2026-03-27 10:30:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-27 10:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-27 10:30:06 [auto1.de] INFO: Batch mode enabled: batch 1/2
2026-03-27 10:30:06 [auto1.de] INFO: Starting spider auto1.de
2026-03-27 10:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-27 10:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-27 10:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-27 10:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-27 10:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: 91f53aa083400ce3
2026-03-27 10:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-27 10:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_17_2026-03-27T10_30_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-27 10:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 10:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 10:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-27 10:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-27 10:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-27 10:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-27 10:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 10:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2114
2026-03-27 10:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-27 10:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-27 10:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:30:07 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-27 10:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-27 10:30:07 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-27 10:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-27 10:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-27 10:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-27 10:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-27 10:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-27 10:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-27 10:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-27 10:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-27 10:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-27 10:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-27 10:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-27 10:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-27 10:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-27 10:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-27 10:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-27 10:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-27 10:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-27 10:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-27 10:30:07 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-27 10:30:07 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-27 10:30:07 [scrapy.core.engine] INFO: Spider opened
2026-03-27 10:30:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-27 10:30:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-27 10:30:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-27 10:30:07 [scrapy-playwright] INFO: Starting download handler
2026-03-27 10:30:07 [scrapy-playwright] INFO: Starting download handler
2026-03-27 10:30:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-27 10:30:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:07 [scrapy.extensions.logstats] INFO: Crawled 1 pages (at 1 pages/min), scraped 0 items (at 0 items/min)
2026-03-27 10:31:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 154MiB
2026-03-27 10:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-27 10:31:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-27 10:31:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-27 10:31:22 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 10476 | hits on page: 40
2026-03-27 10:31:23 [auto1.de] INFO: Found listing with ID: PD92865
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD92865%27 HTTP/1.1" 200 None
2026-03-27 10:31:23 [auto1.de] INFO: Scrape type for PD92865: 1
2026-03-27 10:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:23 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-27 10:31:23 [auto1.de] INFO: Found listing with ID: TR81409
2026-03-27 10:31:23 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30127%27 HTTP/1.1" 200 None
2026-03-27 10:31:23 [auto1.de] INFO: Scrape type for MN30127: 1
2026-03-27 10:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:23 [auto1.de] INFO: Found listing with ID: PM13070
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM13070%27 HTTP/1.1" 200 None
2026-03-27 10:31:23 [auto1.de] INFO: Scrape type for PM13070: 1
2026-03-27 10:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:23 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-27 10:31:23 [auto1.de] INFO: Found listing with ID: TF66313
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF66313%27 HTTP/1.1" 200 None
2026-03-27 10:31:23 [auto1.de] INFO: Scrape type for TF66313: 1
2026-03-27 10:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:23 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-27 10:31:23 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-27 10:31:23 [auto1.de] INFO: Found listing with ID: CZ12085
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ12085%27 HTTP/1.1" 200 None
2026-03-27 10:31:23 [auto1.de] INFO: Scrape type for CZ12085: 1
2026-03-27 10:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:23 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-27 10:31:23 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-27 10:31:23 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08912%27 HTTP/1.1" 200 None
2026-03-27 10:31:23 [auto1.de] INFO: Scrape type for YA08912: 2
2026-03-27 10:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b with identifier: YA08912
2026-03-27 10:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b with scrape type 2
2026-03-27 10:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b with scrape type 2
2026-03-27 10:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b, identifier: YA08912
2026-03-27 10:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b with identifier: YA08912
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-27 10:31:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-27 10:31:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b with identifier: YA08912
2026-03-27 10:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b with identifier: YA08912 to the API
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-28T16:40:47Z',
'fuel_type': 'diesel',
'id': '8cf5c091-e0fd-59e8-9cf0-1f31f7bf8b0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA08912',
'listing': 'auction',
'make': 'Jeep',
'model': 'Grand Cherokee',
'odometer': 130337,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-26',
'seller_name': None,
'title': 'Jeep Grand Cherokee 3.0 CRD Overland',
'transmission': 'automatic',
'trim': 'Overland',
'year': 2013}
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08912%27 HTTP/1.1" 200 None
2026-03-27 10:31:24 [auto1.de] INFO: Saving data for YA08912: {'auction_closing_time': 1774716047.0, 'created_time': 1773830607.538681, 'last_price_update_time': 1774607484.066812}
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA08912') HTTP/1.1" 204 0
2026-03-27 10:31:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:24 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ52783%27 HTTP/1.1" 200 None
2026-03-27 10:31:24 [auto1.de] INFO: Scrape type for CJ52783: 2
2026-03-27 10:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd51997c-a2b2-546a-a07c-8c0a10a46ef2 with identifier: CJ52783
2026-03-27 10:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd51997c-a2b2-546a-a07c-8c0a10a46ef2 with scrape type 2
2026-03-27 10:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd51997c-a2b2-546a-a07c-8c0a10a46ef2 with scrape type 2
2026-03-27 10:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd51997c-a2b2-546a-a07c-8c0a10a46ef2, identifier: CJ52783
2026-03-27 10:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd51997c-a2b2-546a-a07c-8c0a10a46ef2 with identifier: CJ52783
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-27 10:31:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-27 10:31:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd51997c-a2b2-546a-a07c-8c0a10a46ef2 with identifier: CJ52783
2026-03-27 10:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd51997c-a2b2-546a-a07c-8c0a10a46ef2 with identifier: CJ52783 to the API
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-28T16:06:22Z',
'fuel_type': 'petrol',
'id': 'cd51997c-a2b2-546a-a07c-8c0a10a46ef2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ52783',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 41419,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-08-31',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 Goal',
'transmission': 'manual',
'trim': 'Goal',
'year': 2006}
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ52783%27 HTTP/1.1" 200 None
2026-03-27 10:31:24 [auto1.de] INFO: Saving data for CJ52783: {'auction_closing_time': 1774713982.0, 'created_time': 1773304833.969446, 'last_price_update_time': 1774607484.939563}
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ52783') HTTP/1.1" 204 0
2026-03-27 10:31:24 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-27 10:31:24 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-27 10:31:24 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH62859%27 HTTP/1.1" 200 None
2026-03-27 10:31:24 [auto1.de] INFO: Scrape type for EH62859: 2
2026-03-27 10:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c46ab2e5-08a6-5070-8622-2b06d986e09e with identifier: EH62859
2026-03-27 10:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c46ab2e5-08a6-5070-8622-2b06d986e09e with scrape type 2
2026-03-27 10:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c46ab2e5-08a6-5070-8622-2b06d986e09e with scrape type 2
2026-03-27 10:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c46ab2e5-08a6-5070-8622-2b06d986e09e, identifier: EH62859
2026-03-27 10:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c46ab2e5-08a6-5070-8622-2b06d986e09e with identifier: EH62859
2026-03-27 10:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:31:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-27 10:31:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c46ab2e5-08a6-5070-8622-2b06d986e09e with identifier: EH62859
2026-03-27 10:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c46ab2e5-08a6-5070-8622-2b06d986e09e with identifier: EH62859 to the API
2026-03-27 10:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 159,
'expiration_date': '2026-03-28T16:23:36Z',
'fuel_type': 'petrol',
'id': 'c46ab2e5-08a6-5070-8622-2b06d986e09e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH62859',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 84599,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-04',
'seller_name': None,
'title': 'Renault Kadjar 1.3 TCe Bose Edition',
'transmission': 'automatic',
'trim': 'Bose Edition',
'year': 2020}
2026-03-27 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH62859%27 HTTP/1.1" 200 None
2026-03-27 10:31:25 [auto1.de] INFO: Saving data for EH62859: {'auction_closing_time': 1774715016.0, 'created_time': 1773302392.451953, 'last_price_update_time': 1774607485.609213}
2026-03-27 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH62859') HTTP/1.1" 204 0
2026-03-27 10:31:25 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-27 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY64526%27 HTTP/1.1" 200 None
2026-03-27 10:31:25 [auto1.de] INFO: Scrape type for FY64526: 2
2026-03-27 10:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68d25788-6d5f-503c-a51c-b95d0d8ed2d8 with identifier: FY64526
2026-03-27 10:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68d25788-6d5f-503c-a51c-b95d0d8ed2d8 with scrape type 2
2026-03-27 10:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68d25788-6d5f-503c-a51c-b95d0d8ed2d8 with scrape type 2
2026-03-27 10:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68d25788-6d5f-503c-a51c-b95d0d8ed2d8, identifier: FY64526
2026-03-27 10:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68d25788-6d5f-503c-a51c-b95d0d8ed2d8 with identifier: FY64526
2026-03-27 10:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68d25788-6d5f-503c-a51c-b95d0d8ed2d8 with identifier: FY64526
2026-03-27 10:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68d25788-6d5f-503c-a51c-b95d0d8ed2d8 with identifier: FY64526 to the API
2026-03-27 10:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-28T16:44:32Z',
'fuel_type': 'diesel',
'id': '68d25788-6d5f-503c-a51c-b95d0d8ed2d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY64526',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 182219,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-30',
'seller_name': None,
'title': 'Peugeot 2008 1.6 e-HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2013}
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY64526%27 HTTP/1.1" 200 None
2026-03-27 10:31:26 [auto1.de] INFO: Saving data for FY64526: {'auction_closing_time': 1774716272.0, 'created_time': 1773917492.14851, 'last_price_update_time': 1774607486.110111}
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY64526') HTTP/1.1" 204 0
2026-03-27 10:31:26 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX15527%27 HTTP/1.1" 200 None
2026-03-27 10:31:26 [auto1.de] INFO: Scrape type for GX15527: 2
2026-03-27 10:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612e31c7-00f2-5460-90f2-80f2586d9e8a with identifier: GX15527
2026-03-27 10:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612e31c7-00f2-5460-90f2-80f2586d9e8a with scrape type 2
2026-03-27 10:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612e31c7-00f2-5460-90f2-80f2586d9e8a with scrape type 2
2026-03-27 10:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 612e31c7-00f2-5460-90f2-80f2586d9e8a, identifier: GX15527
2026-03-27 10:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 612e31c7-00f2-5460-90f2-80f2586d9e8a with identifier: GX15527
2026-03-27 10:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 612e31c7-00f2-5460-90f2-80f2586d9e8a with identifier: GX15527
2026-03-27 10:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 612e31c7-00f2-5460-90f2-80f2586d9e8a with identifier: GX15527 to the API
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:09:25Z',
'fuel_type': 'petrol',
'id': '612e31c7-00f2-5460-90f2-80f2586d9e8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX15527',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 96818,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-05',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX15527%27 HTTP/1.1" 200 None
2026-03-27 10:31:26 [auto1.de] INFO: Saving data for GX15527: {'auction_closing_time': 1774714165.0, 'created_time': 1773945776.74106, 'last_price_update_time': 1774607486.658833}
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX15527') HTTP/1.1" 204 0
2026-03-27 10:31:26 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL92844%27 HTTP/1.1" 200 None
2026-03-27 10:31:26 [auto1.de] INFO: Scrape type for YL92844: 1
2026-03-27 10:31:26 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78869%27 HTTP/1.1" 200 None
2026-03-27 10:31:26 [auto1.de] INFO: Scrape type for WG78869: 1
2026-03-27 10:31:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:26 [auto1.de] INFO: Found listing with ID: BX52233
2026-03-27 10:31:26 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM31367%27 HTTP/1.1" 200 None
2026-03-27 10:31:26 [auto1.de] INFO: Scrape type for WM31367: 2
2026-03-27 10:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c1b5fc7-88fb-5545-8e7e-850e61202739 with identifier: WM31367
2026-03-27 10:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c1b5fc7-88fb-5545-8e7e-850e61202739 with scrape type 2
2026-03-27 10:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c1b5fc7-88fb-5545-8e7e-850e61202739 with scrape type 2
2026-03-27 10:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c1b5fc7-88fb-5545-8e7e-850e61202739, identifier: WM31367
2026-03-27 10:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c1b5fc7-88fb-5545-8e7e-850e61202739 with identifier: WM31367
2026-03-27 10:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c1b5fc7-88fb-5545-8e7e-850e61202739 with identifier: WM31367
2026-03-27 10:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c1b5fc7-88fb-5545-8e7e-850e61202739 with identifier: WM31367 to the API
2026-03-27 10:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 450,
'expiration_date': '2026-03-28T16:29:06Z',
'fuel_type': 'petrol',
'id': '5c1b5fc7-88fb-5545-8e7e-850e61202739',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM31367',
'listing': 'auction',
'make': 'Ford',
'model': 'Mustang',
'odometer': 72082,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-15',
'seller_name': None,
'title': 'Ford Mustang 5.0 Ti-VCT V8 GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2020}
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM31367%27 HTTP/1.1" 200 None
2026-03-27 10:31:27 [auto1.de] INFO: Saving data for WM31367: {'auction_closing_time': 1774715346.0, 'created_time': 1772546454.546687, 'last_price_update_time': 1774607487.217958}
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM31367') HTTP/1.1" 204 0
2026-03-27 10:31:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:27 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-27 10:31:27 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK83819%27 HTTP/1.1" 200 None
2026-03-27 10:31:27 [auto1.de] INFO: Scrape type for NK83819: 1
2026-03-27 10:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:27 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG37810%27 HTTP/1.1" 200 None
2026-03-27 10:31:27 [auto1.de] INFO: Scrape type for MG37810: 1
2026-03-27 10:31:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:27 [auto1.de] INFO: Found listing with ID: SV13508
2026-03-27 10:31:27 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-27 10:31:27 [auto1.de] INFO: Found listing with ID: TE41931
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE41931%27 HTTP/1.1" 200 None
2026-03-27 10:31:27 [auto1.de] INFO: Scrape type for TE41931: 1
2026-03-27 10:31:27 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD33755%27 HTTP/1.1" 200 None
2026-03-27 10:31:27 [auto1.de] INFO: Scrape type for PD33755: 2
2026-03-27 10:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc787f5f-1bb5-5093-a3d6-9f28304ec9a9 with identifier: PD33755
2026-03-27 10:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc787f5f-1bb5-5093-a3d6-9f28304ec9a9 with scrape type 2
2026-03-27 10:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc787f5f-1bb5-5093-a3d6-9f28304ec9a9 with scrape type 2
2026-03-27 10:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc787f5f-1bb5-5093-a3d6-9f28304ec9a9, identifier: PD33755
2026-03-27 10:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc787f5f-1bb5-5093-a3d6-9f28304ec9a9 with identifier: PD33755
2026-03-27 10:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc787f5f-1bb5-5093-a3d6-9f28304ec9a9 with identifier: PD33755
2026-03-27 10:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc787f5f-1bb5-5093-a3d6-9f28304ec9a9 with identifier: PD33755 to the API
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:39:52Z',
'fuel_type': 'diesel',
'id': 'fc787f5f-1bb5-5093-a3d6-9f28304ec9a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD33755',
'listing': 'auction',
'make': 'Volvo',
'model': 'V90',
'odometer': 199225,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-27',
'seller_name': None,
'title': 'Volvo V90 2.0 D4 R-Design',
'transmission': 'automatic',
'trim': 'R-Design',
'year': 2018}
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD33755%27 HTTP/1.1" 200 None
2026-03-27 10:31:27 [auto1.de] INFO: Saving data for PD33755: {'auction_closing_time': 1774715992.0, 'created_time': 1773429093.606501, 'last_price_update_time': 1774607487.781619}
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD33755') HTTP/1.1" 204 0
2026-03-27 10:31:27 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-27 10:31:27 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW31978%27 HTTP/1.1" 200 None
2026-03-27 10:31:27 [auto1.de] INFO: Scrape type for MW31978: 2
2026-03-27 10:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3d1ba04-710d-568f-97ee-d9ca1e5da2b7 with identifier: MW31978
2026-03-27 10:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d1ba04-710d-568f-97ee-d9ca1e5da2b7 with scrape type 2
2026-03-27 10:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3d1ba04-710d-568f-97ee-d9ca1e5da2b7 with scrape type 2
2026-03-27 10:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3d1ba04-710d-568f-97ee-d9ca1e5da2b7, identifier: MW31978
2026-03-27 10:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3d1ba04-710d-568f-97ee-d9ca1e5da2b7 with identifier: MW31978
2026-03-27 10:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3d1ba04-710d-568f-97ee-d9ca1e5da2b7 with identifier: MW31978
2026-03-27 10:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3d1ba04-710d-568f-97ee-d9ca1e5da2b7 with identifier: MW31978 to the API
2026-03-27 10:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:29:05Z',
'fuel_type': 'petrol',
'id': 'c3d1ba04-710d-568f-97ee-d9ca1e5da2b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW31978',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 46994,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-14',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.5 eTSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2024}
2026-03-27 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW31978%27 HTTP/1.1" 200 None
2026-03-27 10:31:28 [auto1.de] INFO: Saving data for MW31978: {'auction_closing_time': 1774715345.0, 'created_time': 1773775515.30162, 'last_price_update_time': 1774607488.590794}
2026-03-27 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW31978') HTTP/1.1" 204 0
2026-03-27 10:31:28 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 10476 | hits on page: 40
2026-03-27 10:31:28 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-27 10:31:28 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-27 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM50806%27 HTTP/1.1" 200 None
2026-03-27 10:31:28 [auto1.de] INFO: Scrape type for WM50806: 1
2026-03-27 10:31:28 [auto1.de] INFO: Found listing with ID: PD92865
2026-03-27 10:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PD92865/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:28 [auto1.de] INFO: Found listing with ID: VM88505
2026-03-27 10:31:28 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-27 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71041%27 HTTP/1.1" 200 None
2026-03-27 10:31:28 [auto1.de] INFO: Scrape type for FJ71041: 2
2026-03-27 10:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 491aaf14-d194-56ff-9ea6-d5f7177e1bb3 with identifier: FJ71041
2026-03-27 10:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 491aaf14-d194-56ff-9ea6-d5f7177e1bb3 with scrape type 2
2026-03-27 10:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 491aaf14-d194-56ff-9ea6-d5f7177e1bb3 with scrape type 2
2026-03-27 10:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 491aaf14-d194-56ff-9ea6-d5f7177e1bb3, identifier: FJ71041
2026-03-27 10:31:28 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/PD92865/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-27 10:31:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 491aaf14-d194-56ff-9ea6-d5f7177e1bb3 with identifier: FJ71041
2026-03-27 10:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 491aaf14-d194-56ff-9ea6-d5f7177e1bb3 with identifier: FJ71041
2026-03-27 10:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 491aaf14-d194-56ff-9ea6-d5f7177e1bb3 with identifier: FJ71041 to the API
2026-03-27 10:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:28:13Z',
'fuel_type': 'petrol',
'id': '491aaf14-d194-56ff-9ea6-d5f7177e1bb3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ71041',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 79714,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-02',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2022}
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71041%27 HTTP/1.1" 200 None
2026-03-27 10:31:29 [auto1.de] INFO: Saving data for FJ71041: {'auction_closing_time': 1774715293.0, 'created_time': 1773229493.252307, 'last_price_update_time': 1774607489.191047}
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ71041') HTTP/1.1" 204 0
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: TR81409
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT27360%27 HTTP/1.1" 200 None
2026-03-27 10:31:29 [auto1.de] INFO: Scrape type for RT27360: 2
2026-03-27 10:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1053ddd0-2e1c-51ce-aaa8-24d04d06c897 with identifier: RT27360
2026-03-27 10:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1053ddd0-2e1c-51ce-aaa8-24d04d06c897 with scrape type 2
2026-03-27 10:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1053ddd0-2e1c-51ce-aaa8-24d04d06c897 with scrape type 2
2026-03-27 10:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1053ddd0-2e1c-51ce-aaa8-24d04d06c897, identifier: RT27360
2026-03-27 10:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1053ddd0-2e1c-51ce-aaa8-24d04d06c897 with identifier: RT27360
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-27 10:31:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1053ddd0-2e1c-51ce-aaa8-24d04d06c897 with identifier: RT27360
2026-03-27 10:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1053ddd0-2e1c-51ce-aaa8-24d04d06c897 with identifier: RT27360 to the API
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:45:01Z',
'fuel_type': 'petrol',
'id': '1053ddd0-2e1c-51ce-aaa8-24d04d06c897',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT27360',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 13951,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-19',
'seller_name': None,
'title': 'Renault Captur 1.3 TCe Mild-Hybrid Evolution',
'transmission': 'automatic',
'trim': 'Evolution',
'year': 2023}
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT27360%27 HTTP/1.1" 200 None
2026-03-27 10:31:29 [auto1.de] INFO: Saving data for RT27360: {'auction_closing_time': 1774716301.0, 'created_time': 1773426998.384676, 'last_price_update_time': 1774607489.82338}
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT27360') HTTP/1.1" 204 0
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: PM13070
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: LA39027
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: TF66313
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: CZ12085
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08912%27 HTTP/1.1" 200 None
2026-03-27 10:31:29 [auto1.de] INFO: Scrape type for YA08912: 0
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ52783%27 HTTP/1.1" 200 None
2026-03-27 10:31:29 [auto1.de] INFO: Scrape type for CJ52783: 0
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH62859%27 HTTP/1.1" 200 None
2026-03-27 10:31:29 [auto1.de] INFO: Scrape type for EH62859: 0
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY64526%27 HTTP/1.1" 200 None
2026-03-27 10:31:29 [auto1.de] INFO: Scrape type for FY64526: 0
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX15527%27 HTTP/1.1" 200 None
2026-03-27 10:31:29 [auto1.de] INFO: Scrape type for GX15527: 0
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: BX52233
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM31367%27 HTTP/1.1" 200 None
2026-03-27 10:31:29 [auto1.de] INFO: Scrape type for WM31367: 0
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: SV13508
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: TE41931
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD33755%27 HTTP/1.1" 200 None
2026-03-27 10:31:29 [auto1.de] INFO: Scrape type for PD33755: 0
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW31978%27 HTTP/1.1" 200 None
2026-03-27 10:31:29 [auto1.de] INFO: Scrape type for MW31978: 0
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: VM88505
2026-03-27 10:31:29 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-27 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71041%27 HTTP/1.1" 200 None
2026-03-27 10:31:30 [auto1.de] INFO: Scrape type for FJ71041: 0
2026-03-27 10:31:30 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-27 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT27360%27 HTTP/1.1" 200 None
2026-03-27 10:31:30 [auto1.de] INFO: Scrape type for RT27360: 0
2026-03-27 10:31:30 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-27 10:31:30 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-27 10:31:30 [auto1.de] INFO: Found listing with ID: LA39027
2026-03-27 10:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MG37810/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK83819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG78869/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TE41931/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ12085/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PD92865> (referer: https://www.auto1.com/v1/car-details-view/PD92865/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e316798-c173-5f1d-be5d-805589dc3c29 with identifier: PD92865
2026-03-27 10:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e316798-c173-5f1d-be5d-805589dc3c29 with scrape type 1
2026-03-27 10:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1e316798-c173-5f1d-be5d-805589dc3c29
2026-03-27 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F20%252F9c20510a2610f3683e282eee2a8ec573%252Fpa%252FPD92865_0b6f4c96cbc2c17f5c02bf80862f3b8a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_0b6f4c96cbc2c17f5c02bf80862f3b8a.jpg not downloaded yet
2026-03-27 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F20%252F9c20510a2610f3683e282eee2a8ec573%252Fpa%252FPD92865_685901e2911a605a0c41f844dddd3e70.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_685901e2911a605a0c41f844dddd3e70.jpg not downloaded yet
2026-03-27 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F20%252F9c20510a2610f3683e282eee2a8ec573%252Fpa%252FPD92865_0165c63e479bc3238c5efd53770aeae6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_0165c63e479bc3238c5efd53770aeae6.jpg not downloaded yet
2026-03-27 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F20%252F9c20510a2610f3683e282eee2a8ec573%252Fpa%252FPD92865_232ca6fe2f1f904bf43f196c23d44bdb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_232ca6fe2f1f904bf43f196c23d44bdb.jpg not downloaded yet
2026-03-27 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F20%252F9c20510a2610f3683e282eee2a8ec573%252Fpa%252FPD92865_e6e717d5b9b26858e624ec16b61b5ef5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_e6e717d5b9b26858e624ec16b61b5ef5.jpg not downloaded yet
2026-03-27 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F20%252F9c20510a2610f3683e282eee2a8ec573%252Fpa%252FPD92865_6120603113d6de1e1509acde9573b931.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_6120603113d6de1e1509acde9573b931.jpg not downloaded yet
2026-03-27 10:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WM50806/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_e6e717d5b9b26858e624ec16b61b5ef5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_232ca6fe2f1f904bf43f196c23d44bdb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_685901e2911a605a0c41f844dddd3e70.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_0165c63e479bc3238c5efd53770aeae6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_0b6f4c96cbc2c17f5c02bf80862f3b8a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_6120603113d6de1e1509acde9573b931.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4540d0>
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e316798-c173-5f1d-be5d-805589dc3c29/1e316798-c173-5f1d-be5d-805589dc3c29_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F20%252F9c20510a2610f3683e282eee2a8ec573%252Fpa%252FPD92865_e6e717d5b9b26858e624ec16b61b5ef5.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_e6e717d5b9b26858e624ec16b61b5ef5.jpg saved to cache
2026-03-27 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e316798-c173-5f1d-be5d-805589dc3c29
2026-03-27 10:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL92844/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf541790>
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e316798-c173-5f1d-be5d-805589dc3c29/1e316798-c173-5f1d-be5d-805589dc3c29_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F20%252F9c20510a2610f3683e282eee2a8ec573%252Fpa%252FPD92865_232ca6fe2f1f904bf43f196c23d44bdb.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_232ca6fe2f1f904bf43f196c23d44bdb.jpg saved to cache
2026-03-27 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e316798-c173-5f1d-be5d-805589dc3c29
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3ee5d0>
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e316798-c173-5f1d-be5d-805589dc3c29/1e316798-c173-5f1d-be5d-805589dc3c29_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F20%252F9c20510a2610f3683e282eee2a8ec573%252Fpa%252FPD92865_685901e2911a605a0c41f844dddd3e70.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_685901e2911a605a0c41f844dddd3e70.jpg saved to cache
2026-03-27 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e316798-c173-5f1d-be5d-805589dc3c29
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf404950>
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e316798-c173-5f1d-be5d-805589dc3c29/1e316798-c173-5f1d-be5d-805589dc3c29_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F20%252F9c20510a2610f3683e282eee2a8ec573%252Fpa%252FPD92865_0165c63e479bc3238c5efd53770aeae6.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_0165c63e479bc3238c5efd53770aeae6.jpg saved to cache
2026-03-27 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e316798-c173-5f1d-be5d-805589dc3c29
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3df450>
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e316798-c173-5f1d-be5d-805589dc3c29/1e316798-c173-5f1d-be5d-805589dc3c29_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F20%252F9c20510a2610f3683e282eee2a8ec573%252Fpa%252FPD92865_0b6f4c96cbc2c17f5c02bf80862f3b8a.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_0b6f4c96cbc2c17f5c02bf80862f3b8a.jpg saved to cache
2026-03-27 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e316798-c173-5f1d-be5d-805589dc3c29
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be216a90>
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e316798-c173-5f1d-be5d-805589dc3c29/1e316798-c173-5f1d-be5d-805589dc3c29_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F20%252F9c20510a2610f3683e282eee2a8ec573%252Fpa%252FPD92865_6120603113d6de1e1509acde9573b931.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_6120603113d6de1e1509acde9573b931.jpg saved to cache
2026-03-27 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e316798-c173-5f1d-be5d-805589dc3c29
2026-03-27 10:31:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e316798-c173-5f1d-be5d-805589dc3c29, skipping ID generation
2026-03-27 10:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e316798-c173-5f1d-be5d-805589dc3c29 with scrape type 1
2026-03-27 10:31:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e316798-c173-5f1d-be5d-805589dc3c29 sending to next pipeline
2026-03-27 10:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e316798-c173-5f1d-be5d-805589dc3c29, identifier: PD92865
2026-03-27 10:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e316798-c173-5f1d-be5d-805589dc3c29 with identifier: PD92865
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-27 10:31:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e316798-c173-5f1d-be5d-805589dc3c29 with identifier: PD92865
2026-03-27 10:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e316798-c173-5f1d-be5d-805589dc3c29 with identifier: PD92865 to the API
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_6120603113d6de1e1509acde9573b931.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:50:57Z',
'fuel_type': 'diesel',
'id': '1e316798-c173-5f1d-be5d-805589dc3c29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD92865',
'listing': 'auction',
'location': 'DE, Berlin',
'make': 'Ford',
'model': 'C-Max',
'odometer': 104383,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e316798-c173-5f1d-be5d-805589dc3c29/1e316798-c173-5f1d-be5d-805589dc3c29_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85413,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_0b6f4c96cbc2c17f5c02bf80862f3b8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e316798-c173-5f1d-be5d-805589dc3c29/1e316798-c173-5f1d-be5d-805589dc3c29_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91376,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_685901e2911a605a0c41f844dddd3e70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e316798-c173-5f1d-be5d-805589dc3c29/1e316798-c173-5f1d-be5d-805589dc3c29_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78325,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_0165c63e479bc3238c5efd53770aeae6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e316798-c173-5f1d-be5d-805589dc3c29/1e316798-c173-5f1d-be5d-805589dc3c29_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71723,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_232ca6fe2f1f904bf43f196c23d44bdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e316798-c173-5f1d-be5d-805589dc3c29/1e316798-c173-5f1d-be5d-805589dc3c29_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72981,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_e6e717d5b9b26858e624ec16b61b5ef5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e316798-c173-5f1d-be5d-805589dc3c29/1e316798-c173-5f1d-be5d-805589dc3c29_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/20/9c20510a2610f3683e282eee2a8ec573/pa/PD92865_6120603113d6de1e1509acde9573b931.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-06-17',
'seats_number': 5,
'seller_name': None,
'title': 'Ford C-Max 1.6 TDCi Style+',
'transmission': 'manual',
'trim': 'Style+',
'year': 2009}
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD92865%27 HTTP/1.1" 200 None
2026-03-27 10:31:34 [auto1.de] INFO: Saving data for PD92865: {'created_time': 1774607494.306384, 'last_price_update_time': 1774607494.306399, 'auction_closing_time': 1774716657.0}
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD92865') HTTP/1.1" 204 0
2026-03-27 10:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK83819> (referer: https://www.auto1.com/v1/car-details-view/NK83819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG78869> (referer: https://www.auto1.com/v1/car-details-view/WG78869/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:34 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 10477 | hits on page: 40
2026-03-27 10:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f9f659-1548-59ce-a865-56311a1774ba with identifier: NK83819
2026-03-27 10:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f9f659-1548-59ce-a865-56311a1774ba with scrape type 1
2026-03-27 10:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d5f9f659-1548-59ce-a865-56311a1774ba
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F1a%252F721adb36448d6d7d358cea0063e0372a%252Fpa%252FNK83819_4ac8367100e99b9213a61c6bc4265f4b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_4ac8367100e99b9213a61c6bc4265f4b.jpg not downloaded yet
2026-03-27 10:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c245e6af-c309-5511-a47e-0cf99fc5d6e6 with identifier: WG78869
2026-03-27 10:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c245e6af-c309-5511-a47e-0cf99fc5d6e6 with scrape type 1
2026-03-27 10:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c245e6af-c309-5511-a47e-0cf99fc5d6e6
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F74%252Fdf74d03fc58f8eafb60907a4a474a933%252Fpa%252FWG78869_44784fe34ed15bc5ad841724d4f047de.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_44784fe34ed15bc5ad841724d4f047de.jpg not downloaded yet
2026-03-27 10:31:34 [auto1.de] INFO: Found listing with ID: LA39027
2026-03-27 10:31:34 [auto1.de] INFO: Found listing with ID: EM63340
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM63340%27 HTTP/1.1" 200 None
2026-03-27 10:31:34 [auto1.de] INFO: Scrape type for EM63340: 1
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F1a%252F721adb36448d6d7d358cea0063e0372a%252Fpa%252FNK83819_bbb6b86d54dbd0a36ad0831781a04ae3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_bbb6b86d54dbd0a36ad0831781a04ae3.jpg not downloaded yet
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F74%252Fdf74d03fc58f8eafb60907a4a474a933%252Fpa%252FWG78869_8d1b636aec9c1559448e4debcbb46e72.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_8d1b636aec9c1559448e4debcbb46e72.jpg not downloaded yet
2026-03-27 10:31:34 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL42173%27 HTTP/1.1" 200 None
2026-03-27 10:31:34 [auto1.de] INFO: Scrape type for TL42173: 2
2026-03-27 10:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cebd0460-5f0e-5091-be95-be83e214fcca with identifier: TL42173
2026-03-27 10:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cebd0460-5f0e-5091-be95-be83e214fcca with scrape type 2
2026-03-27 10:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cebd0460-5f0e-5091-be95-be83e214fcca with scrape type 2
2026-03-27 10:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cebd0460-5f0e-5091-be95-be83e214fcca, identifier: TL42173
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F1a%252F721adb36448d6d7d358cea0063e0372a%252Fpa%252FNK83819_8945b021a262c4d6e0e323bfe8857f24.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_8945b021a262c4d6e0e323bfe8857f24.jpg not downloaded yet
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F74%252Fdf74d03fc58f8eafb60907a4a474a933%252Fpa%252FWG78869_f4a62ea8ad79a3dad14778a4f9721b45.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_f4a62ea8ad79a3dad14778a4f9721b45.jpg not downloaded yet
2026-03-27 10:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cebd0460-5f0e-5091-be95-be83e214fcca with identifier: TL42173
2026-03-27 10:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cebd0460-5f0e-5091-be95-be83e214fcca with identifier: TL42173
2026-03-27 10:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cebd0460-5f0e-5091-be95-be83e214fcca with identifier: TL42173 to the API
2026-03-27 10:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:00:35Z',
'fuel_type': 'petrol',
'id': 'cebd0460-5f0e-5091-be95-be83e214fcca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL42173',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 109274,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-24',
'seller_name': None,
'title': 'Hyundai i10 1.1 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2012}
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL42173%27 HTTP/1.1" 200 None
2026-03-27 10:31:35 [auto1.de] INFO: Saving data for TL42173: {'auction_closing_time': 1774713635.0, 'created_time': 1774071034.545013, 'last_price_update_time': 1774607495.277918}
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL42173') HTTP/1.1" 204 0
2026-03-27 10:31:35 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-27 10:31:35 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-27 10:31:35 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB94614%27 HTTP/1.1" 200 None
2026-03-27 10:31:35 [auto1.de] INFO: Scrape type for MB94614: 1
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F1a%252F721adb36448d6d7d358cea0063e0372a%252Fpa%252FNK83819_e25d9c5c423ec16b07ae57d8e5b70b61.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_e25d9c5c423ec16b07ae57d8e5b70b61.jpg not downloaded yet
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F74%252Fdf74d03fc58f8eafb60907a4a474a933%252Fpa%252FWG78869_3f723ab9230eb6ac583b326c75429dd1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_3f723ab9230eb6ac583b326c75429dd1.jpg not downloaded yet
2026-03-27 10:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_4ac8367100e99b9213a61c6bc4265f4b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_44784fe34ed15bc5ad841724d4f047de.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:35 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-27 10:31:35 [auto1.de] INFO: Found listing with ID: KY59799
2026-03-27 10:31:35 [auto1.de] INFO: Found listing with ID: NG10221
2026-03-27 10:31:35 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK28238%27 HTTP/1.1" 200 None
2026-03-27 10:31:35 [auto1.de] INFO: Scrape type for ZK28238: 1
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F1a%252F721adb36448d6d7d358cea0063e0372a%252Fpa%252FNK83819_dedb5378b6d17b3b984d0e3cfc1d9019.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_dedb5378b6d17b3b984d0e3cfc1d9019.jpg not downloaded yet
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F74%252Fdf74d03fc58f8eafb60907a4a474a933%252Fpa%252FWG78869_5e887a20a019f547fa431dab4a6a76c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_5e887a20a019f547fa431dab4a6a76c1.jpg not downloaded yet
2026-03-27 10:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF66313/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:35 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17232%27 HTTP/1.1" 200 None
2026-03-27 10:31:35 [auto1.de] INFO: Scrape type for RE17232: 2
2026-03-27 10:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23e455b8-884b-5ad9-9451-660113979c82 with identifier: RE17232
2026-03-27 10:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23e455b8-884b-5ad9-9451-660113979c82 with scrape type 2
2026-03-27 10:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23e455b8-884b-5ad9-9451-660113979c82 with scrape type 2
2026-03-27 10:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23e455b8-884b-5ad9-9451-660113979c82, identifier: RE17232
2026-03-27 10:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM13070/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TE41931> (referer: https://www.auto1.com/v1/car-details-view/TE41931/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23e455b8-884b-5ad9-9451-660113979c82 with identifier: RE17232
2026-03-27 10:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23e455b8-884b-5ad9-9451-660113979c82 with identifier: RE17232
2026-03-27 10:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23e455b8-884b-5ad9-9451-660113979c82 with identifier: RE17232 to the API
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 457,
'expiration_date': '2026-03-28T16:50:17Z',
'fuel_type': 'petrol',
'id': '23e455b8-884b-5ad9-9451-660113979c82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE17232',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 98693,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-19',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 53 AMG Mild-Hybrid T 4Matic+',
'transmission': 'automatic',
'trim': 'T 4Matic+',
'year': 2018}
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17232%27 HTTP/1.1" 200 None
2026-03-27 10:31:35 [auto1.de] INFO: Saving data for RE17232: {'auction_closing_time': 1774716617.0, 'created_time': 1774349950.366438, 'last_price_update_time': 1774607495.936832}
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE17232') HTTP/1.1" 204 0
2026-03-27 10:31:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN30127/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_3f723ab9230eb6ac583b326c75429dd1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:36 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW88691%27 HTTP/1.1" 200 None
2026-03-27 10:31:36 [auto1.de] INFO: Scrape type for YW88691: 1
2026-03-27 10:31:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_8d1b636aec9c1559448e4debcbb46e72.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_e25d9c5c423ec16b07ae57d8e5b70b61.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_bbb6b86d54dbd0a36ad0831781a04ae3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_8945b021a262c4d6e0e323bfe8857f24.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_f4a62ea8ad79a3dad14778a4f9721b45.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:36 [auto1.de] INFO: Found listing with ID: HK36179
2026-03-27 10:31:36 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE30876%27 HTTP/1.1" 200 None
2026-03-27 10:31:36 [auto1.de] INFO: Scrape type for UE30876: 1
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5eea90>
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f9f659-1548-59ce-a865-56311a1774ba/d5f9f659-1548-59ce-a865-56311a1774ba_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F1a%252F721adb36448d6d7d358cea0063e0372a%252Fpa%252FNK83819_4ac8367100e99b9213a61c6bc4265f4b.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_4ac8367100e99b9213a61c6bc4265f4b.jpg saved to cache
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5f9f659-1548-59ce-a865-56311a1774ba
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b33d0>
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c245e6af-c309-5511-a47e-0cf99fc5d6e6/c245e6af-c309-5511-a47e-0cf99fc5d6e6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F74%252Fdf74d03fc58f8eafb60907a4a474a933%252Fpa%252FWG78869_44784fe34ed15bc5ad841724d4f047de.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_44784fe34ed15bc5ad841724d4f047de.jpg saved to cache
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c245e6af-c309-5511-a47e-0cf99fc5d6e6
2026-03-27 10:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0366b08b-3323-5348-9f58-b06c9b82d43a with identifier: TE41931
2026-03-27 10:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0366b08b-3323-5348-9f58-b06c9b82d43a with scrape type 1
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0366b08b-3323-5348-9f58-b06c9b82d43a
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F67%252F3467282c69428371108c07a1a72304ff%252Fpa%252FTE41931_0e40ae62bc02249cf2ce40def88e1775.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_0e40ae62bc02249cf2ce40def88e1775.jpg not downloaded yet
2026-03-27 10:31:36 [auto1.de] INFO: Found listing with ID: DF69059
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF69059%27 HTTP/1.1" 200 None
2026-03-27 10:31:36 [auto1.de] INFO: Scrape type for DF69059: 1
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F67%252F3467282c69428371108c07a1a72304ff%252Fpa%252FTE41931_6d933a5d348b9bf9c32f1721d14c8b19.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_6d933a5d348b9bf9c32f1721d14c8b19.jpg not downloaded yet
2026-03-27 10:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ12085> (referer: https://www.auto1.com/v1/car-details-view/CZ12085/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:36 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-27 10:31:36 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-27 10:31:36 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG00954%27 HTTP/1.1" 200 None
2026-03-27 10:31:36 [auto1.de] INFO: Scrape type for WG00954: 1
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F67%252F3467282c69428371108c07a1a72304ff%252Fpa%252FTE41931_b49c13f39755983920412b8c7bd258b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_b49c13f39755983920412b8c7bd258b8.jpg not downloaded yet
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b7590>
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c245e6af-c309-5511-a47e-0cf99fc5d6e6/c245e6af-c309-5511-a47e-0cf99fc5d6e6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F74%252Fdf74d03fc58f8eafb60907a4a474a933%252Fpa%252FWG78869_3f723ab9230eb6ac583b326c75429dd1.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_3f723ab9230eb6ac583b326c75429dd1.jpg saved to cache
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c245e6af-c309-5511-a47e-0cf99fc5d6e6
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2ab690>
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c245e6af-c309-5511-a47e-0cf99fc5d6e6/c245e6af-c309-5511-a47e-0cf99fc5d6e6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F74%252Fdf74d03fc58f8eafb60907a4a474a933%252Fpa%252FWG78869_8d1b636aec9c1559448e4debcbb46e72.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_8d1b636aec9c1559448e4debcbb46e72.jpg saved to cache
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c245e6af-c309-5511-a47e-0cf99fc5d6e6
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3d4290>
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f9f659-1548-59ce-a865-56311a1774ba/d5f9f659-1548-59ce-a865-56311a1774ba_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F1a%252F721adb36448d6d7d358cea0063e0372a%252Fpa%252FNK83819_e25d9c5c423ec16b07ae57d8e5b70b61.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_e25d9c5c423ec16b07ae57d8e5b70b61.jpg saved to cache
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d5f9f659-1548-59ce-a865-56311a1774ba
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be162710>
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f9f659-1548-59ce-a865-56311a1774ba/d5f9f659-1548-59ce-a865-56311a1774ba_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F1a%252F721adb36448d6d7d358cea0063e0372a%252Fpa%252FNK83819_bbb6b86d54dbd0a36ad0831781a04ae3.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_bbb6b86d54dbd0a36ad0831781a04ae3.jpg saved to cache
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d5f9f659-1548-59ce-a865-56311a1774ba
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf54a0d0>
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f9f659-1548-59ce-a865-56311a1774ba/d5f9f659-1548-59ce-a865-56311a1774ba_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F1a%252F721adb36448d6d7d358cea0063e0372a%252Fpa%252FNK83819_8945b021a262c4d6e0e323bfe8857f24.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_8945b021a262c4d6e0e323bfe8857f24.jpg saved to cache
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d5f9f659-1548-59ce-a865-56311a1774ba
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2ab690>
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c245e6af-c309-5511-a47e-0cf99fc5d6e6/c245e6af-c309-5511-a47e-0cf99fc5d6e6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F74%252Fdf74d03fc58f8eafb60907a4a474a933%252Fpa%252FWG78869_f4a62ea8ad79a3dad14778a4f9721b45.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_f4a62ea8ad79a3dad14778a4f9721b45.jpg saved to cache
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c245e6af-c309-5511-a47e-0cf99fc5d6e6
2026-03-27 10:31:36 [auto1.de] INFO: Found listing with ID: ZK69536
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK69536%27 HTTP/1.1" 200 None
2026-03-27 10:31:36 [auto1.de] INFO: Scrape type for ZK69536: 1
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F67%252F3467282c69428371108c07a1a72304ff%252Fpa%252FTE41931_06b6f09b8616501f707e4164934f7e4d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_06b6f09b8616501f707e4164934f7e4d.jpg not downloaded yet
2026-03-27 10:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_0e40ae62bc02249cf2ce40def88e1775.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:36 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-27 10:31:36 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD44201%27 HTTP/1.1" 200 None
2026-03-27 10:31:36 [auto1.de] INFO: Scrape type for BD44201: 2
2026-03-27 10:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69c631cc-a091-5d47-ac9c-8aad38f66977 with identifier: BD44201
2026-03-27 10:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69c631cc-a091-5d47-ac9c-8aad38f66977 with scrape type 2
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69c631cc-a091-5d47-ac9c-8aad38f66977 with scrape type 2
2026-03-27 10:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69c631cc-a091-5d47-ac9c-8aad38f66977, identifier: BD44201
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F67%252F3467282c69428371108c07a1a72304ff%252Fpa%252FTE41931_6490558787f79ebe7e238c71fcd6f911.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_6490558787f79ebe7e238c71fcd6f911.jpg not downloaded yet
2026-03-27 10:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03 with identifier: CZ12085
2026-03-27 10:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03 with scrape type 1
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F37%252F943749232f06296f5869faa9de688b6d%252Fpa%252FCZ12085_d1eba88cd7069ef4b96c10317ea03157.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_d1eba88cd7069ef4b96c10317ea03157.jpg not downloaded yet
2026-03-27 10:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69c631cc-a091-5d47-ac9c-8aad38f66977 with identifier: BD44201
2026-03-27 10:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69c631cc-a091-5d47-ac9c-8aad38f66977 with identifier: BD44201
2026-03-27 10:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69c631cc-a091-5d47-ac9c-8aad38f66977 with identifier: BD44201 to the API
2026-03-27 10:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:42:18Z',
'fuel_type': 'diesel',
'id': '69c631cc-a091-5d47-ac9c-8aad38f66977',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD44201',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 89877,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-26',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2018}
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD44201%27 HTTP/1.1" 200 None
2026-03-27 10:31:37 [auto1.de] INFO: Saving data for BD44201: {'auction_closing_time': 1774716138.0, 'created_time': 1773830655.282444, 'last_price_update_time': 1774607497.212856}
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD44201') HTTP/1.1" 204 0
2026-03-27 10:31:37 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-27 10:31:37 [auto1.de] INFO: Found listing with ID: SZ69357
2026-03-27 10:31:37 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-27 10:31:37 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-27 10:31:37 [auto1.de] INFO: Found listing with ID: NG01563
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG01563%27 HTTP/1.1" 200 None
2026-03-27 10:31:37 [auto1.de] INFO: Scrape type for NG01563: 1
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F37%252F943749232f06296f5869faa9de688b6d%252Fpa%252FCZ12085_a2516a04a51424cde2d735b328292437.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_a2516a04a51424cde2d735b328292437.jpg not downloaded yet
2026-03-27 10:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_6d933a5d348b9bf9c32f1721d14c8b19.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB94614/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2abf10>
2026-03-27 10:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0366b08b-3323-5348-9f58-b06c9b82d43a/0366b08b-3323-5348-9f58-b06c9b82d43a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F67%252F3467282c69428371108c07a1a72304ff%252Fpa%252FTE41931_0e40ae62bc02249cf2ce40def88e1775.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_0e40ae62bc02249cf2ce40def88e1775.jpg saved to cache
2026-03-27 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0366b08b-3323-5348-9f58-b06c9b82d43a
2026-03-27 10:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_5e887a20a019f547fa431dab4a6a76c1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:37 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-27 10:31:37 [auto1.de] INFO: Found listing with ID: XX11179
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX11179%27 HTTP/1.1" 200 None
2026-03-27 10:31:37 [auto1.de] INFO: Scrape type for XX11179: 1
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F37%252F943749232f06296f5869faa9de688b6d%252Fpa%252FCZ12085_3a8f5ad8358b10c99309e4b9df648709.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_3a8f5ad8358b10c99309e4b9df648709.jpg not downloaded yet
2026-03-27 10:31:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL92844> (referer: https://www.auto1.com/v1/car-details-view/YL92844/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:37 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-27 10:31:37 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-27 10:31:37 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-27 10:31:37 [auto1.de] INFO: Found listing with ID: HK63697
2026-03-27 10:31:37 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-27 10:31:37 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-27 10:31:37 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU27688%27 HTTP/1.1" 200 None
2026-03-27 10:31:37 [auto1.de] INFO: Scrape type for AU27688: 1
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F37%252F943749232f06296f5869faa9de688b6d%252Fpa%252FCZ12085_6212269f38983100303308b2f7134a20.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_6212269f38983100303308b2f7134a20.jpg not downloaded yet
2026-03-27 10:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM63340/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:37 [auto1.de] INFO: Found listing with ID: RM96597
2026-03-27 10:31:37 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU23189%27 HTTP/1.1" 200 None
2026-03-27 10:31:37 [auto1.de] INFO: Scrape type for JU23189: 1
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F37%252F943749232f06296f5869faa9de688b6d%252Fpa%252FCZ12085_74ff4669953cd062528796e9fe1d8616.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_74ff4669953cd062528796e9fe1d8616.jpg not downloaded yet
2026-03-27 10:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2f1790>
2026-03-27 10:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0366b08b-3323-5348-9f58-b06c9b82d43a/0366b08b-3323-5348-9f58-b06c9b82d43a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F67%252F3467282c69428371108c07a1a72304ff%252Fpa%252FTE41931_6d933a5d348b9bf9c32f1721d14c8b19.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_6d933a5d348b9bf9c32f1721d14c8b19.jpg saved to cache
2026-03-27 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0366b08b-3323-5348-9f58-b06c9b82d43a
2026-03-27 10:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_06b6f09b8616501f707e4164934f7e4d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:37 [auto1.de] INFO: Found listing with ID: LW83066
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW83066%27 HTTP/1.1" 200 None
2026-03-27 10:31:37 [auto1.de] INFO: Scrape type for LW83066: 1
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F37%252F943749232f06296f5869faa9de688b6d%252Fpa%252FCZ12085_890e5ad88b9073742b83585381790091.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_890e5ad88b9073742b83585381790091.jpg not downloaded yet
2026-03-27 10:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_d1eba88cd7069ef4b96c10317ea03157.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WM50806> (referer: https://www.auto1.com/v1/car-details-view/WM50806/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1001d0>
2026-03-27 10:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c245e6af-c309-5511-a47e-0cf99fc5d6e6/c245e6af-c309-5511-a47e-0cf99fc5d6e6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F74%252Fdf74d03fc58f8eafb60907a4a474a933%252Fpa%252FWG78869_5e887a20a019f547fa431dab4a6a76c1.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_5e887a20a019f547fa431dab4a6a76c1.jpg saved to cache
2026-03-27 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c245e6af-c309-5511-a47e-0cf99fc5d6e6
2026-03-27 10:31:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c245e6af-c309-5511-a47e-0cf99fc5d6e6, skipping ID generation
2026-03-27 10:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c245e6af-c309-5511-a47e-0cf99fc5d6e6 with scrape type 1
2026-03-27 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c245e6af-c309-5511-a47e-0cf99fc5d6e6 sending to next pipeline
2026-03-27 10:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c245e6af-c309-5511-a47e-0cf99fc5d6e6, identifier: WG78869
2026-03-27 10:31:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7a430bd-5867-52e7-bb37-7078639a2673 with identifier: YL92844
2026-03-27 10:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7a430bd-5867-52e7-bb37-7078639a2673 with scrape type 1
2026-03-27 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c7a430bd-5867-52e7-bb37-7078639a2673
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_44c42876497317aea5d2664b567efce3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_44c42876497317aea5d2664b567efce3.jpg not downloaded yet
2026-03-27 10:31:37 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 10477 | hits on page: 40
2026-03-27 10:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_6490558787f79ebe7e238c71fcd6f911.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_dedb5378b6d17b3b984d0e3cfc1d9019.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:37 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX68947%27 HTTP/1.1" 200 None
2026-03-27 10:31:37 [auto1.de] INFO: Scrape type for LX68947: 2
2026-03-27 10:31:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a660f3fb-e8b1-52c5-804a-a2b34b53e60e with identifier: LX68947
2026-03-27 10:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a660f3fb-e8b1-52c5-804a-a2b34b53e60e with scrape type 2
2026-03-27 10:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a660f3fb-e8b1-52c5-804a-a2b34b53e60e with scrape type 2
2026-03-27 10:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a660f3fb-e8b1-52c5-804a-a2b34b53e60e, identifier: LX68947
2026-03-27 10:31:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c245e6af-c309-5511-a47e-0cf99fc5d6e6 with identifier: WG78869
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:31:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-27 10:31:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c245e6af-c309-5511-a47e-0cf99fc5d6e6 with identifier: WG78869
2026-03-27 10:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c245e6af-c309-5511-a47e-0cf99fc5d6e6 with identifier: WG78869 to the API
2026-03-27 10:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_5e887a20a019f547fa431dab4a6a76c1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 176,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.9L',
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:40:52Z',
'fuel_type': 'diesel',
'id': 'c245e6af-c309-5511-a47e-0cf99fc5d6e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG78869',
'listing': 'auction',
'location': 'DE, Böblingen',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 258605,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c245e6af-c309-5511-a47e-0cf99fc5d6e6/c245e6af-c309-5511-a47e-0cf99fc5d6e6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_44784fe34ed15bc5ad841724d4f047de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c245e6af-c309-5511-a47e-0cf99fc5d6e6/c245e6af-c309-5511-a47e-0cf99fc5d6e6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_8d1b636aec9c1559448e4debcbb46e72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c245e6af-c309-5511-a47e-0cf99fc5d6e6/c245e6af-c309-5511-a47e-0cf99fc5d6e6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_f4a62ea8ad79a3dad14778a4f9721b45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c245e6af-c309-5511-a47e-0cf99fc5d6e6/c245e6af-c309-5511-a47e-0cf99fc5d6e6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57659,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_3f723ab9230eb6ac583b326c75429dd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c245e6af-c309-5511-a47e-0cf99fc5d6e6/c245e6af-c309-5511-a47e-0cf99fc5d6e6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/74/df74d03fc58f8eafb60907a4a474a933/pa/WG78869_5e887a20a019f547fa431dab4a6a76c1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '1999-05-11',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Sharan 1.9 TDI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 1999}
2026-03-27 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78869%27 HTTP/1.1" 200 None
2026-03-27 10:31:38 [auto1.de] INFO: Saving data for WG78869: {'created_time': 1774607498.436062, 'last_price_update_time': 1774607498.436074, 'auction_closing_time': 1774716052.0}
2026-03-27 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG78869') HTTP/1.1" 204 0
2026-03-27 10:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_a2516a04a51424cde2d735b328292437.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a660f3fb-e8b1-52c5-804a-a2b34b53e60e with identifier: LX68947
2026-03-27 10:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:31:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-27 10:31:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a660f3fb-e8b1-52c5-804a-a2b34b53e60e with identifier: LX68947
2026-03-27 10:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a660f3fb-e8b1-52c5-804a-a2b34b53e60e with identifier: LX68947 to the API
2026-03-27 10:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:02:53Z',
'fuel_type': 'diesel',
'id': 'a660f3fb-e8b1-52c5-804a-a2b34b53e60e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX68947',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 116520,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-09-27',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Ghia X',
'transmission': 'manual',
'trim': 'Ghia X',
'year': 2004}
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX68947%27 HTTP/1.1" 200 None
2026-03-27 10:31:39 [auto1.de] INFO: Saving data for LX68947: {'auction_closing_time': 1774713773.0, 'created_time': 1773302864.901384, 'last_price_update_time': 1774607499.08612}
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX68947') HTTP/1.1" 204 0
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_8ad3730a73f63033c61d8464a061e803.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_8ad3730a73f63033c61d8464a061e803.jpg not downloaded yet
2026-03-27 10:31:39 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-27 10:31:39 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS69685%27 HTTP/1.1" 200 None
2026-03-27 10:31:39 [auto1.de] INFO: Scrape type for GS69685: 2
2026-03-27 10:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05059f83-d70d-53c8-a1a3-992f8729741f with identifier: GS69685
2026-03-27 10:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05059f83-d70d-53c8-a1a3-992f8729741f with scrape type 2
2026-03-27 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05059f83-d70d-53c8-a1a3-992f8729741f with scrape type 2
2026-03-27 10:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05059f83-d70d-53c8-a1a3-992f8729741f, identifier: GS69685
2026-03-27 10:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_6212269f38983100303308b2f7134a20.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:39 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT44889%27 HTTP/1.1" 200 None
2026-03-27 10:31:39 [auto1.de] INFO: Scrape type for CT44889: 2
2026-03-27 10:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5beb08c1-c19d-5744-818a-a4472e905285 with identifier: CT44889
2026-03-27 10:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5beb08c1-c19d-5744-818a-a4472e905285 with scrape type 2
2026-03-27 10:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5beb08c1-c19d-5744-818a-a4472e905285 with scrape type 2
2026-03-27 10:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5beb08c1-c19d-5744-818a-a4472e905285, identifier: CT44889
2026-03-27 10:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05059f83-d70d-53c8-a1a3-992f8729741f with identifier: GS69685
2026-03-27 10:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05059f83-d70d-53c8-a1a3-992f8729741f with identifier: GS69685
2026-03-27 10:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05059f83-d70d-53c8-a1a3-992f8729741f with identifier: GS69685 to the API
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:53:09Z',
'fuel_type': 'petrol',
'id': '05059f83-d70d-53c8-a1a3-992f8729741f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS69685',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 110483,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-01',
'seller_name': None,
'title': 'Skoda Fabia 1.2 Cool Edition',
'transmission': 'manual',
'trim': 'Cool Edition',
'year': 2009}
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS69685%27 HTTP/1.1" 200 None
2026-03-27 10:31:39 [auto1.de] INFO: Saving data for GS69685: {'auction_closing_time': 1774716789.0, 'created_time': 1773306723.420779, 'last_price_update_time': 1774607499.72847}
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS69685') HTTP/1.1" 204 0
2026-03-27 10:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5beb08c1-c19d-5744-818a-a4472e905285 with identifier: CT44889
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-27 10:31:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5beb08c1-c19d-5744-818a-a4472e905285 with identifier: CT44889
2026-03-27 10:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5beb08c1-c19d-5744-818a-a4472e905285 with identifier: CT44889 to the API
2026-03-27 10:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:26:18Z',
'fuel_type': 'petrol',
'id': '5beb08c1-c19d-5744-818a-a4472e905285',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT44889',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 149363,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-09-14',
'seller_name': None,
'title': 'Volkswagen Golf V 1.4 TSI United',
'transmission': 'manual',
'trim': 'United',
'year': 2008}
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT44889%27 HTTP/1.1" 200 None
2026-03-27 10:31:40 [auto1.de] INFO: Saving data for CT44889: {'auction_closing_time': 1774715178.0, 'created_time': 1774032781.380397, 'last_price_update_time': 1774607500.202873}
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT44889') HTTP/1.1" 204 0
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_aa8bb07a3b3ae768d8786d3e762a1ba0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_aa8bb07a3b3ae768d8786d3e762a1ba0.jpg not downloaded yet
2026-03-27 10:31:40 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE12757%27 HTTP/1.1" 200 None
2026-03-27 10:31:40 [auto1.de] INFO: Scrape type for AE12757: 1
2026-03-27 10:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW88691/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b4510>
2026-03-27 10:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0366b08b-3323-5348-9f58-b06c9b82d43a/0366b08b-3323-5348-9f58-b06c9b82d43a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F67%252F3467282c69428371108c07a1a72304ff%252Fpa%252FTE41931_06b6f09b8616501f707e4164934f7e4d.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_06b6f09b8616501f707e4164934f7e4d.jpg saved to cache
2026-03-27 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0366b08b-3323-5348-9f58-b06c9b82d43a
2026-03-27 10:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf36d950>
2026-03-27 10:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03/9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F37%252F943749232f06296f5869faa9de688b6d%252Fpa%252FCZ12085_d1eba88cd7069ef4b96c10317ea03157.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_d1eba88cd7069ef4b96c10317ea03157.jpg saved to cache
2026-03-27 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03
2026-03-27 10:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f834236-0c7f-557c-9693-c1c9802a73b0 with identifier: WM50806
2026-03-27 10:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f834236-0c7f-557c-9693-c1c9802a73b0 with scrape type 1
2026-03-27 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f834236-0c7f-557c-9693-c1c9802a73b0
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_06292c1dfc3699ed60e1024673d6adf5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_06292c1dfc3699ed60e1024673d6adf5.jpg not downloaded yet
2026-03-27 10:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be102a50>
2026-03-27 10:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0366b08b-3323-5348-9f58-b06c9b82d43a/0366b08b-3323-5348-9f58-b06c9b82d43a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F67%252F3467282c69428371108c07a1a72304ff%252Fpa%252FTE41931_6490558787f79ebe7e238c71fcd6f911.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_6490558787f79ebe7e238c71fcd6f911.jpg saved to cache
2026-03-27 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0366b08b-3323-5348-9f58-b06c9b82d43a
2026-03-27 10:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf412650>
2026-03-27 10:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f9f659-1548-59ce-a865-56311a1774ba/d5f9f659-1548-59ce-a865-56311a1774ba_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F1a%252F721adb36448d6d7d358cea0063e0372a%252Fpa%252FNK83819_dedb5378b6d17b3b984d0e3cfc1d9019.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_dedb5378b6d17b3b984d0e3cfc1d9019.jpg saved to cache
2026-03-27 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d5f9f659-1548-59ce-a865-56311a1774ba
2026-03-27 10:31:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5f9f659-1548-59ce-a865-56311a1774ba, skipping ID generation
2026-03-27 10:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f9f659-1548-59ce-a865-56311a1774ba with scrape type 1
2026-03-27 10:31:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5f9f659-1548-59ce-a865-56311a1774ba sending to next pipeline
2026-03-27 10:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5f9f659-1548-59ce-a865-56311a1774ba, identifier: NK83819
2026-03-27 10:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_74ff4669953cd062528796e9fe1d8616.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5f9f659-1548-59ce-a865-56311a1774ba with identifier: NK83819
2026-03-27 10:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5f9f659-1548-59ce-a865-56311a1774ba with identifier: NK83819
2026-03-27 10:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5f9f659-1548-59ce-a865-56311a1774ba with identifier: NK83819 to the API
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_dedb5378b6d17b3b984d0e3cfc1d9019.jpg>
{'auction_title': '',
'c_o_2_emission_value': 180,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:43:25Z',
'fuel_type': 'petrol',
'id': 'd5f9f659-1548-59ce-a865-56311a1774ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK83819',
'listing': 'auction',
'location': 'DE, Weiterstadt',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 169450,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f9f659-1548-59ce-a865-56311a1774ba/d5f9f659-1548-59ce-a865-56311a1774ba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91984,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_4ac8367100e99b9213a61c6bc4265f4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f9f659-1548-59ce-a865-56311a1774ba/d5f9f659-1548-59ce-a865-56311a1774ba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_bbb6b86d54dbd0a36ad0831781a04ae3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f9f659-1548-59ce-a865-56311a1774ba/d5f9f659-1548-59ce-a865-56311a1774ba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_8945b021a262c4d6e0e323bfe8857f24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f9f659-1548-59ce-a865-56311a1774ba/d5f9f659-1548-59ce-a865-56311a1774ba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71830,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_e25d9c5c423ec16b07ae57d8e5b70b61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f9f659-1548-59ce-a865-56311a1774ba/d5f9f659-1548-59ce-a865-56311a1774ba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/1a/721adb36448d6d7d358cea0063e0372a/pa/NK83819_dedb5378b6d17b3b984d0e3cfc1d9019.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2003-04-07',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 160 Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2003}
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK83819%27 HTTP/1.1" 200 None
2026-03-27 10:31:40 [auto1.de] INFO: Saving data for NK83819: {'created_time': 1774607500.998042, 'last_price_update_time': 1774607500.998054, 'auction_closing_time': 1774716205.0}
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK83819') HTTP/1.1" 204 0
2026-03-27 10:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_890e5ad88b9073742b83585381790091.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_464ae512817e0f47c30d7692f9c12070.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_464ae512817e0f47c30d7692f9c12070.jpg not downloaded yet
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: NC61336
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC61336%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [auto1.de] INFO: Scrape type for NC61336: 1
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_fb32b751247152010d5c7b017411b987.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_fb32b751247152010d5c7b017411b987.jpg not downloaded yet
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1b9690>
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03/9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F37%252F943749232f06296f5869faa9de688b6d%252Fpa%252FCZ12085_a2516a04a51424cde2d735b328292437.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_a2516a04a51424cde2d735b328292437.jpg saved to cache
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1bccd0>
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03/9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F37%252F943749232f06296f5869faa9de688b6d%252Fpa%252FCZ12085_6212269f38983100303308b2f7134a20.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_6212269f38983100303308b2f7134a20.jpg saved to cache
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_e8aeda0ecca304c675b94cc5a8a8898c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_e8aeda0ecca304c675b94cc5a8a8898c.jpg not downloaded yet
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: BY27711
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK79873%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [auto1.de] INFO: Scrape type for CK79873: 1
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_9c309c4445876249cee6dc86c8bceabe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_9c309c4445876249cee6dc86c8bceabe.jpg not downloaded yet
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f2050>
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03/9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F37%252F943749232f06296f5869faa9de688b6d%252Fpa%252FCZ12085_74ff4669953cd062528796e9fe1d8616.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_74ff4669953cd062528796e9fe1d8616.jpg saved to cache
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c564d9d0>
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03/9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F37%252F943749232f06296f5869faa9de688b6d%252Fpa%252FCZ12085_890e5ad88b9073742b83585381790091.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_890e5ad88b9073742b83585381790091.jpg saved to cache
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_08619076bca05d8b934789a7b6d18a83.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_08619076bca05d8b934789a7b6d18a83.jpg not downloaded yet
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: JG50197
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: CD24001
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: MV69505
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV69505%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [auto1.de] INFO: Scrape type for MV69505: 1
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_c8250dc6104a599642d995c0f785e983.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_c8250dc6104a599642d995c0f785e983.jpg not downloaded yet
2026-03-27 10:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_06292c1dfc3699ed60e1024673d6adf5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_86f5e36d3a5082e554f5dde04c67b715.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_86f5e36d3a5082e554f5dde04c67b715.jpg not downloaded yet
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: FR69790
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS26285%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [auto1.de] INFO: Scrape type for KS26285: 1
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_d7e8b25f3164c1cc5c754dff0798e8f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_d7e8b25f3164c1cc5c754dff0798e8f8.jpg not downloaded yet
2026-03-27 10:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_8ad3730a73f63033c61d8464a061e803.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_e284e411b510476cd0c1f846982936d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_e284e411b510476cd0c1f846982936d5.jpg not downloaded yet
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: NH03698
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH03698%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [auto1.de] INFO: Scrape type for NH03698: 1
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_9807036a9c6585047f11f159fd76dd65.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_9807036a9c6585047f11f159fd76dd65.jpg not downloaded yet
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_3514f2f00c1f292ffcf4b240f368731f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_3514f2f00c1f292ffcf4b240f368731f.jpg not downloaded yet
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: SC33158
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC33158%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [auto1.de] INFO: Scrape type for SC33158: 1
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_f247a014924c67a6c41e22c329627218.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_f247a014924c67a6c41e22c329627218.jpg not downloaded yet
2026-03-27 10:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_9c309c4445876249cee6dc86c8bceabe.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_8b447d8803686602ee5da7a5382305c6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_8b447d8803686602ee5da7a5382305c6.jpg not downloaded yet
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY54008%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [auto1.de] INFO: Scrape type for WY54008: 1
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_5ab95a540cfea8b488828d9a205358ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_5ab95a540cfea8b488828d9a205358ae.jpg not downloaded yet
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1c35d0>
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_06292c1dfc3699ed60e1024673d6adf5.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_06292c1dfc3699ed60e1024673d6adf5.jpg saved to cache
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f834236-0c7f-557c-9693-c1c9802a73b0
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE78461%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [auto1.de] INFO: Scrape type for WE78461: 1
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_9f5ff665f7a158bfacc99c94b8fe0248.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_9f5ff665f7a158bfacc99c94b8fe0248.jpg not downloaded yet
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf306310>
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_8ad3730a73f63033c61d8464a061e803.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_8ad3730a73f63033c61d8464a061e803.jpg saved to cache
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7a430bd-5867-52e7-bb37-7078639a2673
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf35ff50>
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_9c309c4445876249cee6dc86c8bceabe.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_9c309c4445876249cee6dc86c8bceabe.jpg saved to cache
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f834236-0c7f-557c-9693-c1c9802a73b0
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: XX31314
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX31314%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [auto1.de] INFO: Scrape type for XX31314: 1
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_93e0039802460ffc71ee0e4258fb52c3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_93e0039802460ffc71ee0e4258fb52c3.jpg not downloaded yet
2026-03-27 10:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG01563/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: ZA85073
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: UK16576
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK16576%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [auto1.de] INFO: Scrape type for UK16576: 1
2026-03-27 10:31:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE30876/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_d7e8b25f3164c1cc5c754dff0798e8f8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: HL17570
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL17570%27 HTTP/1.1" 200 None
2026-03-27 10:31:41 [auto1.de] INFO: Scrape type for HL17570: 1
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-27 10:31:41 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-27 10:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_f247a014924c67a6c41e22c329627218.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_44c42876497317aea5d2664b567efce3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4e3790>
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_d7e8b25f3164c1cc5c754dff0798e8f8.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_d7e8b25f3164c1cc5c754dff0798e8f8.jpg saved to cache
2026-03-27 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f834236-0c7f-557c-9693-c1c9802a73b0
2026-03-27 10:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf570590>
2026-03-27 10:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_f247a014924c67a6c41e22c329627218.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_f247a014924c67a6c41e22c329627218.jpg saved to cache
2026-03-27 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f834236-0c7f-557c-9693-c1c9802a73b0
2026-03-27 10:31:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be100b90>
2026-03-27 10:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_44c42876497317aea5d2664b567efce3.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_44c42876497317aea5d2664b567efce3.jpg saved to cache
2026-03-27 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7a430bd-5867-52e7-bb37-7078639a2673
2026-03-27 10:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_93e0039802460ffc71ee0e4258fb52c3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_9f5ff665f7a158bfacc99c94b8fe0248.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1ef1d0>
2026-03-27 10:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_93e0039802460ffc71ee0e4258fb52c3.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_93e0039802460ffc71ee0e4258fb52c3.jpg saved to cache
2026-03-27 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f834236-0c7f-557c-9693-c1c9802a73b0
2026-03-27 10:31:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be257b50>
2026-03-27 10:31:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_9f5ff665f7a158bfacc99c94b8fe0248.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_9f5ff665f7a158bfacc99c94b8fe0248.jpg saved to cache
2026-03-27 10:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f834236-0c7f-557c-9693-c1c9802a73b0
2026-03-27 10:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF66313> (referer: https://www.auto1.com/v1/car-details-view/TF66313/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2da829a-bd7b-52ba-8ce4-d18246b423b5 with identifier: TF66313
2026-03-27 10:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2da829a-bd7b-52ba-8ce4-d18246b423b5 with scrape type 1
2026-03-27 10:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2da829a-bd7b-52ba-8ce4-d18246b423b5
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_033eb35c525da4f5772b0162336834c3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_033eb35c525da4f5772b0162336834c3.jpg not downloaded yet
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_a24bb5c13d58fddbb1f4265af2f75b0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_a24bb5c13d58fddbb1f4265af2f75b0f.jpg not downloaded yet
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_7a4df547952babe71534091044cffe63.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_7a4df547952babe71534091044cffe63.jpg not downloaded yet
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_005cad2af0d3bd1140828cc098f3ec26.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_005cad2af0d3bd1140828cc098f3ec26.jpg not downloaded yet
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_70b075a167d4eb992075c499ceb6d037.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_70b075a167d4eb992075c499ceb6d037.jpg not downloaded yet
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_e03d29ccb79da44430f26caa953c7ee1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_e03d29ccb79da44430f26caa953c7ee1.jpg not downloaded yet
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_1229b9eac01ef8e4546eb635ff431fa8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_1229b9eac01ef8e4546eb635ff431fa8.jpg not downloaded yet
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_0f0c9d82733ce4e93b54922dfcc85c33.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_0f0c9d82733ce4e93b54922dfcc85c33.jpg not downloaded yet
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_d40eef22fdc6cdde1b1d4bfcb7aaff1d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_d40eef22fdc6cdde1b1d4bfcb7aaff1d.jpg not downloaded yet
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_6d44db83c8bd503842e1a4c1971130c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_6d44db83c8bd503842e1a4c1971130c5.jpg not downloaded yet
2026-03-27 10:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK28238/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_6d44db83c8bd503842e1a4c1971130c5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be256d50>
2026-03-27 10:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_6d44db83c8bd503842e1a4c1971130c5.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_6d44db83c8bd503842e1a4c1971130c5.jpg saved to cache
2026-03-27 10:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c2da829a-bd7b-52ba-8ce4-d18246b423b5
2026-03-27 10:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_d40eef22fdc6cdde1b1d4bfcb7aaff1d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be174410>
2026-03-27 10:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_d40eef22fdc6cdde1b1d4bfcb7aaff1d.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_d40eef22fdc6cdde1b1d4bfcb7aaff1d.jpg saved to cache
2026-03-27 10:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c2da829a-bd7b-52ba-8ce4-d18246b423b5
2026-03-27 10:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU27688/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_0f0c9d82733ce4e93b54922dfcc85c33.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b6090>
2026-03-27 10:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_0f0c9d82733ce4e93b54922dfcc85c33.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_0f0c9d82733ce4e93b54922dfcc85c33.jpg saved to cache
2026-03-27 10:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2da829a-bd7b-52ba-8ce4-d18246b423b5
2026-03-27 10:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU23189/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_1229b9eac01ef8e4546eb635ff431fa8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be257f50>
2026-03-27 10:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_1229b9eac01ef8e4546eb635ff431fa8.jpg') HTTP/1.1" 204 0
2026-03-27 10:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_1229b9eac01ef8e4546eb635ff431fa8.jpg saved to cache
2026-03-27 10:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c2da829a-bd7b-52ba-8ce4-d18246b423b5
2026-03-27 10:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX31314/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:31:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_e03d29ccb79da44430f26caa953c7ee1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_70b075a167d4eb992075c499ceb6d037.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1d4d10>
2026-03-27 10:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_e03d29ccb79da44430f26caa953c7ee1.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_e03d29ccb79da44430f26caa953c7ee1.jpg saved to cache
2026-03-27 10:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2da829a-bd7b-52ba-8ce4-d18246b423b5
2026-03-27 10:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf46c890>
2026-03-27 10:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_70b075a167d4eb992075c499ceb6d037.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_70b075a167d4eb992075c499ceb6d037.jpg saved to cache
2026-03-27 10:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2da829a-bd7b-52ba-8ce4-d18246b423b5
2026-03-27 10:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MG37810> (referer: https://www.auto1.com/v1/car-details-view/MG37810/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:32:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6da3d3d4-b79d-5360-9701-7138af02912b with identifier: MG37810
2026-03-27 10:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6da3d3d4-b79d-5360-9701-7138af02912b with scrape type 1
2026-03-27 10:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6da3d3d4-b79d-5360-9701-7138af02912b
2026-03-27 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_7076cf598f145301797669d8ff7b5ccb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_7076cf598f145301797669d8ff7b5ccb.jpg not downloaded yet
2026-03-27 10:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_005cad2af0d3bd1140828cc098f3ec26.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_4519adce278bcc19875284f7ed9dfa4c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_4519adce278bcc19875284f7ed9dfa4c.jpg not downloaded yet
2026-03-27 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_0e70a5d3deadffb6d2f26b931071e23d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_0e70a5d3deadffb6d2f26b931071e23d.jpg not downloaded yet
2026-03-27 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_e4cf4b0aabf630f1530d041f2fa8793f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_e4cf4b0aabf630f1530d041f2fa8793f.jpg not downloaded yet
2026-03-27 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_aa8b723d325c15353def46c11226728c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_aa8b723d325c15353def46c11226728c.jpg not downloaded yet
2026-03-27 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_aa6522b19a1d5944ef0c4868580b9b0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_aa6522b19a1d5944ef0c4868580b9b0f.jpg not downloaded yet
2026-03-27 10:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_a62c21af2caa521ba29f98f1c08b4e91.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_a62c21af2caa521ba29f98f1c08b4e91.jpg not downloaded yet
2026-03-27 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_a0a87c526c62cd2fff8349e01dfdcfa0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_a0a87c526c62cd2fff8349e01dfdcfa0.jpg not downloaded yet
2026-03-27 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_bdd0a7c3bd00fb3a0080d2cfd30c1c53.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_bdd0a7c3bd00fb3a0080d2cfd30c1c53.jpg not downloaded yet
2026-03-27 10:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b7290>
2026-03-27 10:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_005cad2af0d3bd1140828cc098f3ec26.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_005cad2af0d3bd1140828cc098f3ec26.jpg saved to cache
2026-03-27 10:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2da829a-bd7b-52ba-8ce4-d18246b423b5
2026-03-27 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_968cf4ea905860c35bd5bcb373859c20.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_968cf4ea905860c35bd5bcb373859c20.jpg not downloaded yet
2026-03-27 10:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_7076cf598f145301797669d8ff7b5ccb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be012550>
2026-03-27 10:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_7076cf598f145301797669d8ff7b5ccb.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_7076cf598f145301797669d8ff7b5ccb.jpg saved to cache
2026-03-27 10:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6da3d3d4-b79d-5360-9701-7138af02912b
2026-03-27 10:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_968cf4ea905860c35bd5bcb373859c20.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:32:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf573850>
2026-03-27 10:32:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_968cf4ea905860c35bd5bcb373859c20.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_968cf4ea905860c35bd5bcb373859c20.jpg saved to cache
2026-03-27 10:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6da3d3d4-b79d-5360-9701-7138af02912b
2026-03-27 10:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_bdd0a7c3bd00fb3a0080d2cfd30c1c53.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e7410>
2026-03-27 10:32:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_bdd0a7c3bd00fb3a0080d2cfd30c1c53.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_bdd0a7c3bd00fb3a0080d2cfd30c1c53.jpg saved to cache
2026-03-27 10:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6da3d3d4-b79d-5360-9701-7138af02912b
2026-03-27 10:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_a0a87c526c62cd2fff8349e01dfdcfa0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:32:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf486c50>
2026-03-27 10:32:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_a0a87c526c62cd2fff8349e01dfdcfa0.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_a0a87c526c62cd2fff8349e01dfdcfa0.jpg saved to cache
2026-03-27 10:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6da3d3d4-b79d-5360-9701-7138af02912b
2026-03-27 10:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_a62c21af2caa521ba29f98f1c08b4e91.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:32:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be010c10>
2026-03-27 10:32:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_a62c21af2caa521ba29f98f1c08b4e91.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_a62c21af2caa521ba29f98f1c08b4e91.jpg saved to cache
2026-03-27 10:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6da3d3d4-b79d-5360-9701-7138af02912b
2026-03-27 10:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_aa6522b19a1d5944ef0c4868580b9b0f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1ebb10>
2026-03-27 10:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_aa6522b19a1d5944ef0c4868580b9b0f.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_aa6522b19a1d5944ef0c4868580b9b0f.jpg saved to cache
2026-03-27 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6da3d3d4-b79d-5360-9701-7138af02912b
2026-03-27 10:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_aa8b723d325c15353def46c11226728c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1b1110>
2026-03-27 10:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_aa8b723d325c15353def46c11226728c.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_aa8b723d325c15353def46c11226728c.jpg saved to cache
2026-03-27 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6da3d3d4-b79d-5360-9701-7138af02912b
2026-03-27 10:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_e4cf4b0aabf630f1530d041f2fa8793f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf572390>
2026-03-27 10:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_e4cf4b0aabf630f1530d041f2fa8793f.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_e4cf4b0aabf630f1530d041f2fa8793f.jpg saved to cache
2026-03-27 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6da3d3d4-b79d-5360-9701-7138af02912b
2026-03-27 10:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_0e70a5d3deadffb6d2f26b931071e23d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e5d90>
2026-03-27 10:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_0e70a5d3deadffb6d2f26b931071e23d.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_0e70a5d3deadffb6d2f26b931071e23d.jpg saved to cache
2026-03-27 10:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6da3d3d4-b79d-5360-9701-7138af02912b
2026-03-27 10:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_4519adce278bcc19875284f7ed9dfa4c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be013c10>
2026-03-27 10:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fcc%252F31cc0342a9416090fcda84daa31aa405%252Fpa%252FMG37810_4519adce278bcc19875284f7ed9dfa4c.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_4519adce278bcc19875284f7ed9dfa4c.jpg saved to cache
2026-03-27 10:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6da3d3d4-b79d-5360-9701-7138af02912b
2026-03-27 10:32:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6da3d3d4-b79d-5360-9701-7138af02912b, skipping ID generation
2026-03-27 10:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6da3d3d4-b79d-5360-9701-7138af02912b with scrape type 1
2026-03-27 10:32:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6da3d3d4-b79d-5360-9701-7138af02912b sending to next pipeline
2026-03-27 10:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6da3d3d4-b79d-5360-9701-7138af02912b, identifier: MG37810
2026-03-27 10:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6da3d3d4-b79d-5360-9701-7138af02912b with identifier: MG37810
2026-03-27 10:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6da3d3d4-b79d-5360-9701-7138af02912b with identifier: MG37810
2026-03-27 10:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6da3d3d4-b79d-5360-9701-7138af02912b with identifier: MG37810 to the API
2026-03-27 10:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_4519adce278bcc19875284f7ed9dfa4c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:58:29Z',
'fuel_type': 'petrol',
'id': '6da3d3d4-b79d-5360-9701-7138af02912b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG37810',
'listing': 'auction',
'location': 'DE, Gießen',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 86259,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2880682,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_7076cf598f145301797669d8ff7b5ccb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2733583,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_4519adce278bcc19875284f7ed9dfa4c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2659148,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_0e70a5d3deadffb6d2f26b931071e23d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2588671,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_e4cf4b0aabf630f1530d041f2fa8793f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2489425,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_aa8b723d325c15353def46c11226728c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2552332,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_aa6522b19a1d5944ef0c4868580b9b0f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2443417,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_a62c21af2caa521ba29f98f1c08b4e91.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2645274,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_a0a87c526c62cd2fff8349e01dfdcfa0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_bdd0a7c3bd00fb3a0080d2cfd30c1c53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da3d3d4-b79d-5360-9701-7138af02912b/6da3d3d4-b79d-5360-9701-7138af02912b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2805634,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img31/cc/31cc0342a9416090fcda84daa31aa405/pa/MG37810_968cf4ea905860c35bd5bcb373859c20.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-02-20',
'seats_number': 4,
'seller_name': None,
'title': 'Audi A1 Sportback 1.2 TFSI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2013}
2026-03-27 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG37810%27 HTTP/1.1" 200 None
2026-03-27 10:32:07 [auto1.de] INFO: Saving data for MG37810: {'created_time': 1774607527.509987, 'last_price_update_time': 1774607527.509997, 'auction_closing_time': 1774717109.0}
2026-03-27 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG37810') HTTP/1.1" 204 0
2026-03-27 10:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_7a4df547952babe71534091044cffe63.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:07 [scrapy.extensions.logstats] INFO: Crawled 37 pages (at 36 pages/min), scraped 20 items (at 20 items/min)
2026-03-27 10:32:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 175MiB
2026-03-27 10:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL17570/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:32:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1cb810>
2026-03-27 10:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_7a4df547952babe71534091044cffe63.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_7a4df547952babe71534091044cffe63.jpg saved to cache
2026-03-27 10:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2da829a-bd7b-52ba-8ce4-d18246b423b5
2026-03-27 10:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_033eb35c525da4f5772b0162336834c3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_a24bb5c13d58fddbb1f4265af2f75b0f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e4d90>
2026-03-27 10:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_033eb35c525da4f5772b0162336834c3.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_033eb35c525da4f5772b0162336834c3.jpg saved to cache
2026-03-27 10:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2da829a-bd7b-52ba-8ce4-d18246b423b5
2026-03-27 10:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1b0190>
2026-03-27 10:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F15%252F091550668c7c901c8c37b7b245625a65%252Fpa%252FTF66313_a24bb5c13d58fddbb1f4265af2f75b0f.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_a24bb5c13d58fddbb1f4265af2f75b0f.jpg saved to cache
2026-03-27 10:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2da829a-bd7b-52ba-8ce4-d18246b423b5
2026-03-27 10:32:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2da829a-bd7b-52ba-8ce4-d18246b423b5, skipping ID generation
2026-03-27 10:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2da829a-bd7b-52ba-8ce4-d18246b423b5 with scrape type 1
2026-03-27 10:32:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2da829a-bd7b-52ba-8ce4-d18246b423b5 sending to next pipeline
2026-03-27 10:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2da829a-bd7b-52ba-8ce4-d18246b423b5, identifier: TF66313
2026-03-27 10:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2da829a-bd7b-52ba-8ce4-d18246b423b5 with identifier: TF66313
2026-03-27 10:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2da829a-bd7b-52ba-8ce4-d18246b423b5 with identifier: TF66313
2026-03-27 10:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2da829a-bd7b-52ba-8ce4-d18246b423b5 with identifier: TF66313 to the API
2026-03-27 10:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_a24bb5c13d58fddbb1f4265af2f75b0f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-03-28T16:35:26Z',
'fuel_type': 'diesel',
'id': 'c2da829a-bd7b-52ba-8ce4-d18246b423b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF66313',
'listing': 'auction',
'location': 'DE',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 179510,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 131066,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_033eb35c525da4f5772b0162336834c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_a24bb5c13d58fddbb1f4265af2f75b0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124672,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_7a4df547952babe71534091044cffe63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103518,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_005cad2af0d3bd1140828cc098f3ec26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_70b075a167d4eb992075c499ceb6d037.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114416,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_e03d29ccb79da44430f26caa953c7ee1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 126710,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_1229b9eac01ef8e4546eb635ff431fa8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_0f0c9d82733ce4e93b54922dfcc85c33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_d40eef22fdc6cdde1b1d4bfcb7aaff1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2da829a-bd7b-52ba-8ce4-d18246b423b5/c2da829a-bd7b-52ba-8ce4-d18246b423b5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/15/091550668c7c901c8c37b7b245625a65/pa/TF66313_6d44db83c8bd503842e1a4c1971130c5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 d Progressive',
'transmission': 'automatic',
'trim': 'Progressive',
'year': 2019}
2026-03-27 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF66313%27 HTTP/1.1" 200 None
2026-03-27 10:32:08 [auto1.de] INFO: Saving data for TF66313: {'created_time': 1774607528.581171, 'last_price_update_time': 1774607528.581181, 'auction_closing_time': 1774715726.0}
2026-03-27 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF66313') HTTP/1.1" 204 0
2026-03-27 10:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_5ab95a540cfea8b488828d9a205358ae.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e54d0>
2026-03-27 10:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_5ab95a540cfea8b488828d9a205358ae.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_5ab95a540cfea8b488828d9a205358ae.jpg saved to cache
2026-03-27 10:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f834236-0c7f-557c-9693-c1c9802a73b0
2026-03-27 10:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF69059/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:32:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE30876> (referer: https://www.auto1.com/v1/car-details-view/UE30876/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:32:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LW83066/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:32:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05d164fa-902c-54bb-ab5a-f6903d939bc9 with identifier: UE30876
2026-03-27 10:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05d164fa-902c-54bb-ab5a-f6903d939bc9 with scrape type 1
2026-03-27 10:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05d164fa-902c-54bb-ab5a-f6903d939bc9
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_98954574ddc290ad7e3a5281447ed77c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_98954574ddc290ad7e3a5281447ed77c.jpg not downloaded yet
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_894fdef0af52ad86830b1291825bff01.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_894fdef0af52ad86830b1291825bff01.jpg not downloaded yet
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_1326561e9f708460c8c36a289b8e572e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_1326561e9f708460c8c36a289b8e572e.jpg not downloaded yet
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_2fa0a14f7e1290e629837f808f697f57.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_2fa0a14f7e1290e629837f808f697f57.jpg not downloaded yet
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_3b6fb9badd4014b5bc722c4c1e20875f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_3b6fb9badd4014b5bc722c4c1e20875f.jpg not downloaded yet
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_a500538dfb86a8bfabf139d05a8f6d5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_a500538dfb86a8bfabf139d05a8f6d5b.jpg not downloaded yet
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_88296858a7246e04432876905cea3787.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_88296858a7246e04432876905cea3787.jpg not downloaded yet
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_7d53ee4f42f0d1e3556156321d7e63ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_7d53ee4f42f0d1e3556156321d7e63ea.jpg not downloaded yet
2026-03-27 10:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_8b447d8803686602ee5da7a5382305c6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_d8de86a0b5ee06b17a8fa0f6e162cb6e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_d8de86a0b5ee06b17a8fa0f6e162cb6e.jpg not downloaded yet
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_e3d5ae542c0f3d520bb7bc9b9debd526.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_e3d5ae542c0f3d520bb7bc9b9debd526.jpg not downloaded yet
2026-03-27 10:32:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c4254190>
2026-03-27 10:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_8b447d8803686602ee5da7a5382305c6.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_8b447d8803686602ee5da7a5382305c6.jpg saved to cache
2026-03-27 10:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c7a430bd-5867-52e7-bb37-7078639a2673
2026-03-27 10:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_7d53ee4f42f0d1e3556156321d7e63ea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1e9790>
2026-03-27 10:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_7d53ee4f42f0d1e3556156321d7e63ea.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_7d53ee4f42f0d1e3556156321d7e63ea.jpg saved to cache
2026-03-27 10:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05d164fa-902c-54bb-ab5a-f6903d939bc9
2026-03-27 10:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_e3d5ae542c0f3d520bb7bc9b9debd526.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf372990>
2026-03-27 10:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_e3d5ae542c0f3d520bb7bc9b9debd526.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_e3d5ae542c0f3d520bb7bc9b9debd526.jpg saved to cache
2026-03-27 10:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05d164fa-902c-54bb-ab5a-f6903d939bc9
2026-03-27 10:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_d8de86a0b5ee06b17a8fa0f6e162cb6e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1e9390>
2026-03-27 10:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_d8de86a0b5ee06b17a8fa0f6e162cb6e.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_d8de86a0b5ee06b17a8fa0f6e162cb6e.jpg saved to cache
2026-03-27 10:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05d164fa-902c-54bb-ab5a-f6903d939bc9
2026-03-27 10:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_88296858a7246e04432876905cea3787.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf373750>
2026-03-27 10:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_88296858a7246e04432876905cea3787.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_88296858a7246e04432876905cea3787.jpg saved to cache
2026-03-27 10:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05d164fa-902c-54bb-ab5a-f6903d939bc9
2026-03-27 10:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_a500538dfb86a8bfabf139d05a8f6d5b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1eb5d0>
2026-03-27 10:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_a500538dfb86a8bfabf139d05a8f6d5b.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_a500538dfb86a8bfabf139d05a8f6d5b.jpg saved to cache
2026-03-27 10:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05d164fa-902c-54bb-ab5a-f6903d939bc9
2026-03-27 10:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK16576/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:32:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_3b6fb9badd4014b5bc722c4c1e20875f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1e5310>
2026-03-27 10:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_3b6fb9badd4014b5bc722c4c1e20875f.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_3b6fb9badd4014b5bc722c4c1e20875f.jpg saved to cache
2026-03-27 10:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05d164fa-902c-54bb-ab5a-f6903d939bc9
2026-03-27 10:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WE78461/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:32:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_2fa0a14f7e1290e629837f808f697f57.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG01563> (referer: https://www.auto1.com/v1/car-details-view/NG01563/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:32:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_1326561e9f708460c8c36a289b8e572e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf44f390>
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_2fa0a14f7e1290e629837f808f697f57.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_2fa0a14f7e1290e629837f808f697f57.jpg saved to cache
2026-03-27 10:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05d164fa-902c-54bb-ab5a-f6903d939bc9
2026-03-27 10:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 724d67c5-f1e1-597f-acce-03782e26f701 with identifier: NG01563
2026-03-27 10:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 724d67c5-f1e1-597f-acce-03782e26f701 with scrape type 1
2026-03-27 10:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 724d67c5-f1e1-597f-acce-03782e26f701
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F81%252Fa381faf30264430e25570ef01e04d579%252Fpa%252FNG01563_d3b42b06a93051f4470b0912653170a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_d3b42b06a93051f4470b0912653170a6.jpg not downloaded yet
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F81%252Fa381faf30264430e25570ef01e04d579%252Fpa%252FNG01563_96aadc9d5691045e16e1e5a14e28d748.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_96aadc9d5691045e16e1e5a14e28d748.jpg not downloaded yet
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F81%252Fa381faf30264430e25570ef01e04d579%252Fpa%252FNG01563_684ddb8271f58f2c87004b17d8ea0b73.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_684ddb8271f58f2c87004b17d8ea0b73.jpg not downloaded yet
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F81%252Fa381faf30264430e25570ef01e04d579%252Fpa%252FNG01563_454b0fa8c90c6180416b662b5ef82984.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_454b0fa8c90c6180416b662b5ef82984.jpg not downloaded yet
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F81%252Fa381faf30264430e25570ef01e04d579%252Fpa%252FNG01563_fbd43f6d29c1e61234eed72f617570ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_fbd43f6d29c1e61234eed72f617570ab.jpg not downloaded yet
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c4249690>
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_1326561e9f708460c8c36a289b8e572e.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_1326561e9f708460c8c36a289b8e572e.jpg saved to cache
2026-03-27 10:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05d164fa-902c-54bb-ab5a-f6903d939bc9
2026-03-27 10:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_894fdef0af52ad86830b1291825bff01.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_fbd43f6d29c1e61234eed72f617570ab.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3583d0>
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_894fdef0af52ad86830b1291825bff01.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_894fdef0af52ad86830b1291825bff01.jpg saved to cache
2026-03-27 10:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05d164fa-902c-54bb-ab5a-f6903d939bc9
2026-03-27 10:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_454b0fa8c90c6180416b662b5ef82984.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf35ee10>
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_724d67c5-f1e1-597f-acce-03782e26f701/724d67c5-f1e1-597f-acce-03782e26f701_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F81%252Fa381faf30264430e25570ef01e04d579%252Fpa%252FNG01563_fbd43f6d29c1e61234eed72f617570ab.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_fbd43f6d29c1e61234eed72f617570ab.jpg saved to cache
2026-03-27 10:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 724d67c5-f1e1-597f-acce-03782e26f701
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf373c90>
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_724d67c5-f1e1-597f-acce-03782e26f701/724d67c5-f1e1-597f-acce-03782e26f701_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F81%252Fa381faf30264430e25570ef01e04d579%252Fpa%252FNG01563_454b0fa8c90c6180416b662b5ef82984.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_454b0fa8c90c6180416b662b5ef82984.jpg saved to cache
2026-03-27 10:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 724d67c5-f1e1-597f-acce-03782e26f701
2026-03-27 10:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_684ddb8271f58f2c87004b17d8ea0b73.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU23189> (referer: https://www.auto1.com/v1/car-details-view/JU23189/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:32:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_96aadc9d5691045e16e1e5a14e28d748.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be255e10>
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_724d67c5-f1e1-597f-acce-03782e26f701/724d67c5-f1e1-597f-acce-03782e26f701_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F81%252Fa381faf30264430e25570ef01e04d579%252Fpa%252FNG01563_684ddb8271f58f2c87004b17d8ea0b73.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_684ddb8271f58f2c87004b17d8ea0b73.jpg saved to cache
2026-03-27 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 724d67c5-f1e1-597f-acce-03782e26f701
2026-03-27 10:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_d3b42b06a93051f4470b0912653170a6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3097a46a-39d6-5ef1-a1ae-9239be909dd1 with identifier: JU23189
2026-03-27 10:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3097a46a-39d6-5ef1-a1ae-9239be909dd1 with scrape type 1
2026-03-27 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3097a46a-39d6-5ef1-a1ae-9239be909dd1
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c1eab4344a0340a0f3b1db6b2e6305%252Fpa%252FJU23189_54c02113b434321e84e9c828d4bb9960.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_54c02113b434321e84e9c828d4bb9960.jpg not downloaded yet
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c1eab4344a0340a0f3b1db6b2e6305%252Fpa%252FJU23189_0b8c1b4d74cc59b20b960d172290d14d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_0b8c1b4d74cc59b20b960d172290d14d.jpg not downloaded yet
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c1eab4344a0340a0f3b1db6b2e6305%252Fpa%252FJU23189_db5082b5045cb0872a6cc266415f45ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_db5082b5045cb0872a6cc266415f45ed.jpg not downloaded yet
2026-03-27 10:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be177590>
2026-03-27 10:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_724d67c5-f1e1-597f-acce-03782e26f701/724d67c5-f1e1-597f-acce-03782e26f701_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F81%252Fa381faf30264430e25570ef01e04d579%252Fpa%252FNG01563_96aadc9d5691045e16e1e5a14e28d748.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_96aadc9d5691045e16e1e5a14e28d748.jpg saved to cache
2026-03-27 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 724d67c5-f1e1-597f-acce-03782e26f701
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c1eab4344a0340a0f3b1db6b2e6305%252Fpa%252FJU23189_fe0bb2c500fd12cdc6910bed0b43c27e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_fe0bb2c500fd12cdc6910bed0b43c27e.jpg not downloaded yet
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c1eab4344a0340a0f3b1db6b2e6305%252Fpa%252FJU23189_96e705b65b64327c51bf888a25b4f3c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_96e705b65b64327c51bf888a25b4f3c0.jpg not downloaded yet
2026-03-27 10:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be10e4d0>
2026-03-27 10:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_724d67c5-f1e1-597f-acce-03782e26f701/724d67c5-f1e1-597f-acce-03782e26f701_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F81%252Fa381faf30264430e25570ef01e04d579%252Fpa%252FNG01563_d3b42b06a93051f4470b0912653170a6.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_d3b42b06a93051f4470b0912653170a6.jpg saved to cache
2026-03-27 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 724d67c5-f1e1-597f-acce-03782e26f701
2026-03-27 10:32:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 724d67c5-f1e1-597f-acce-03782e26f701, skipping ID generation
2026-03-27 10:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 724d67c5-f1e1-597f-acce-03782e26f701 with scrape type 1
2026-03-27 10:32:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 724d67c5-f1e1-597f-acce-03782e26f701 sending to next pipeline
2026-03-27 10:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 724d67c5-f1e1-597f-acce-03782e26f701, identifier: NG01563
2026-03-27 10:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 724d67c5-f1e1-597f-acce-03782e26f701 with identifier: NG01563
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-27 10:32:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 724d67c5-f1e1-597f-acce-03782e26f701 with identifier: NG01563
2026-03-27 10:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 724d67c5-f1e1-597f-acce-03782e26f701 with identifier: NG01563 to the API
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_d3b42b06a93051f4470b0912653170a6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 2,
'engine': '2.0L',
'engine_horse_power': 175,
'expiration_date': '2026-03-28T16:48:18Z',
'fuel_type': 'petrol',
'id': '724d67c5-f1e1-597f-acce-03782e26f701',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG01563',
'listing': 'auction',
'location': 'DE, Hannover',
'make': 'Saab',
'model': '9-3',
'odometer': 169337,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724d67c5-f1e1-597f-acce-03782e26f701/724d67c5-f1e1-597f-acce-03782e26f701_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_d3b42b06a93051f4470b0912653170a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724d67c5-f1e1-597f-acce-03782e26f701/724d67c5-f1e1-597f-acce-03782e26f701_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_96aadc9d5691045e16e1e5a14e28d748.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724d67c5-f1e1-597f-acce-03782e26f701/724d67c5-f1e1-597f-acce-03782e26f701_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_684ddb8271f58f2c87004b17d8ea0b73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724d67c5-f1e1-597f-acce-03782e26f701/724d67c5-f1e1-597f-acce-03782e26f701_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55012,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_454b0fa8c90c6180416b662b5ef82984.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_724d67c5-f1e1-597f-acce-03782e26f701/724d67c5-f1e1-597f-acce-03782e26f701_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53280,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/81/a381faf30264430e25570ef01e04d579/pa/NG01563_fbd43f6d29c1e61234eed72f617570ab.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2005-02-21',
'seats_number': 4,
'seller_name': None,
'title': 'Saab 9-3 2.0 T Vector',
'transmission': 'automatic',
'trim': 'T Vector',
'year': 2005}
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG01563%27 HTTP/1.1" 200 None
2026-03-27 10:32:20 [auto1.de] INFO: Saving data for NG01563: {'created_time': 1774607540.946552, 'last_price_update_time': 1774607540.946567, 'auction_closing_time': 1774716498.0}
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG01563') HTTP/1.1" 204 0
2026-03-27 10:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU27688> (referer: https://www.auto1.com/v1/car-details-view/AU27688/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:32:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK28238> (referer: https://www.auto1.com/v1/car-details-view/ZK28238/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:32:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_98954574ddc290ad7e3a5281447ed77c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_3514f2f00c1f292ffcf4b240f368731f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_fe0bb2c500fd12cdc6910bed0b43c27e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_db5082b5045cb0872a6cc266415f45ed.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_96e705b65b64327c51bf888a25b4f3c0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5f1c75a-867e-5e74-b483-de1381e56f8e with identifier: AU27688
2026-03-27 10:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5f1c75a-867e-5e74-b483-de1381e56f8e with scrape type 1
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5f1c75a-867e-5e74-b483-de1381e56f8e
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_3dc0adac8bfe64b8a282fb2c33db9b2b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_3dc0adac8bfe64b8a282fb2c33db9b2b.jpg not downloaded yet
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_f10eab9251ed3c2b0fc566a3eccd3c83.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_f10eab9251ed3c2b0fc566a3eccd3c83.jpg not downloaded yet
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_6718ddc2c76fe02fe5a04649e1023584.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_6718ddc2c76fe02fe5a04649e1023584.jpg not downloaded yet
2026-03-27 10:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da4eeb5d-6e91-5755-b416-1a790dfd96ac with identifier: ZK28238
2026-03-27 10:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da4eeb5d-6e91-5755-b416-1a790dfd96ac with scrape type 1
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da4eeb5d-6e91-5755-b416-1a790dfd96ac
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa5%252F1ca5096b646faf56aba929225c81e2fa%252Fpa%252FZK28238_6c2d7df19dd0b18fa4f426b63f77043e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_6c2d7df19dd0b18fa4f426b63f77043e.jpg already downloaded
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa5%252F1ca5096b646faf56aba929225c81e2fa%252Fpa%252FZK28238_bcb6913732dbbeadeca1cb70a30251f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_bcb6913732dbbeadeca1cb70a30251f7.jpg already downloaded
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa5%252F1ca5096b646faf56aba929225c81e2fa%252Fpa%252FZK28238_2b64d431505d40c69f1e19faf1912a3a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_2b64d431505d40c69f1e19faf1912a3a.jpg already downloaded
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa5%252F1ca5096b646faf56aba929225c81e2fa%252Fpa%252FZK28238_aeb5dc9eb21124e4bb268431de8b0ce5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_aeb5dc9eb21124e4bb268431de8b0ce5.jpg already downloaded
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa5%252F1ca5096b646faf56aba929225c81e2fa%252Fpa%252FZK28238_da33b3c70472a70394e95de7b169ec2b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_da33b3c70472a70394e95de7b169ec2b.jpg already downloaded
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa5%252F1ca5096b646faf56aba929225c81e2fa%252Fpa%252FZK28238_fba494a8b34197b2e7a996d5f6fdf88b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_fba494a8b34197b2e7a996d5f6fdf88b.jpg already downloaded
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa5%252F1ca5096b646faf56aba929225c81e2fa%252Fpa%252FZK28238_d0d4961ec627b072a71d4a4c3d9399fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_d0d4961ec627b072a71d4a4c3d9399fd.jpg already downloaded
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa5%252F1ca5096b646faf56aba929225c81e2fa%252Fpa%252FZK28238_1e5b7236faf27dc700e29d0ae145c2b7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_1e5b7236faf27dc700e29d0ae145c2b7.jpg already downloaded
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa5%252F1ca5096b646faf56aba929225c81e2fa%252Fpa%252FZK28238_c5bcec5510cdfb8226925fc9a34e9240.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_c5bcec5510cdfb8226925fc9a34e9240.jpg already downloaded
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fa5%252F1ca5096b646faf56aba929225c81e2fa%252Fpa%252FZK28238_cd895d502eaf90f1a823da9f199f702c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_cd895d502eaf90f1a823da9f199f702c.jpg already downloaded
2026-03-27 10:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da4eeb5d-6e91-5755-b416-1a790dfd96ac, identifier: ZK28238
2026-03-27 10:32:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c564dd50>
2026-03-27 10:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F04%252F7104db0b45eff8ed07a1db2fcb0c4987%252Fpa%252FUE30876_98954574ddc290ad7e3a5281447ed77c.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_98954574ddc290ad7e3a5281447ed77c.jpg saved to cache
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05d164fa-902c-54bb-ab5a-f6903d939bc9
2026-03-27 10:32:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05d164fa-902c-54bb-ab5a-f6903d939bc9, skipping ID generation
2026-03-27 10:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05d164fa-902c-54bb-ab5a-f6903d939bc9 with scrape type 1
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05d164fa-902c-54bb-ab5a-f6903d939bc9 sending to next pipeline
2026-03-27 10:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05d164fa-902c-54bb-ab5a-f6903d939bc9, identifier: UE30876
2026-03-27 10:32:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be02f3d0>
2026-03-27 10:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_3514f2f00c1f292ffcf4b240f368731f.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_3514f2f00c1f292ffcf4b240f368731f.jpg saved to cache
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7a430bd-5867-52e7-bb37-7078639a2673
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_e506ea6ce816f18eba841e1496192ce1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_e506ea6ce816f18eba841e1496192ce1.jpg not downloaded yet
2026-03-27 10:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da4eeb5d-6e91-5755-b416-1a790dfd96ac with identifier: ZK28238
2026-03-27 10:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da4eeb5d-6e91-5755-b416-1a790dfd96ac with identifier: ZK28238
2026-03-27 10:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da4eeb5d-6e91-5755-b416-1a790dfd96ac with identifier: ZK28238 to the API
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZK28238>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-03-28T16:01:57Z',
'fuel_type': 'diesel',
'id': 'da4eeb5d-6e91-5755-b416-1a790dfd96ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK28238',
'listing': 'auction',
'location': 'DE, Überherrn',
'make': 'BMW',
'model': '3er',
'odometer': 290983,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_6c2d7df19dd0b18fa4f426b63f77043e.jpg',
'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_bcb6913732dbbeadeca1cb70a30251f7.jpg',
'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_2b64d431505d40c69f1e19faf1912a3a.jpg',
'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_aeb5dc9eb21124e4bb268431de8b0ce5.jpg',
'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_da33b3c70472a70394e95de7b169ec2b.jpg',
'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_fba494a8b34197b2e7a996d5f6fdf88b.jpg',
'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_d0d4961ec627b072a71d4a4c3d9399fd.jpg',
'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_1e5b7236faf27dc700e29d0ae145c2b7.jpg',
'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_c5bcec5510cdfb8226925fc9a34e9240.jpg',
'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_cd895d502eaf90f1a823da9f199f702c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da4eeb5d-6e91-5755-b416-1a790dfd96ac/da4eeb5d-6e91-5755-b416-1a790dfd96ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88250,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_6c2d7df19dd0b18fa4f426b63f77043e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da4eeb5d-6e91-5755-b416-1a790dfd96ac/da4eeb5d-6e91-5755-b416-1a790dfd96ac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76201,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_bcb6913732dbbeadeca1cb70a30251f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da4eeb5d-6e91-5755-b416-1a790dfd96ac/da4eeb5d-6e91-5755-b416-1a790dfd96ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_2b64d431505d40c69f1e19faf1912a3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da4eeb5d-6e91-5755-b416-1a790dfd96ac/da4eeb5d-6e91-5755-b416-1a790dfd96ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69051,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_aeb5dc9eb21124e4bb268431de8b0ce5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da4eeb5d-6e91-5755-b416-1a790dfd96ac/da4eeb5d-6e91-5755-b416-1a790dfd96ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68218,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_da33b3c70472a70394e95de7b169ec2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da4eeb5d-6e91-5755-b416-1a790dfd96ac/da4eeb5d-6e91-5755-b416-1a790dfd96ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71920,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_fba494a8b34197b2e7a996d5f6fdf88b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da4eeb5d-6e91-5755-b416-1a790dfd96ac/da4eeb5d-6e91-5755-b416-1a790dfd96ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_d0d4961ec627b072a71d4a4c3d9399fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da4eeb5d-6e91-5755-b416-1a790dfd96ac/da4eeb5d-6e91-5755-b416-1a790dfd96ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72570,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_1e5b7236faf27dc700e29d0ae145c2b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da4eeb5d-6e91-5755-b416-1a790dfd96ac/da4eeb5d-6e91-5755-b416-1a790dfd96ac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_c5bcec5510cdfb8226925fc9a34e9240.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da4eeb5d-6e91-5755-b416-1a790dfd96ac/da4eeb5d-6e91-5755-b416-1a790dfd96ac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72218,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/a5/1ca5096b646faf56aba929225c81e2fa/pa/ZK28238_cd895d502eaf90f1a823da9f199f702c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-11-26',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 318d',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK28238%27 HTTP/1.1" 200 None
2026-03-27 10:32:22 [auto1.de] INFO: Saving data for ZK28238: {'created_time': 1774607542.101111, 'last_price_update_time': 1774607542.101123, 'auction_closing_time': 1774713717.0}
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK28238') HTTP/1.1" 204 0
2026-03-27 10:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05d164fa-902c-54bb-ab5a-f6903d939bc9 with identifier: UE30876
2026-03-27 10:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05d164fa-902c-54bb-ab5a-f6903d939bc9 with identifier: UE30876
2026-03-27 10:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05d164fa-902c-54bb-ab5a-f6903d939bc9 with identifier: UE30876 to the API
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_98954574ddc290ad7e3a5281447ed77c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 154,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:14:10Z',
'fuel_type': 'petrol',
'id': '05d164fa-902c-54bb-ab5a-f6903d939bc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE30876',
'listing': 'auction',
'location': 'DE, Berlin',
'make': 'Hyundai',
'model': 'ix20',
'odometer': 84867,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2534418,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_98954574ddc290ad7e3a5281447ed77c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75682,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_894fdef0af52ad86830b1291825bff01.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66006,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_1326561e9f708460c8c36a289b8e572e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59213,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_2fa0a14f7e1290e629837f808f697f57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69844,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_3b6fb9badd4014b5bc722c4c1e20875f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76304,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_a500538dfb86a8bfabf139d05a8f6d5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53544,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_88296858a7246e04432876905cea3787.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_7d53ee4f42f0d1e3556156321d7e63ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75173,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_d8de86a0b5ee06b17a8fa0f6e162cb6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05d164fa-902c-54bb-ab5a-f6903d939bc9/05d164fa-902c-54bb-ab5a-f6903d939bc9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69441,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/04/7104db0b45eff8ed07a1db2fcb0c4987/pa/UE30876_e3d5ae542c0f3d520bb7bc9b9debd526.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-10-14',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai ix20 1.6 Comfort',
'transmission': 'automatic',
'trim': 'Comfort',
'year': 2012}
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE30876%27 HTTP/1.1" 200 None
2026-03-27 10:32:22 [auto1.de] INFO: Saving data for UE30876: {'created_time': 1774607542.583199, 'last_price_update_time': 1774607542.58321, 'auction_closing_time': 1774714450.0}
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE30876') HTTP/1.1" 204 0
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_05d803c7ebc16a01c98581706b29bf92.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_05d803c7ebc16a01c98581706b29bf92.jpg not downloaded yet
2026-03-27 10:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be29e790>
2026-03-27 10:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3097a46a-39d6-5ef1-a1ae-9239be909dd1/3097a46a-39d6-5ef1-a1ae-9239be909dd1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c1eab4344a0340a0f3b1db6b2e6305%252Fpa%252FJU23189_fe0bb2c500fd12cdc6910bed0b43c27e.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_fe0bb2c500fd12cdc6910bed0b43c27e.jpg saved to cache
2026-03-27 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3097a46a-39d6-5ef1-a1ae-9239be909dd1
2026-03-27 10:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2ab510>
2026-03-27 10:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3097a46a-39d6-5ef1-a1ae-9239be909dd1/3097a46a-39d6-5ef1-a1ae-9239be909dd1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c1eab4344a0340a0f3b1db6b2e6305%252Fpa%252FJU23189_db5082b5045cb0872a6cc266415f45ed.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_db5082b5045cb0872a6cc266415f45ed.jpg saved to cache
2026-03-27 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3097a46a-39d6-5ef1-a1ae-9239be909dd1
2026-03-27 10:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1d6710>
2026-03-27 10:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3097a46a-39d6-5ef1-a1ae-9239be909dd1/3097a46a-39d6-5ef1-a1ae-9239be909dd1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c1eab4344a0340a0f3b1db6b2e6305%252Fpa%252FJU23189_96e705b65b64327c51bf888a25b4f3c0.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_96e705b65b64327c51bf888a25b4f3c0.jpg saved to cache
2026-03-27 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3097a46a-39d6-5ef1-a1ae-9239be909dd1
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_e167fab4fa422320cc36e79e19411165.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_e167fab4fa422320cc36e79e19411165.jpg not downloaded yet
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_4d5445958da64d0b629ee5150ac9c3e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_4d5445958da64d0b629ee5150ac9c3e3.jpg not downloaded yet
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_fffd6795438b65f4a40b7095843ed8a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_fffd6795438b65f4a40b7095843ed8a3.jpg not downloaded yet
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_09e65aee30be75a0ce1b268a0724e1ee.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_09e65aee30be75a0ce1b268a0724e1ee.jpg not downloaded yet
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_ea32d875b640704ca08aef13bae2c169.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_ea32d875b640704ca08aef13bae2c169.jpg not downloaded yet
2026-03-27 10:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_6718ddc2c76fe02fe5a04649e1023584.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_f10eab9251ed3c2b0fc566a3eccd3c83.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_3dc0adac8bfe64b8a282fb2c33db9b2b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_ea32d875b640704ca08aef13bae2c169.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_09e65aee30be75a0ce1b268a0724e1ee.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3250d0>
2026-03-27 10:32:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_6718ddc2c76fe02fe5a04649e1023584.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_6718ddc2c76fe02fe5a04649e1023584.jpg saved to cache
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5f1c75a-867e-5e74-b483-de1381e56f8e
2026-03-27 10:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_e506ea6ce816f18eba841e1496192ce1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_fffd6795438b65f4a40b7095843ed8a3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_4d5445958da64d0b629ee5150ac9c3e3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_e167fab4fa422320cc36e79e19411165.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be035810>
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_f10eab9251ed3c2b0fc566a3eccd3c83.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_f10eab9251ed3c2b0fc566a3eccd3c83.jpg saved to cache
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5f1c75a-867e-5e74-b483-de1381e56f8e
2026-03-27 10:32:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 10:32:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 10:32:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 10:32:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 10:32:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c58ef250>
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_3dc0adac8bfe64b8a282fb2c33db9b2b.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_3dc0adac8bfe64b8a282fb2c33db9b2b.jpg saved to cache
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5f1c75a-867e-5e74-b483-de1381e56f8e
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be111150>
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_ea32d875b640704ca08aef13bae2c169.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_ea32d875b640704ca08aef13bae2c169.jpg saved to cache
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5f1c75a-867e-5e74-b483-de1381e56f8e
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be032910>
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_09e65aee30be75a0ce1b268a0724e1ee.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_09e65aee30be75a0ce1b268a0724e1ee.jpg saved to cache
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5f1c75a-867e-5e74-b483-de1381e56f8e
2026-03-27 10:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_05d803c7ebc16a01c98581706b29bf92.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_54c02113b434321e84e9c828d4bb9960.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_0b8c1b4d74cc59b20b960d172290d14d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_9807036a9c6585047f11f159fd76dd65.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c53b0390>
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_e506ea6ce816f18eba841e1496192ce1.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_e506ea6ce816f18eba841e1496192ce1.jpg saved to cache
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5f1c75a-867e-5e74-b483-de1381e56f8e
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c541eed0>
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_fffd6795438b65f4a40b7095843ed8a3.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_fffd6795438b65f4a40b7095843ed8a3.jpg saved to cache
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5f1c75a-867e-5e74-b483-de1381e56f8e
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be281ed0>
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_4d5445958da64d0b629ee5150ac9c3e3.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_4d5445958da64d0b629ee5150ac9c3e3.jpg saved to cache
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5f1c75a-867e-5e74-b483-de1381e56f8e
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be139850>
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_e167fab4fa422320cc36e79e19411165.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_e167fab4fa422320cc36e79e19411165.jpg saved to cache
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5f1c75a-867e-5e74-b483-de1381e56f8e
2026-03-27 10:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL17570> (referer: https://www.auto1.com/v1/car-details-view/HL17570/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1bb990>
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fca%252F83ca79bfa76585ebb1819289d57fa81a%252Fpa%252FAU27688_05d803c7ebc16a01c98581706b29bf92.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_05d803c7ebc16a01c98581706b29bf92.jpg saved to cache
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5f1c75a-867e-5e74-b483-de1381e56f8e
2026-03-27 10:32:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5f1c75a-867e-5e74-b483-de1381e56f8e, skipping ID generation
2026-03-27 10:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5f1c75a-867e-5e74-b483-de1381e56f8e with scrape type 1
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5f1c75a-867e-5e74-b483-de1381e56f8e sending to next pipeline
2026-03-27 10:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5f1c75a-867e-5e74-b483-de1381e56f8e, identifier: AU27688
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c61c4490>
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3097a46a-39d6-5ef1-a1ae-9239be909dd1/3097a46a-39d6-5ef1-a1ae-9239be909dd1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c1eab4344a0340a0f3b1db6b2e6305%252Fpa%252FJU23189_54c02113b434321e84e9c828d4bb9960.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_54c02113b434321e84e9c828d4bb9960.jpg saved to cache
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3097a46a-39d6-5ef1-a1ae-9239be909dd1
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be100090>
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3097a46a-39d6-5ef1-a1ae-9239be909dd1/3097a46a-39d6-5ef1-a1ae-9239be909dd1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc1%252F68c1eab4344a0340a0f3b1db6b2e6305%252Fpa%252FJU23189_0b8c1b4d74cc59b20b960d172290d14d.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_0b8c1b4d74cc59b20b960d172290d14d.jpg saved to cache
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3097a46a-39d6-5ef1-a1ae-9239be909dd1
2026-03-27 10:32:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3097a46a-39d6-5ef1-a1ae-9239be909dd1, skipping ID generation
2026-03-27 10:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3097a46a-39d6-5ef1-a1ae-9239be909dd1 with scrape type 1
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3097a46a-39d6-5ef1-a1ae-9239be909dd1 sending to next pipeline
2026-03-27 10:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3097a46a-39d6-5ef1-a1ae-9239be909dd1, identifier: JU23189
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c424a610>
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_9807036a9c6585047f11f159fd76dd65.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_9807036a9c6585047f11f159fd76dd65.jpg saved to cache
2026-03-27 10:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f834236-0c7f-557c-9693-c1c9802a73b0
2026-03-27 10:32:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5f1c75a-867e-5e74-b483-de1381e56f8e with identifier: AU27688
2026-03-27 10:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5f1c75a-867e-5e74-b483-de1381e56f8e with identifier: AU27688
2026-03-27 10:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5f1c75a-867e-5e74-b483-de1381e56f8e with identifier: AU27688 to the API
2026-03-27 10:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_05d803c7ebc16a01c98581706b29bf92.jpg>
{'auction_title': '',
'c_o_2_emission_value': 229,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:20:42Z',
'fuel_type': 'petrol',
'id': 'f5f1c75a-867e-5e74-b483-de1381e56f8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU27688',
'listing': 'auction',
'location': 'DE',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 228569,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2942436,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_3dc0adac8bfe64b8a282fb2c33db9b2b.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_f10eab9251ed3c2b0fc566a3eccd3c83.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_6718ddc2c76fe02fe5a04649e1023584.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_e506ea6ce816f18eba841e1496192ce1.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54081,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_05d803c7ebc16a01c98581706b29bf92.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51581,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_e167fab4fa422320cc36e79e19411165.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38250,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_4d5445958da64d0b629ee5150ac9c3e3.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63169,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_fffd6795438b65f4a40b7095843ed8a3.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47673,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_09e65aee30be75a0ce1b268a0724e1ee.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f1c75a-867e-5e74-b483-de1381e56f8e/f5f1c75a-867e-5e74-b483-de1381e56f8e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ca/83ca79bfa76585ebb1819289d57fa81a/pa/AU27688_ea32d875b640704ca08aef13bae2c169.jpg',
'Width': 450}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-08-20',
'seats_number': 4,
'seller_name': None,
'title': 'Volkswagen Polo 1.4 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2013}
2026-03-27 10:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU27688%27 HTTP/1.1" 200 None
2026-03-27 10:32:25 [auto1.de] INFO: Saving data for AU27688: {'created_time': 1774607545.020947, 'last_price_update_time': 1774607545.020956, 'auction_closing_time': 1774714842.0}
2026-03-27 10:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU27688') HTTP/1.1" 204 0
2026-03-27 10:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3097a46a-39d6-5ef1-a1ae-9239be909dd1 with identifier: JU23189
2026-03-27 10:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3097a46a-39d6-5ef1-a1ae-9239be909dd1 with identifier: JU23189
2026-03-27 10:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3097a46a-39d6-5ef1-a1ae-9239be909dd1 with identifier: JU23189 to the API
2026-03-27 10:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_0b8c1b4d74cc59b20b960d172290d14d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 237,
'category': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:30:37Z',
'fuel_type': 'petrol',
'id': '3097a46a-39d6-5ef1-a1ae-9239be909dd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU23189',
'listing': 'auction',
'location': 'DE, München',
'make': 'Mercedes-Benz',
'model': 'SLK-Klasse',
'odometer': 168144,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3097a46a-39d6-5ef1-a1ae-9239be909dd1/3097a46a-39d6-5ef1-a1ae-9239be909dd1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93868,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_54c02113b434321e84e9c828d4bb9960.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3097a46a-39d6-5ef1-a1ae-9239be909dd1/3097a46a-39d6-5ef1-a1ae-9239be909dd1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_0b8c1b4d74cc59b20b960d172290d14d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3097a46a-39d6-5ef1-a1ae-9239be909dd1/3097a46a-39d6-5ef1-a1ae-9239be909dd1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_db5082b5045cb0872a6cc266415f45ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3097a46a-39d6-5ef1-a1ae-9239be909dd1/3097a46a-39d6-5ef1-a1ae-9239be909dd1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_fe0bb2c500fd12cdc6910bed0b43c27e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3097a46a-39d6-5ef1-a1ae-9239be909dd1/3097a46a-39d6-5ef1-a1ae-9239be909dd1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94558,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/c1/68c1eab4344a0340a0f3b1db6b2e6305/pa/JU23189_96e705b65b64327c51bf888a25b4f3c0.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2002-09-04',
'seats_number': 2,
'seller_name': None,
'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
'transmission': 'manual',
'trim': '',
'year': 2002}
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU23189%27 HTTP/1.1" 200 None
2026-03-27 10:32:26 [auto1.de] INFO: Saving data for JU23189: {'created_time': 1774607546.12803, 'last_price_update_time': 1774607546.128042, 'auction_closing_time': 1774715437.0}
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU23189') HTTP/1.1" 204 0
2026-03-27 10:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_e284e411b510476cd0c1f846982936d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611 with identifier: HL17570
2026-03-27 10:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611 with scrape type 1
2026-03-27 10:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F8a%252F268a501677789702aeff149630b184cc%252Fpa%252FHL17570_8ed9624cd0e4fd33394739892cb23c86.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_8ed9624cd0e4fd33394739892cb23c86.jpg not downloaded yet
2026-03-27 10:32:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F8a%252F268a501677789702aeff149630b184cc%252Fpa%252FHL17570_97f32209863f70588d1681973a76b8e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_97f32209863f70588d1681973a76b8e3.jpg not downloaded yet
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F8a%252F268a501677789702aeff149630b184cc%252Fpa%252FHL17570_1bb9c6b4d95c404e4512b7924c20938c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_1bb9c6b4d95c404e4512b7924c20938c.jpg not downloaded yet
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F8a%252F268a501677789702aeff149630b184cc%252Fpa%252FHL17570_b220ff1687d29e5eddc8bac9c0639c09.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_b220ff1687d29e5eddc8bac9c0639c09.jpg not downloaded yet
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F8a%252F268a501677789702aeff149630b184cc%252Fpa%252FHL17570_e95127602410464d4b0e1cb0b5b426fb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_e95127602410464d4b0e1cb0b5b426fb.jpg not downloaded yet
2026-03-27 10:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf484590>
2026-03-27 10:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_e284e411b510476cd0c1f846982936d5.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_e284e411b510476cd0c1f846982936d5.jpg saved to cache
2026-03-27 10:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7a430bd-5867-52e7-bb37-7078639a2673
2026-03-27 10:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_8ed9624cd0e4fd33394739892cb23c86.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_c8250dc6104a599642d995c0f785e983.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:26 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 10482 | hits on page: 40
2026-03-27 10:32:26 [auto1.de] INFO: Found listing with ID: UK16576
2026-03-27 10:32:26 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-27 10:32:26 [auto1.de] INFO: Found listing with ID: HL17570
2026-03-27 10:32:26 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-27 10:32:26 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-27 10:32:26 [auto1.de] INFO: Found listing with ID: BZ40542
2026-03-27 10:32:26 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP27245%27 HTTP/1.1" 200 None
2026-03-27 10:32:26 [auto1.de] INFO: Scrape type for KP27245: 1
2026-03-27 10:32:26 [auto1.de] INFO: Found listing with ID: LG79841
2026-03-27 10:32:26 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-27 10:32:26 [auto1.de] INFO: Found listing with ID: LF68869
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF68869%27 HTTP/1.1" 200 None
2026-03-27 10:32:26 [auto1.de] INFO: Scrape type for LF68869: 1
2026-03-27 10:32:26 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-27 10:32:26 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF06660%27 HTTP/1.1" 200 None
2026-03-27 10:32:26 [auto1.de] INFO: Scrape type for HF06660: 1
2026-03-27 10:32:26 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-27 10:32:26 [auto1.de] INFO: Found listing with ID: JC58786
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC58786%27 HTTP/1.1" 200 None
2026-03-27 10:32:26 [auto1.de] INFO: Scrape type for JC58786: 0
2026-03-27 10:32:26 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-27 10:32:26 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-27 10:32:26 [auto1.de] INFO: Found listing with ID: RF57736
2026-03-27 10:32:26 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY26864%27 HTTP/1.1" 200 None
2026-03-27 10:32:26 [auto1.de] INFO: Scrape type for GY26864: 2
2026-03-27 10:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7882e127-1b01-5045-8bef-b3bb50b2c615 with identifier: GY26864
2026-03-27 10:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7882e127-1b01-5045-8bef-b3bb50b2c615 with scrape type 2
2026-03-27 10:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7882e127-1b01-5045-8bef-b3bb50b2c615 with scrape type 2
2026-03-27 10:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7882e127-1b01-5045-8bef-b3bb50b2c615, identifier: GY26864
2026-03-27 10:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7882e127-1b01-5045-8bef-b3bb50b2c615 with identifier: GY26864
2026-03-27 10:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7882e127-1b01-5045-8bef-b3bb50b2c615 with identifier: GY26864
2026-03-27 10:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7882e127-1b01-5045-8bef-b3bb50b2c615 with identifier: GY26864 to the API
2026-03-27 10:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 380,
'expiration_date': '2026-03-28T16:19:44Z',
'fuel_type': 'petrol',
'id': '7882e127-1b01-5045-8bef-b3bb50b2c615',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY26864',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 145492,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-13',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 45 Shooting Brake AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2016}
2026-03-27 10:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY26864%27 HTTP/1.1" 200 None
2026-03-27 10:32:27 [auto1.de] INFO: Saving data for GY26864: {'auction_closing_time': 1774714784.0, 'created_time': 1773226949.831073, 'last_price_update_time': 1774607547.980815}
2026-03-27 10:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY26864') HTTP/1.1" 204 0
2026-03-27 10:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_b220ff1687d29e5eddc8bac9c0639c09.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:28 [auto1.de] INFO: Found listing with ID: JL47940
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL47940%27 HTTP/1.1" 200 None
2026-03-27 10:32:28 [auto1.de] INFO: Scrape type for JL47940: 1
2026-03-27 10:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_e95127602410464d4b0e1cb0b5b426fb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c564af90>
2026-03-27 10:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611/d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F8a%252F268a501677789702aeff149630b184cc%252Fpa%252FHL17570_8ed9624cd0e4fd33394739892cb23c86.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_8ed9624cd0e4fd33394739892cb23c86.jpg saved to cache
2026-03-27 10:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611
2026-03-27 10:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be282e10>
2026-03-27 10:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_c8250dc6104a599642d995c0f785e983.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_c8250dc6104a599642d995c0f785e983.jpg saved to cache
2026-03-27 10:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f834236-0c7f-557c-9693-c1c9802a73b0
2026-03-27 10:32:28 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT76935%27 HTTP/1.1" 200 None
2026-03-27 10:32:28 [auto1.de] INFO: Scrape type for VT76935: 1
2026-03-27 10:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY54008/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:32:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:32:28 [auto1.de] INFO: Found listing with ID: ZD23716
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD23716%27 HTTP/1.1" 200 None
2026-03-27 10:32:28 [auto1.de] INFO: Scrape type for ZD23716: 1
2026-03-27 10:32:28 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG00412%27 HTTP/1.1" 200 None
2026-03-27 10:32:28 [auto1.de] INFO: Scrape type for ZG00412: 2
2026-03-27 10:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 703f9153-187e-5475-b1d0-35832e3679b3 with identifier: ZG00412
2026-03-27 10:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 703f9153-187e-5475-b1d0-35832e3679b3 with scrape type 2
2026-03-27 10:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 703f9153-187e-5475-b1d0-35832e3679b3 with scrape type 2
2026-03-27 10:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 703f9153-187e-5475-b1d0-35832e3679b3, identifier: ZG00412
2026-03-27 10:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c564f210>
2026-03-27 10:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611/d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F8a%252F268a501677789702aeff149630b184cc%252Fpa%252FHL17570_b220ff1687d29e5eddc8bac9c0639c09.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_b220ff1687d29e5eddc8bac9c0639c09.jpg saved to cache
2026-03-27 10:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611
2026-03-27 10:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f2b90>
2026-03-27 10:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611/d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F8a%252F268a501677789702aeff149630b184cc%252Fpa%252FHL17570_e95127602410464d4b0e1cb0b5b426fb.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_e95127602410464d4b0e1cb0b5b426fb.jpg saved to cache
2026-03-27 10:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611
2026-03-27 10:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 703f9153-187e-5475-b1d0-35832e3679b3 with identifier: ZG00412
2026-03-27 10:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 703f9153-187e-5475-b1d0-35832e3679b3 with identifier: ZG00412
2026-03-27 10:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 703f9153-187e-5475-b1d0-35832e3679b3 with identifier: ZG00412 to the API
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:35:00Z',
'fuel_type': 'diesel',
'id': '703f9153-187e-5475-b1d0-35832e3679b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG00412',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 94794,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-12',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2018}
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG00412%27 HTTP/1.1" 200 None
2026-03-27 10:32:28 [auto1.de] INFO: Saving data for ZG00412: {'auction_closing_time': 1774715700.0, 'created_time': 1774002196.112133, 'last_price_update_time': 1774607548.861903}
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG00412') HTTP/1.1" 204 0
2026-03-27 10:32:28 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL45586%27 HTTP/1.1" 200 None
2026-03-27 10:32:28 [auto1.de] INFO: Scrape type for XL45586: 2
2026-03-27 10:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8157fd3e-fd37-5c06-b9bd-57338cef12dd with identifier: XL45586
2026-03-27 10:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8157fd3e-fd37-5c06-b9bd-57338cef12dd with scrape type 2
2026-03-27 10:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8157fd3e-fd37-5c06-b9bd-57338cef12dd with scrape type 2
2026-03-27 10:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8157fd3e-fd37-5c06-b9bd-57338cef12dd, identifier: XL45586
2026-03-27 10:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8157fd3e-fd37-5c06-b9bd-57338cef12dd with identifier: XL45586
2026-03-27 10:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8157fd3e-fd37-5c06-b9bd-57338cef12dd with identifier: XL45586
2026-03-27 10:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8157fd3e-fd37-5c06-b9bd-57338cef12dd with identifier: XL45586 to the API
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 450,
'expiration_date': '2026-03-28T16:15:26Z',
'fuel_type': 'petrol',
'id': '8157fd3e-fd37-5c06-b9bd-57338cef12dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL45586',
'listing': 'auction',
'make': 'Audi',
'model': 'S6',
'odometer': 139797,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-24',
'seller_name': None,
'title': 'Audi S6 4.0 V8 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2018}
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL45586%27 HTTP/1.1" 200 None
2026-03-27 10:32:29 [auto1.de] INFO: Saving data for XL45586: {'auction_closing_time': 1774714526.0, 'created_time': 1772543201.677041, 'last_price_update_time': 1774607549.381908}
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL45586') HTTP/1.1" 204 0
2026-03-27 10:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_86f5e36d3a5082e554f5dde04c67b715.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:29 [auto1.de] INFO: Found listing with ID: PH94566
2026-03-27 10:32:29 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC50567%27 HTTP/1.1" 200 None
2026-03-27 10:32:29 [auto1.de] INFO: Scrape type for MC50567: 1
2026-03-27 10:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX31314> (referer: https://www.auto1.com/v1/car-details-view/XX31314/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:32:29 [auto1.de] INFO: Found listing with ID: RG24592
2026-03-27 10:32:29 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK74159%27 HTTP/1.1" 200 None
2026-03-27 10:32:29 [auto1.de] INFO: Scrape type for MK74159: 1
2026-03-27 10:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:32:29 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-27 10:32:29 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ96778%27 HTTP/1.1" 200 None
2026-03-27 10:32:29 [auto1.de] INFO: Scrape type for JZ96778: 1
2026-03-27 10:32:29 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-27 10:32:29 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB74339%27 HTTP/1.1" 200 None
2026-03-27 10:32:29 [auto1.de] INFO: Scrape type for GB74339: 1
2026-03-27 10:32:29 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-27 10:32:29 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS13064%27 HTTP/1.1" 200 None
2026-03-27 10:32:29 [auto1.de] INFO: Scrape type for YS13064: 1
2026-03-27 10:32:29 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW23670%27 HTTP/1.1" 200 None
2026-03-27 10:32:29 [auto1.de] INFO: Scrape type for DW23670: 1
2026-03-27 10:32:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2a82d0>
2026-03-27 10:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_86f5e36d3a5082e554f5dde04c67b715.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_86f5e36d3a5082e554f5dde04c67b715.jpg saved to cache
2026-03-27 10:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7a430bd-5867-52e7-bb37-7078639a2673
2026-03-27 10:32:29 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL45864%27 HTTP/1.1" 200 None
2026-03-27 10:32:29 [auto1.de] INFO: Scrape type for TL45864: 1
2026-03-27 10:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 929769ef-7a25-57f3-bcc9-86c4e988916c with identifier: XX31314
2026-03-27 10:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 929769ef-7a25-57f3-bcc9-86c4e988916c with scrape type 1
2026-03-27 10:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 929769ef-7a25-57f3-bcc9-86c4e988916c
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2c86f11bc26c6f0c7afb12a65b72b3%252Fpa%252FXX31314_27564b7811ad82bdd058f9104703926c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2c86f11bc26c6f0c7afb12a65b72b3/pa/XX31314_27564b7811ad82bdd058f9104703926c.jpg not downloaded yet
2026-03-27 10:32:29 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-27 10:32:29 [auto1.de] INFO: Found listing with ID: KH43158
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH43158%27 HTTP/1.1" 200 None
2026-03-27 10:32:29 [auto1.de] INFO: Scrape type for KH43158: 1
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2c86f11bc26c6f0c7afb12a65b72b3%252Fpa%252FXX31314_8169b043f25cdfd74595cfafcf390b11.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2c86f11bc26c6f0c7afb12a65b72b3/pa/XX31314_8169b043f25cdfd74595cfafcf390b11.jpg not downloaded yet
2026-03-27 10:32:29 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE44691%27 HTTP/1.1" 200 None
2026-03-27 10:32:29 [auto1.de] INFO: Scrape type for BE44691: 1
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2c86f11bc26c6f0c7afb12a65b72b3%252Fpa%252FXX31314_c19d675e62af93648fb7002a9fce8aa9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2c86f11bc26c6f0c7afb12a65b72b3/pa/XX31314_c19d675e62af93648fb7002a9fce8aa9.jpg not downloaded yet
2026-03-27 10:32:29 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-27 10:32:29 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM99769%27 HTTP/1.1" 200 None
2026-03-27 10:32:29 [auto1.de] INFO: Scrape type for JM99769: 1
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2c86f11bc26c6f0c7afb12a65b72b3%252Fpa%252FXX31314_55b2d87f71fd5514f625bc63987b10c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2c86f11bc26c6f0c7afb12a65b72b3/pa/XX31314_55b2d87f71fd5514f625bc63987b10c2.jpg not downloaded yet
2026-03-27 10:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC33158/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:32:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2c86f11bc26c6f0c7afb12a65b72b3/pa/XX31314_55b2d87f71fd5514f625bc63987b10c2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be281a10>
2026-03-27 10:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929769ef-7a25-57f3-bcc9-86c4e988916c/929769ef-7a25-57f3-bcc9-86c4e988916c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2c86f11bc26c6f0c7afb12a65b72b3%252Fpa%252FXX31314_55b2d87f71fd5514f625bc63987b10c2.jpg') HTTP/1.1" 204 0
2026-03-27 10:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2c86f11bc26c6f0c7afb12a65b72b3/pa/XX31314_55b2d87f71fd5514f625bc63987b10c2.jpg saved to cache
2026-03-27 10:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 929769ef-7a25-57f3-bcc9-86c4e988916c
2026-03-27 10:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NH03698/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:32:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KS26285/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:32:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:07 [scrapy.extensions.logstats] INFO: Crawled 53 pages (at 16 pages/min), scraped 29 items (at 9 items/min)
2026-03-27 10:33:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-27 10:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MV69505/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HF06660/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF68869/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF69059> (referer: https://www.auto1.com/v1/car-details-view/DF69059/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 674728a0-6417-5cf5-9af8-cfd213d65b26 with identifier: DF69059
2026-03-27 10:33:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 674728a0-6417-5cf5-9af8-cfd213d65b26 with scrape type 1
2026-03-27 10:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 674728a0-6417-5cf5-9af8-cfd213d65b26
2026-03-27 10:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_833ad1ae5b8e0fcbde6244edd13d5179.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_833ad1ae5b8e0fcbde6244edd13d5179.jpg not downloaded yet
2026-03-27 10:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_0a9958c285e7e33f6fb7a005f76e602b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_0a9958c285e7e33f6fb7a005f76e602b.jpg not downloaded yet
2026-03-27 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_3d3481f7c3b64896f4fabfcf046c6d5f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_3d3481f7c3b64896f4fabfcf046c6d5f.jpg not downloaded yet
2026-03-27 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_b1fcd3c47475988dee22af016ef96d53.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_b1fcd3c47475988dee22af016ef96d53.jpg not downloaded yet
2026-03-27 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_21d23d34df4e530b5321b5f54586d9fb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_21d23d34df4e530b5321b5f54586d9fb.jpg not downloaded yet
2026-03-27 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_4652693c95b3b2a31bec722fc468f092.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_4652693c95b3b2a31bec722fc468f092.jpg not downloaded yet
2026-03-27 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_2bf7b6b27ac7630e7dc7e0b2ec79b6b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_2bf7b6b27ac7630e7dc7e0b2ec79b6b9.jpg not downloaded yet
2026-03-27 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_061af295276b2795f29a509191974696.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_061af295276b2795f29a509191974696.jpg not downloaded yet
2026-03-27 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_910c5ede71459806afecc9942f38525a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_910c5ede71459806afecc9942f38525a.jpg not downloaded yet
2026-03-27 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_f1f27dce81513a7a5dada5bf78835ca0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_f1f27dce81513a7a5dada5bf78835ca0.jpg not downloaded yet
2026-03-27 10:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD23716/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_f1f27dce81513a7a5dada5bf78835ca0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1fb910>
2026-03-27 10:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_f1f27dce81513a7a5dada5bf78835ca0.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_f1f27dce81513a7a5dada5bf78835ca0.jpg saved to cache
2026-03-27 10:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 674728a0-6417-5cf5-9af8-cfd213d65b26
2026-03-27 10:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY54008> (referer: https://www.auto1.com/v1/car-details-view/WY54008/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eefa11ee-9875-5b77-958f-dd4205007831 with identifier: WY54008
2026-03-27 10:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eefa11ee-9875-5b77-958f-dd4205007831 with scrape type 1
2026-03-27 10:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eefa11ee-9875-5b77-958f-dd4205007831
2026-03-27 10:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_ddd9c83e3ade49f1fd96901c57303bcb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_ddd9c83e3ade49f1fd96901c57303bcb.jpg not downloaded yet
2026-03-27 10:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_b654b50e082038365f34e53f929cbb9d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_b654b50e082038365f34e53f929cbb9d.jpg not downloaded yet
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_210e94240a662d9d42edcbd0ff4aa1aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_210e94240a662d9d42edcbd0ff4aa1aa.jpg not downloaded yet
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_139b34651c09842033b954e7302228b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_139b34651c09842033b954e7302228b2.jpg not downloaded yet
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_dbd68bf02b7131bd59f3b222c2d321c9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_dbd68bf02b7131bd59f3b222c2d321c9.jpg not downloaded yet
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_8cb4b67092ae11a377b89e947380eb0c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_8cb4b67092ae11a377b89e947380eb0c.jpg not downloaded yet
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_39c7e10fa28f33c69bad4b1705d6ec33.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_39c7e10fa28f33c69bad4b1705d6ec33.jpg not downloaded yet
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_98c504fac5379d544b89129195060551.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_98c504fac5379d544b89129195060551.jpg not downloaded yet
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_2d62b761812910d7191c10119dde083b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_2d62b761812910d7191c10119dde083b.jpg not downloaded yet
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_216a73e8b62e137c6f0007c0413a025d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_216a73e8b62e137c6f0007c0413a025d.jpg not downloaded yet
2026-03-27 10:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_910c5ede71459806afecc9942f38525a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5513a10>
2026-03-27 10:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_910c5ede71459806afecc9942f38525a.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_910c5ede71459806afecc9942f38525a.jpg saved to cache
2026-03-27 10:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 674728a0-6417-5cf5-9af8-cfd213d65b26
2026-03-27 10:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_216a73e8b62e137c6f0007c0413a025d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf39d510>
2026-03-27 10:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_216a73e8b62e137c6f0007c0413a025d.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_216a73e8b62e137c6f0007c0413a025d.jpg saved to cache
2026-03-27 10:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eefa11ee-9875-5b77-958f-dd4205007831
2026-03-27 10:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_2d62b761812910d7191c10119dde083b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be223e50>
2026-03-27 10:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_2d62b761812910d7191c10119dde083b.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_2d62b761812910d7191c10119dde083b.jpg saved to cache
2026-03-27 10:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eefa11ee-9875-5b77-958f-dd4205007831
2026-03-27 10:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_98c504fac5379d544b89129195060551.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b9390>
2026-03-27 10:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_98c504fac5379d544b89129195060551.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_98c504fac5379d544b89129195060551.jpg saved to cache
2026-03-27 10:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eefa11ee-9875-5b77-958f-dd4205007831
2026-03-27 10:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_39c7e10fa28f33c69bad4b1705d6ec33.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be281910>
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_39c7e10fa28f33c69bad4b1705d6ec33.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_39c7e10fa28f33c69bad4b1705d6ec33.jpg saved to cache
2026-03-27 10:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eefa11ee-9875-5b77-958f-dd4205007831
2026-03-27 10:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_8cb4b67092ae11a377b89e947380eb0c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5708d0>
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_8cb4b67092ae11a377b89e947380eb0c.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_8cb4b67092ae11a377b89e947380eb0c.jpg saved to cache
2026-03-27 10:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eefa11ee-9875-5b77-958f-dd4205007831
2026-03-27 10:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_dbd68bf02b7131bd59f3b222c2d321c9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4e5850>
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_dbd68bf02b7131bd59f3b222c2d321c9.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_dbd68bf02b7131bd59f3b222c2d321c9.jpg saved to cache
2026-03-27 10:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eefa11ee-9875-5b77-958f-dd4205007831
2026-03-27 10:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_139b34651c09842033b954e7302228b2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_210e94240a662d9d42edcbd0ff4aa1aa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf31b5d0>
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_139b34651c09842033b954e7302228b2.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_139b34651c09842033b954e7302228b2.jpg saved to cache
2026-03-27 10:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eefa11ee-9875-5b77-958f-dd4205007831
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2bb990>
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_210e94240a662d9d42edcbd0ff4aa1aa.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_210e94240a662d9d42edcbd0ff4aa1aa.jpg saved to cache
2026-03-27 10:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eefa11ee-9875-5b77-958f-dd4205007831
2026-03-27 10:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM99769/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_b654b50e082038365f34e53f929cbb9d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f1f10>
2026-03-27 10:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_b654b50e082038365f34e53f929cbb9d.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_b654b50e082038365f34e53f929cbb9d.jpg saved to cache
2026-03-27 10:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eefa11ee-9875-5b77-958f-dd4205007831
2026-03-27 10:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_061af295276b2795f29a509191974696.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_ddd9c83e3ade49f1fd96901c57303bcb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_2bf7b6b27ac7630e7dc7e0b2ec79b6b9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2bac10>
2026-03-27 10:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_061af295276b2795f29a509191974696.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_061af295276b2795f29a509191974696.jpg saved to cache
2026-03-27 10:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 674728a0-6417-5cf5-9af8-cfd213d65b26
2026-03-27 10:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be280c50>
2026-03-27 10:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F91%252F0c91779fb557845ff7677800dd4947b5%252Fpa%252FWY54008_ddd9c83e3ade49f1fd96901c57303bcb.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_ddd9c83e3ade49f1fd96901c57303bcb.jpg saved to cache
2026-03-27 10:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eefa11ee-9875-5b77-958f-dd4205007831
2026-03-27 10:33:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eefa11ee-9875-5b77-958f-dd4205007831, skipping ID generation
2026-03-27 10:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eefa11ee-9875-5b77-958f-dd4205007831 with scrape type 1
2026-03-27 10:33:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eefa11ee-9875-5b77-958f-dd4205007831 sending to next pipeline
2026-03-27 10:33:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eefa11ee-9875-5b77-958f-dd4205007831, identifier: WY54008
2026-03-27 10:33:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf572590>
2026-03-27 10:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_2bf7b6b27ac7630e7dc7e0b2ec79b6b9.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_2bf7b6b27ac7630e7dc7e0b2ec79b6b9.jpg saved to cache
2026-03-27 10:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 674728a0-6417-5cf5-9af8-cfd213d65b26
2026-03-27 10:33:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eefa11ee-9875-5b77-958f-dd4205007831 with identifier: WY54008
2026-03-27 10:33:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eefa11ee-9875-5b77-958f-dd4205007831 with identifier: WY54008
2026-03-27 10:33:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eefa11ee-9875-5b77-958f-dd4205007831 with identifier: WY54008 to the API
2026-03-27 10:33:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_ddd9c83e3ade49f1fd96901c57303bcb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:48:31Z',
'fuel_type': 'petrol',
'id': 'eefa11ee-9875-5b77-958f-dd4205007831',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY54008',
'listing': 'auction',
'location': 'DE, Eisenach',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 137484,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_ddd9c83e3ade49f1fd96901c57303bcb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70503,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_b654b50e082038365f34e53f929cbb9d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70875,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_210e94240a662d9d42edcbd0ff4aa1aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65205,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_139b34651c09842033b954e7302228b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_dbd68bf02b7131bd59f3b222c2d321c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_8cb4b67092ae11a377b89e947380eb0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_39c7e10fa28f33c69bad4b1705d6ec33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_98c504fac5379d544b89129195060551.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66807,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_2d62b761812910d7191c10119dde083b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eefa11ee-9875-5b77-958f-dd4205007831/eefa11ee-9875-5b77-958f-dd4205007831_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83728,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/91/0c91779fb557845ff7677800dd4947b5/pa/WY54008_216a73e8b62e137c6f0007c0413a025d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2016}
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY54008%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [auto1.de] INFO: Saving data for WY54008: {'created_time': 1774607612.336476, 'last_price_update_time': 1774607612.336488, 'auction_closing_time': 1774716511.0}
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY54008') HTTP/1.1" 204 0
2026-03-27 10:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LW83066> (referer: https://www.auto1.com/v1/car-details-view/LW83066/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_4652693c95b3b2a31bec722fc468f092.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC33158> (referer: https://www.auto1.com/v1/car-details-view/SC33158/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d with identifier: LW83066
2026-03-27 10:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d with scrape type 1
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_400805bdee2f09e796786fbe9877eff2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_400805bdee2f09e796786fbe9877eff2.jpg not downloaded yet
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_92aa4d5627dc44d7319c73d6876f6cfe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_92aa4d5627dc44d7319c73d6876f6cfe.jpg not downloaded yet
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_d06df7cbbf38e1156cf6b22d25964c58.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_d06df7cbbf38e1156cf6b22d25964c58.jpg not downloaded yet
2026-03-27 10:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1b0fd0>
2026-03-27 10:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_4652693c95b3b2a31bec722fc468f092.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_4652693c95b3b2a31bec722fc468f092.jpg saved to cache
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 674728a0-6417-5cf5-9af8-cfd213d65b26
2026-03-27 10:33:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 375dca87-70ca-5f77-aa3b-54fdb580b67c with identifier: SC33158
2026-03-27 10:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 375dca87-70ca-5f77-aa3b-54fdb580b67c with scrape type 1
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 375dca87-70ca-5f77-aa3b-54fdb580b67c
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_dc7ce76f73f9c15febcfaa23ed4ead72.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_dc7ce76f73f9c15febcfaa23ed4ead72.jpg not downloaded yet
2026-03-27 10:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_b1fcd3c47475988dee22af016ef96d53.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_69795b52c1deb3a896f9da2b9b962618.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_69795b52c1deb3a896f9da2b9b962618.jpg not downloaded yet
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_63d3728980d14c3e43f8468f5f64de0a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_63d3728980d14c3e43f8468f5f64de0a.jpg not downloaded yet
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_368969ddcb18bbc417b0a25765a4b392.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_368969ddcb18bbc417b0a25765a4b392.jpg not downloaded yet
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_d42e89922876ddb8eb6891ad53c01bb8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_d42e89922876ddb8eb6891ad53c01bb8.jpg not downloaded yet
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_e424c7ee05879fa24a891c7bc58b4316.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_e424c7ee05879fa24a891c7bc58b4316.jpg not downloaded yet
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_689d58d2d2d47a45a20048ceb5d039fb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_689d58d2d2d47a45a20048ceb5d039fb.jpg not downloaded yet
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_0444c7f6f59a2e08a2349bb9fbe5a9b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_0444c7f6f59a2e08a2349bb9fbe5a9b9.jpg not downloaded yet
2026-03-27 10:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_dc7ce76f73f9c15febcfaa23ed4ead72.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_6c91c7fef4c0057d684a951ff49f3b5c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_6c91c7fef4c0057d684a951ff49f3b5c.jpg not downloaded yet
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_b4f07e409a2a4972752b35c6b99c888c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_b4f07e409a2a4972752b35c6b99c888c.jpg not downloaded yet
2026-03-27 10:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2aba10>
2026-03-27 10:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_b1fcd3c47475988dee22af016ef96d53.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_b1fcd3c47475988dee22af016ef96d53.jpg saved to cache
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 674728a0-6417-5cf5-9af8-cfd213d65b26
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_f9b68a597fa4a1a79fc6e57764314a7d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_f9b68a597fa4a1a79fc6e57764314a7d.jpg not downloaded yet
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_14e0f95d3fdfa76d4d4c7568f7ca41c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_14e0f95d3fdfa76d4d4c7568f7ca41c0.jpg not downloaded yet
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_a5ee376a0a9ac88abde9e5bfe6f9e4d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_a5ee376a0a9ac88abde9e5bfe6f9e4d4.jpg not downloaded yet
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_3d243a8f811a122e7c74502a5ea801e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_3d243a8f811a122e7c74502a5ea801e3.jpg not downloaded yet
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_8e573a9dee77ea823ba8b7c5a82d575d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_8e573a9dee77ea823ba8b7c5a82d575d.jpg not downloaded yet
2026-03-27 10:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be12b2d0>
2026-03-27 10:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_dc7ce76f73f9c15febcfaa23ed4ead72.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_dc7ce76f73f9c15febcfaa23ed4ead72.jpg saved to cache
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 375dca87-70ca-5f77-aa3b-54fdb580b67c
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_0f674998043b715499b16aeb29f3643a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_0f674998043b715499b16aeb29f3643a.jpg not downloaded yet
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_7bc29e3add6f59f1e885fb9ad60824b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_7bc29e3add6f59f1e885fb9ad60824b5.jpg not downloaded yet
2026-03-27 10:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_0444c7f6f59a2e08a2349bb9fbe5a9b9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_21d23d34df4e530b5321b5f54586d9fb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_7bc29e3add6f59f1e885fb9ad60824b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_3d3481f7c3b64896f4fabfcf046c6d5f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_0f674998043b715499b16aeb29f3643a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5645890>
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_0444c7f6f59a2e08a2349bb9fbe5a9b9.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_0444c7f6f59a2e08a2349bb9fbe5a9b9.jpg saved to cache
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d
2026-03-27 10:33:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1d0510>
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_21d23d34df4e530b5321b5f54586d9fb.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_21d23d34df4e530b5321b5f54586d9fb.jpg saved to cache
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 674728a0-6417-5cf5-9af8-cfd213d65b26
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be214690>
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_7bc29e3add6f59f1e885fb9ad60824b5.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_7bc29e3add6f59f1e885fb9ad60824b5.jpg saved to cache
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 375dca87-70ca-5f77-aa3b-54fdb580b67c
2026-03-27 10:33:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf568690>
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_3d3481f7c3b64896f4fabfcf046c6d5f.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_3d3481f7c3b64896f4fabfcf046c6d5f.jpg saved to cache
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 674728a0-6417-5cf5-9af8-cfd213d65b26
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5ecd10>
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_0f674998043b715499b16aeb29f3643a.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_0f674998043b715499b16aeb29f3643a.jpg saved to cache
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 375dca87-70ca-5f77-aa3b-54fdb580b67c
2026-03-27 10:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_8e573a9dee77ea823ba8b7c5a82d575d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KS26285> (referer: https://www.auto1.com/v1/car-details-view/KS26285/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NH03698> (referer: https://www.auto1.com/v1/car-details-view/NH03698/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_a5ee376a0a9ac88abde9e5bfe6f9e4d4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3265d0>
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_8e573a9dee77ea823ba8b7c5a82d575d.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_8e573a9dee77ea823ba8b7c5a82d575d.jpg saved to cache
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 375dca87-70ca-5f77-aa3b-54fdb580b67c
2026-03-27 10:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_6c91c7fef4c0057d684a951ff49f3b5c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fe3bd58-ac24-5d19-984d-7a9f503563cb with identifier: KS26285
2026-03-27 10:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fe3bd58-ac24-5d19-984d-7a9f503563cb with scrape type 1
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2fe3bd58-ac24-5d19-984d-7a9f503563cb
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_5966f79250b04ffdad193c4e8f9d24b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_5966f79250b04ffdad193c4e8f9d24b5.jpg not downloaded yet
2026-03-27 10:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f with identifier: NH03698
2026-03-27 10:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f with scrape type 1
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F4d%252F0f4d050dbb86de3e259d37b3796dc2ee%252Fpa%252FNH03698_59299f4b242082467a9cd89451afd2df.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_59299f4b242082467a9cd89451afd2df.jpg not downloaded yet
2026-03-27 10:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_14e0f95d3fdfa76d4d4c7568f7ca41c0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_eb6a2a0d11d8c1957576e078aec027bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_eb6a2a0d11d8c1957576e078aec027bd.jpg not downloaded yet
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F4d%252F0f4d050dbb86de3e259d37b3796dc2ee%252Fpa%252FNH03698_1572203f6662bb4cf4e40a589d7e1f28.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_1572203f6662bb4cf4e40a589d7e1f28.jpg not downloaded yet
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_481fe116208805fb5b2ef57a9995f121.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_481fe116208805fb5b2ef57a9995f121.jpg not downloaded yet
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F4d%252F0f4d050dbb86de3e259d37b3796dc2ee%252Fpa%252FNH03698_db0732f6853b119a8d612d158eb92cd2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_db0732f6853b119a8d612d158eb92cd2.jpg not downloaded yet
2026-03-27 10:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_689d58d2d2d47a45a20048ceb5d039fb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be102510>
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_a5ee376a0a9ac88abde9e5bfe6f9e4d4.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_a5ee376a0a9ac88abde9e5bfe6f9e4d4.jpg saved to cache
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 375dca87-70ca-5f77-aa3b-54fdb580b67c
2026-03-27 10:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_f9b68a597fa4a1a79fc6e57764314a7d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_59299f4b242082467a9cd89451afd2df.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_46de6bc216a35ede602c73b562a1e29f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_46de6bc216a35ede602c73b562a1e29f.jpg not downloaded yet
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F4d%252F0f4d050dbb86de3e259d37b3796dc2ee%252Fpa%252FNH03698_4137a64e92bd585b1e10c8cf7476bc28.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_4137a64e92bd585b1e10c8cf7476bc28.jpg not downloaded yet
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be02fa90>
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_6c91c7fef4c0057d684a951ff49f3b5c.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_6c91c7fef4c0057d684a951ff49f3b5c.jpg saved to cache
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 375dca87-70ca-5f77-aa3b-54fdb580b67c
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_cd4949b62fa9bafe93e3305db26524d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_cd4949b62fa9bafe93e3305db26524d8.jpg not downloaded yet
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F4d%252F0f4d050dbb86de3e259d37b3796dc2ee%252Fpa%252FNH03698_c1ec6c7e47e1fc656990ad0c4257f59f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_c1ec6c7e47e1fc656990ad0c4257f59f.jpg not downloaded yet
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be026d90>
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_14e0f95d3fdfa76d4d4c7568f7ca41c0.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_14e0f95d3fdfa76d4d4c7568f7ca41c0.jpg saved to cache
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be013a10>
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_689d58d2d2d47a45a20048ceb5d039fb.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_689d58d2d2d47a45a20048ceb5d039fb.jpg saved to cache
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 375dca87-70ca-5f77-aa3b-54fdb580b67c
2026-03-27 10:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_1572203f6662bb4cf4e40a589d7e1f28.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_db0732f6853b119a8d612d158eb92cd2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_8714c5b671c24358053cdbcf662df8e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_8714c5b671c24358053cdbcf662df8e8.jpg not downloaded yet
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_617ca686b5483ae4dc09c4bd0297c40e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_617ca686b5483ae4dc09c4bd0297c40e.jpg not downloaded yet
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5530450>
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_f9b68a597fa4a1a79fc6e57764314a7d.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_f9b68a597fa4a1a79fc6e57764314a7d.jpg saved to cache
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 375dca87-70ca-5f77-aa3b-54fdb580b67c
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf48c510>
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f/ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F4d%252F0f4d050dbb86de3e259d37b3796dc2ee%252Fpa%252FNH03698_59299f4b242082467a9cd89451afd2df.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_59299f4b242082467a9cd89451afd2df.jpg saved to cache
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_fb871371a08da434500435ae58746d31.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_fb871371a08da434500435ae58746d31.jpg not downloaded yet
2026-03-27 10:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_c1ec6c7e47e1fc656990ad0c4257f59f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_481fe116208805fb5b2ef57a9995f121.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_5cd78ad2be89ef018d59f5f724b8c5b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_5cd78ad2be89ef018d59f5f724b8c5b3.jpg not downloaded yet
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be12a750>
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f/ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F4d%252F0f4d050dbb86de3e259d37b3796dc2ee%252Fpa%252FNH03698_1572203f6662bb4cf4e40a589d7e1f28.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_1572203f6662bb4cf4e40a589d7e1f28.jpg saved to cache
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1b1610>
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f/ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F4d%252F0f4d050dbb86de3e259d37b3796dc2ee%252Fpa%252FNH03698_db0732f6853b119a8d612d158eb92cd2.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_db0732f6853b119a8d612d158eb92cd2.jpg saved to cache
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f
2026-03-27 10:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_3d243a8f811a122e7c74502a5ea801e3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_1c1c2f85f43400dda50cfc9451ba4512.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_1c1c2f85f43400dda50cfc9451ba4512.jpg not downloaded yet
2026-03-27 10:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_cd4949b62fa9bafe93e3305db26524d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be021450>
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f/ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F4d%252F0f4d050dbb86de3e259d37b3796dc2ee%252Fpa%252FNH03698_c1ec6c7e47e1fc656990ad0c4257f59f.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_c1ec6c7e47e1fc656990ad0c4257f59f.jpg saved to cache
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5354550>
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_481fe116208805fb5b2ef57a9995f121.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_481fe116208805fb5b2ef57a9995f121.jpg saved to cache
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2fe3bd58-ac24-5d19-984d-7a9f503563cb
2026-03-27 10:33:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5354c90>
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_3d243a8f811a122e7c74502a5ea801e3.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_3d243a8f811a122e7c74502a5ea801e3.jpg saved to cache
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf383e50>
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_cd4949b62fa9bafe93e3305db26524d8.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_cd4949b62fa9bafe93e3305db26524d8.jpg saved to cache
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2fe3bd58-ac24-5d19-984d-7a9f503563cb
2026-03-27 10:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_617ca686b5483ae4dc09c4bd0297c40e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_b4f07e409a2a4972752b35c6b99c888c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_fb871371a08da434500435ae58746d31.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_5cd78ad2be89ef018d59f5f724b8c5b3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_4137a64e92bd585b1e10c8cf7476bc28.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_8714c5b671c24358053cdbcf662df8e8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_46de6bc216a35ede602c73b562a1e29f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3828d0>
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_617ca686b5483ae4dc09c4bd0297c40e.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_617ca686b5483ae4dc09c4bd0297c40e.jpg saved to cache
2026-03-27 10:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2fe3bd58-ac24-5d19-984d-7a9f503563cb
2026-03-27 10:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HF06660> (referer: https://www.auto1.com/v1/car-details-view/HF06660/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf46f790>
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_b4f07e409a2a4972752b35c6b99c888c.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_b4f07e409a2a4972752b35c6b99c888c.jpg saved to cache
2026-03-27 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d
2026-03-27 10:33:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c564e790>
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_fb871371a08da434500435ae58746d31.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_fb871371a08da434500435ae58746d31.jpg saved to cache
2026-03-27 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2fe3bd58-ac24-5d19-984d-7a9f503563cb
2026-03-27 10:33:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3d5f10>
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_5cd78ad2be89ef018d59f5f724b8c5b3.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_5cd78ad2be89ef018d59f5f724b8c5b3.jpg saved to cache
2026-03-27 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2fe3bd58-ac24-5d19-984d-7a9f503563cb
2026-03-27 10:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_1c1c2f85f43400dda50cfc9451ba4512.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MV69505> (referer: https://www.auto1.com/v1/car-details-view/MV69505/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be034c90>
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f/ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F4d%252F0f4d050dbb86de3e259d37b3796dc2ee%252Fpa%252FNH03698_4137a64e92bd585b1e10c8cf7476bc28.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_4137a64e92bd585b1e10c8cf7476bc28.jpg saved to cache
2026-03-27 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f
2026-03-27 10:33:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f, skipping ID generation
2026-03-27 10:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f with scrape type 1
2026-03-27 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f sending to next pipeline
2026-03-27 10:33:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f, identifier: NH03698
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1c7c10>
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_8714c5b671c24358053cdbcf662df8e8.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_8714c5b671c24358053cdbcf662df8e8.jpg saved to cache
2026-03-27 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2fe3bd58-ac24-5d19-984d-7a9f503563cb
2026-03-27 10:33:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf59a1d0>
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_46de6bc216a35ede602c73b562a1e29f.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_46de6bc216a35ede602c73b562a1e29f.jpg saved to cache
2026-03-27 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2fe3bd58-ac24-5d19-984d-7a9f503563cb
2026-03-27 10:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57aa10a7-6db1-545d-a03e-a3af09cabb59 with identifier: HF06660
2026-03-27 10:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57aa10a7-6db1-545d-a03e-a3af09cabb59 with scrape type 1
2026-03-27 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 57aa10a7-6db1-545d-a03e-a3af09cabb59
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_8ce0806f621dd1a35f01d4574312b663.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_8ce0806f621dd1a35f01d4574312b663.jpg not downloaded yet
2026-03-27 10:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f with identifier: NH03698
2026-03-27 10:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f with identifier: NH03698
2026-03-27 10:33:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f with identifier: NH03698 to the API
2026-03-27 10:33:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_4137a64e92bd585b1e10c8cf7476bc28.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:42:15Z',
'fuel_type': 'petrol',
'id': 'ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH03698',
'listing': 'auction',
'location': 'DE',
'make': 'Dacia',
'model': 'Jogger',
'odometer': 8713,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f/ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 26416,
'Height': 354,
'OriginUrl': 'https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_59299f4b242082467a9cd89451afd2df.jpg',
'Width': 472},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f/ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31677,
'Height': 351,
'OriginUrl': 'https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_1572203f6662bb4cf4e40a589d7e1f28.jpg',
'Width': 468},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f/ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32985,
'Height': 351,
'OriginUrl': 'https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_db0732f6853b119a8d612d158eb92cd2.jpg',
'Width': 468},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f/ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28768,
'Height': 351,
'OriginUrl': 'https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_4137a64e92bd585b1e10c8cf7476bc28.jpg',
'Width': 468},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f/ea4fbcc6-26ab-5803-a1e1-65a0c0d5e16f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 18924,
'Height': 354,
'OriginUrl': 'https://img-pa.auto1.com/img0f/4d/0f4d050dbb86de3e259d37b3796dc2ee/pa/NH03698_c1ec6c7e47e1fc656990ad0c4257f59f.jpg',
'Width': 472}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2025-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Jogger 1.0 TCe Extreme',
'transmission': 'manual',
'trim': 'Extreme',
'year': 2025}
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH03698%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [auto1.de] INFO: Saving data for NH03698: {'created_time': 1774607616.161976, 'last_price_update_time': 1774607616.161988, 'auction_closing_time': 1774716135.0}
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH03698') HTTP/1.1" 204 0
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_78aab353b2717f997371e47263ac62e4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_78aab353b2717f997371e47263ac62e4.jpg not downloaded yet
2026-03-27 10:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_d42e89922876ddb8eb6891ad53c01bb8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_e424c7ee05879fa24a891c7bc58b4316.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_368969ddcb18bbc417b0a25765a4b392.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be257e90>
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_1c1c2f85f43400dda50cfc9451ba4512.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_1c1c2f85f43400dda50cfc9451ba4512.jpg saved to cache
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2fe3bd58-ac24-5d19-984d-7a9f503563cb
2026-03-27 10:33:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7264d6f-1a5e-58d9-a331-975c677af46b with identifier: MV69505
2026-03-27 10:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7264d6f-1a5e-58d9-a331-975c677af46b with scrape type 1
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7264d6f-1a5e-58d9-a331-975c677af46b
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_37e8849b939eee7e38f41ecfa8adf810.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_37e8849b939eee7e38f41ecfa8adf810.jpg not downloaded yet
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_a1ba69585317e548aa4712878756fa13.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_a1ba69585317e548aa4712878756fa13.jpg not downloaded yet
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_4c555fee5051443a56fe717be6757d52.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_4c555fee5051443a56fe717be6757d52.jpg not downloaded yet
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_8fd49a116c4a44a136ba9310855880ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_8fd49a116c4a44a136ba9310855880ae.jpg not downloaded yet
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_d1f7c588e167168dc7d2aa15eac53f2e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_d1f7c588e167168dc7d2aa15eac53f2e.jpg not downloaded yet
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_024336fa802ac6cf534eec46c124076d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_024336fa802ac6cf534eec46c124076d.jpg not downloaded yet
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_70e08c16407a1d01a36d8d2fe75d394a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_70e08c16407a1d01a36d8d2fe75d394a.jpg not downloaded yet
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf302ed0>
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_d42e89922876ddb8eb6891ad53c01bb8.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_d42e89922876ddb8eb6891ad53c01bb8.jpg saved to cache
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 375dca87-70ca-5f77-aa3b-54fdb580b67c
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be112bd0>
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_e424c7ee05879fa24a891c7bc58b4316.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_e424c7ee05879fa24a891c7bc58b4316.jpg saved to cache
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2f81d0>
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_368969ddcb18bbc417b0a25765a4b392.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_368969ddcb18bbc417b0a25765a4b392.jpg saved to cache
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_aa205a16f31147758f98a2bb23570a7e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_aa205a16f31147758f98a2bb23570a7e.jpg not downloaded yet
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_fe16695b8c727599118331972b46f7f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_fe16695b8c727599118331972b46f7f8.jpg not downloaded yet
2026-03-27 10:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_d06df7cbbf38e1156cf6b22d25964c58.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_92aa4d5627dc44d7319c73d6876f6cfe.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_0a2007952e6f162a53f05abc924f041e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_0a2007952e6f162a53f05abc924f041e.jpg not downloaded yet
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_2da210c2b8df6157eac52d11da558d84.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_2da210c2b8df6157eac52d11da558d84.jpg not downloaded yet
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_14b205809fc75d38c194915a4982df2b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_14b205809fc75d38c194915a4982df2b.jpg not downloaded yet
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_1f638fe53d74d3156104ec0fbefbba09.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_1f638fe53d74d3156104ec0fbefbba09.jpg not downloaded yet
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_9f2d95201ea1ac155999237c77ebefde.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_9f2d95201ea1ac155999237c77ebefde.jpg not downloaded yet
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_41755dd391873d970a2691ff2d9e307f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_41755dd391873d970a2691ff2d9e307f.jpg not downloaded yet
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_a81e9815de4083399c9d0cb05f7e86d3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_a81e9815de4083399c9d0cb05f7e86d3.jpg not downloaded yet
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_0a77913e00e2982e6405d096c0337a8b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_0a77913e00e2982e6405d096c0337a8b.jpg not downloaded yet
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_c9ba8bf728faf593fe67a126fd3a00a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_c9ba8bf728faf593fe67a126fd3a00a5.jpg not downloaded yet
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5b77b90>
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_d06df7cbbf38e1156cf6b22d25964c58.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_d06df7cbbf38e1156cf6b22d25964c58.jpg saved to cache
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1b2490>
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_92aa4d5627dc44d7319c73d6876f6cfe.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_92aa4d5627dc44d7319c73d6876f6cfe.jpg saved to cache
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d
2026-03-27 10:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_63d3728980d14c3e43f8468f5f64de0a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_aa205a16f31147758f98a2bb23570a7e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_70e08c16407a1d01a36d8d2fe75d394a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_eb6a2a0d11d8c1957576e078aec027bd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_5966f79250b04ffdad193c4e8f9d24b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_8ce0806f621dd1a35f01d4574312b663.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_69795b52c1deb3a896f9da2b9b962618.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_41755dd391873d970a2691ff2d9e307f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf37cf50>
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ffa%252F98fa58a32627daa707937be7c1a47b2c%252Fpa%252FSC33158_63d3728980d14c3e43f8468f5f64de0a.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_63d3728980d14c3e43f8468f5f64de0a.jpg saved to cache
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 375dca87-70ca-5f77-aa3b-54fdb580b67c
2026-03-27 10:33:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 375dca87-70ca-5f77-aa3b-54fdb580b67c, skipping ID generation
2026-03-27 10:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 375dca87-70ca-5f77-aa3b-54fdb580b67c with scrape type 1
2026-03-27 10:33:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 375dca87-70ca-5f77-aa3b-54fdb580b67c sending to next pipeline
2026-03-27 10:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 375dca87-70ca-5f77-aa3b-54fdb580b67c, identifier: SC33158
2026-03-27 10:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 375dca87-70ca-5f77-aa3b-54fdb580b67c with identifier: SC33158
2026-03-27 10:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 375dca87-70ca-5f77-aa3b-54fdb580b67c with identifier: SC33158
2026-03-27 10:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 375dca87-70ca-5f77-aa3b-54fdb580b67c with identifier: SC33158 to the API
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_63d3728980d14c3e43f8468f5f64de0a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 269,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 3',
'engine': '3.6L',
'engine_horse_power': 320,
'expiration_date': '2026-03-28T16:32:59Z',
'fuel_type': 'petrol',
'id': '375dca87-70ca-5f77-aa3b-54fdb580b67c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC33158',
'listing': 'auction',
'location': 'DE, Weiden',
'make': 'Porsche',
'model': '911',
'odometer': 65980,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75815,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_dc7ce76f73f9c15febcfaa23ed4ead72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70706,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_63d3728980d14c3e43f8468f5f64de0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_d42e89922876ddb8eb6891ad53c01bb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_689d58d2d2d47a45a20048ceb5d039fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67984,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_6c91c7fef4c0057d684a951ff49f3b5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_f9b68a597fa4a1a79fc6e57764314a7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69322,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_a5ee376a0a9ac88abde9e5bfe6f9e4d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_8e573a9dee77ea823ba8b7c5a82d575d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62444,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_0f674998043b715499b16aeb29f3643a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375dca87-70ca-5f77-aa3b-54fdb580b67c/375dca87-70ca-5f77-aa3b-54fdb580b67c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/fa/98fa58a32627daa707937be7c1a47b2c/pa/SC33158_7bc29e3add6f59f1e885fb9ad60824b5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2004-01-12',
'seats_number': 4,
'seller_name': None,
'title': 'Porsche 911 996 Carrera',
'transmission': 'manual',
'trim': 'Carrera',
'year': 2004}
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC33158%27 HTTP/1.1" 200 None
2026-03-27 10:33:37 [auto1.de] INFO: Saving data for SC33158: {'created_time': 1774607617.498983, 'last_price_update_time': 1774607617.498994, 'auction_closing_time': 1774715579.0}
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC33158') HTTP/1.1" 204 0
2026-03-27 10:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_c9ba8bf728faf593fe67a126fd3a00a5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_a81e9815de4083399c9d0cb05f7e86d3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_0a77913e00e2982e6405d096c0337a8b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF68869> (referer: https://www.auto1.com/v1/car-details-view/LF68869/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WE78461> (referer: https://www.auto1.com/v1/car-details-view/WE78461/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD23716> (referer: https://www.auto1.com/v1/car-details-view/ZD23716/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b5950>
2026-03-27 10:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_aa205a16f31147758f98a2bb23570a7e.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_aa205a16f31147758f98a2bb23570a7e.jpg saved to cache
2026-03-27 10:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 57aa10a7-6db1-545d-a03e-a3af09cabb59
2026-03-27 10:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2f2bd0>
2026-03-27 10:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_70e08c16407a1d01a36d8d2fe75d394a.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_70e08c16407a1d01a36d8d2fe75d394a.jpg saved to cache
2026-03-27 10:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f7264d6f-1a5e-58d9-a331-975c677af46b
2026-03-27 10:33:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be20bc10>
2026-03-27 10:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_eb6a2a0d11d8c1957576e078aec027bd.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_eb6a2a0d11d8c1957576e078aec027bd.jpg saved to cache
2026-03-27 10:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2fe3bd58-ac24-5d19-984d-7a9f503563cb
2026-03-27 10:33:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3eda90>
2026-03-27 10:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fce%252F66ce7d0a4a7594d684d36aede4ffa48c%252Fpa%252FKS26285_5966f79250b04ffdad193c4e8f9d24b5.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_5966f79250b04ffdad193c4e8f9d24b5.jpg saved to cache
2026-03-27 10:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2fe3bd58-ac24-5d19-984d-7a9f503563cb
2026-03-27 10:33:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2fe3bd58-ac24-5d19-984d-7a9f503563cb, skipping ID generation
2026-03-27 10:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fe3bd58-ac24-5d19-984d-7a9f503563cb with scrape type 1
2026-03-27 10:33:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2fe3bd58-ac24-5d19-984d-7a9f503563cb sending to next pipeline
2026-03-27 10:33:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2fe3bd58-ac24-5d19-984d-7a9f503563cb, identifier: KS26285
2026-03-27 10:33:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be013990>
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_8ce0806f621dd1a35f01d4574312b663.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_8ce0806f621dd1a35f01d4574312b663.jpg saved to cache
2026-03-27 10:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57aa10a7-6db1-545d-a03e-a3af09cabb59
2026-03-27 10:33:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf405350>
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_69795b52c1deb3a896f9da2b9b962618.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_69795b52c1deb3a896f9da2b9b962618.jpg saved to cache
2026-03-27 10:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b4090>
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_41755dd391873d970a2691ff2d9e307f.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_41755dd391873d970a2691ff2d9e307f.jpg saved to cache
2026-03-27 10:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f7264d6f-1a5e-58d9-a331-975c677af46b
2026-03-27 10:33:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2fe3bd58-ac24-5d19-984d-7a9f503563cb with identifier: KS26285
2026-03-27 10:33:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2fe3bd58-ac24-5d19-984d-7a9f503563cb with identifier: KS26285
2026-03-27 10:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2fe3bd58-ac24-5d19-984d-7a9f503563cb with identifier: KS26285 to the API
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_5966f79250b04ffdad193c4e8f9d24b5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:51:13Z',
'fuel_type': 'diesel',
'id': '2fe3bd58-ac24-5d19-984d-7a9f503563cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS26285',
'listing': 'auction',
'location': 'DE, Dornach',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 140947,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2213557,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_5966f79250b04ffdad193c4e8f9d24b5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2156395,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_eb6a2a0d11d8c1957576e078aec027bd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66370,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_481fe116208805fb5b2ef57a9995f121.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1960724,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_46de6bc216a35ede602c73b562a1e29f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_cd4949b62fa9bafe93e3305db26524d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_8714c5b671c24358053cdbcf662df8e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61992,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_617ca686b5483ae4dc09c4bd0297c40e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2045674,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_fb871371a08da434500435ae58746d31.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2134226,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_5cd78ad2be89ef018d59f5f724b8c5b3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fe3bd58-ac24-5d19-984d-7a9f503563cb/2fe3bd58-ac24-5d19-984d-7a9f503563cb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/ce/66ce7d0a4a7594d684d36aede4ffa48c/pa/KS26285_1c1c2f85f43400dda50cfc9451ba4512.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-10-17',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Passat 1.6 TDI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2011}
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS26285%27 HTTP/1.1" 200 None
2026-03-27 10:33:38 [auto1.de] INFO: Saving data for KS26285: {'created_time': 1774607618.889081, 'last_price_update_time': 1774607618.889092, 'auction_closing_time': 1774716673.0}
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS26285') HTTP/1.1" 204 0
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c564d210>
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_c9ba8bf728faf593fe67a126fd3a00a5.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_c9ba8bf728faf593fe67a126fd3a00a5.jpg saved to cache
2026-03-27 10:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f7264d6f-1a5e-58d9-a331-975c677af46b
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf477c50>
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_a81e9815de4083399c9d0cb05f7e86d3.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_a81e9815de4083399c9d0cb05f7e86d3.jpg saved to cache
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 57aa10a7-6db1-545d-a03e-a3af09cabb59
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be29ea90>
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_0a77913e00e2982e6405d096c0337a8b.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_0a77913e00e2982e6405d096c0337a8b.jpg saved to cache
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f7264d6f-1a5e-58d9-a331-975c677af46b
2026-03-27 10:33:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6 with identifier: LF68869
2026-03-27 10:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6 with scrape type 1
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F23%252Fb2237aa9116e78c02115c5f002f3bbb2%252Fpa%252FLF68869_fcbea428937ba293e54f49c9d18ec763.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_fcbea428937ba293e54f49c9d18ec763.jpg not downloaded yet
2026-03-27 10:33:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2649402-d15a-58da-8f45-22e6df2d71eb with identifier: WE78461
2026-03-27 10:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2649402-d15a-58da-8f45-22e6df2d71eb with scrape type 1
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2649402-d15a-58da-8f45-22e6df2d71eb
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_1f1473f0aa241db421db19ac4b89c990.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_1f1473f0aa241db421db19ac4b89c990.jpg not downloaded yet
2026-03-27 10:33:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 263f08e8-a9d3-54e0-a966-ccd267923967 with identifier: ZD23716
2026-03-27 10:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 263f08e8-a9d3-54e0-a966-ccd267923967 with scrape type 1
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 263f08e8-a9d3-54e0-a966-ccd267923967
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_41ce2b67f786e70817c9dcffb7fc1121.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_41ce2b67f786e70817c9dcffb7fc1121.jpg not downloaded yet
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F23%252Fb2237aa9116e78c02115c5f002f3bbb2%252Fpa%252FLF68869_b42592e5d54bf01373a5b4b33eb4a078.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_b42592e5d54bf01373a5b4b33eb4a078.jpg not downloaded yet
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_7f44b35e51360cdb12f03339225109b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_7f44b35e51360cdb12f03339225109b8.jpg not downloaded yet
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_fd4b27b09205c05f0ead7d779db9fa06.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_fd4b27b09205c05f0ead7d779db9fa06.jpg not downloaded yet
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F23%252Fb2237aa9116e78c02115c5f002f3bbb2%252Fpa%252FLF68869_b75548432cf523fcdad66b21f5d8b142.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_b75548432cf523fcdad66b21f5d8b142.jpg not downloaded yet
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_0334cc673b45f038f4fd528df0dab9c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_0334cc673b45f038f4fd528df0dab9c2.jpg not downloaded yet
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_edc6cd9d916fbf77bfa6262a057e2ae0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_edc6cd9d916fbf77bfa6262a057e2ae0.jpg not downloaded yet
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F23%252Fb2237aa9116e78c02115c5f002f3bbb2%252Fpa%252FLF68869_2b6cc740360d59e430ba13e1a5c8021e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_2b6cc740360d59e430ba13e1a5c8021e.jpg not downloaded yet
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_1eddc495f1a338a58379ad6aa4a022ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_1eddc495f1a338a58379ad6aa4a022ed.jpg not downloaded yet
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_4c2e847e6acebf2f694d7f65b4bb9329.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_4c2e847e6acebf2f694d7f65b4bb9329.jpg not downloaded yet
2026-03-27 10:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_1f638fe53d74d3156104ec0fbefbba09.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_2da210c2b8df6157eac52d11da558d84.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_0a2007952e6f162a53f05abc924f041e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F23%252Fb2237aa9116e78c02115c5f002f3bbb2%252Fpa%252FLF68869_06c767fb71431bee7b78f41ad4630534.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_06c767fb71431bee7b78f41ad4630534.jpg not downloaded yet
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_e0526686e9d38b18e53a20364364b9c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_e0526686e9d38b18e53a20364364b9c0.jpg not downloaded yet
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_978274ac56f1db08cede8935a2b39d2d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_978274ac56f1db08cede8935a2b39d2d.jpg not downloaded yet
2026-03-27 10:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_fe16695b8c727599118331972b46f7f8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_215e3272770929785d8b30971571823a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_215e3272770929785d8b30971571823a.jpg not downloaded yet
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_810f3d80bc51fd35cb6b58af2629eb84.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_810f3d80bc51fd35cb6b58af2629eb84.jpg not downloaded yet
2026-03-27 10:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_024336fa802ac6cf534eec46c124076d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_4c555fee5051443a56fe717be6757d52.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_8323e3fada12896229d6c8bbcac32592.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_8323e3fada12896229d6c8bbcac32592.jpg not downloaded yet
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_c849a46ca108e7ca5716bfcd4c6906dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_c849a46ca108e7ca5716bfcd4c6906dd.jpg not downloaded yet
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf43e490>
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_1f638fe53d74d3156104ec0fbefbba09.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_1f638fe53d74d3156104ec0fbefbba09.jpg saved to cache
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f7264d6f-1a5e-58d9-a331-975c677af46b
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1d6750>
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_2da210c2b8df6157eac52d11da558d84.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_2da210c2b8df6157eac52d11da558d84.jpg saved to cache
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f7264d6f-1a5e-58d9-a331-975c677af46b
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_0b99d21cbbf5b7880db5e7c0de0edc5c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_0b99d21cbbf5b7880db5e7c0de0edc5c.jpg not downloaded yet
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_c19e2fc82868f777021a882c2d687439.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_c19e2fc82868f777021a882c2d687439.jpg not downloaded yet
2026-03-27 10:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_4c2e847e6acebf2f694d7f65b4bb9329.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_d1f7c588e167168dc7d2aa15eac53f2e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be20a4d0>
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_0a2007952e6f162a53f05abc924f041e.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_0a2007952e6f162a53f05abc924f041e.jpg saved to cache
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 57aa10a7-6db1-545d-a03e-a3af09cabb59
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4e6b10>
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_fe16695b8c727599118331972b46f7f8.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_fe16695b8c727599118331972b46f7f8.jpg saved to cache
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f7264d6f-1a5e-58d9-a331-975c677af46b
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2216d0>
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_024336fa802ac6cf534eec46c124076d.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_024336fa802ac6cf534eec46c124076d.jpg saved to cache
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 57aa10a7-6db1-545d-a03e-a3af09cabb59
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1bd210>
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_4c555fee5051443a56fe717be6757d52.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_4c555fee5051443a56fe717be6757d52.jpg saved to cache
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f7264d6f-1a5e-58d9-a331-975c677af46b
2026-03-27 10:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_edc6cd9d916fbf77bfa6262a057e2ae0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_0334cc673b45f038f4fd528df0dab9c2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_07d5e1a9cdb028f540ca7d0709ca2117.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_07d5e1a9cdb028f540ca7d0709ca2117.jpg not downloaded yet
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_a9248f961ae2f771e174ab59b21d4b8d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_a9248f961ae2f771e174ab59b21d4b8d.jpg not downloaded yet
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_4d49b90ebcf88f4e806fd3719bcf4d71.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_4d49b90ebcf88f4e806fd3719bcf4d71.jpg not downloaded yet
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_b90d82d5832237e4bec46471ac077028.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_b90d82d5832237e4bec46471ac077028.jpg not downloaded yet
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be275a90>
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_4c2e847e6acebf2f694d7f65b4bb9329.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_4c2e847e6acebf2f694d7f65b4bb9329.jpg saved to cache
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 263f08e8-a9d3-54e0-a966-ccd267923967
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf469c50>
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_d1f7c588e167168dc7d2aa15eac53f2e.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_d1f7c588e167168dc7d2aa15eac53f2e.jpg saved to cache
2026-03-27 10:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f7264d6f-1a5e-58d9-a331-975c677af46b
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f2650>
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_edc6cd9d916fbf77bfa6262a057e2ae0.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_edc6cd9d916fbf77bfa6262a057e2ae0.jpg saved to cache
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 263f08e8-a9d3-54e0-a966-ccd267923967
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf39d8d0>
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_0334cc673b45f038f4fd528df0dab9c2.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_0334cc673b45f038f4fd528df0dab9c2.jpg saved to cache
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2649402-d15a-58da-8f45-22e6df2d71eb
2026-03-27 10:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_978274ac56f1db08cede8935a2b39d2d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_8323e3fada12896229d6c8bbcac32592.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_c849a46ca108e7ca5716bfcd4c6906dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_9f2d95201ea1ac155999237c77ebefde.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_14b205809fc75d38c194915a4982df2b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_8fd49a116c4a44a136ba9310855880ae.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_1eddc495f1a338a58379ad6aa4a022ed.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM99769> (referer: https://www.auto1.com/v1/car-details-view/JM99769/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2fa490>
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_978274ac56f1db08cede8935a2b39d2d.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_978274ac56f1db08cede8935a2b39d2d.jpg saved to cache
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 263f08e8-a9d3-54e0-a966-ccd267923967
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f2910>
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_8323e3fada12896229d6c8bbcac32592.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_8323e3fada12896229d6c8bbcac32592.jpg saved to cache
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2649402-d15a-58da-8f45-22e6df2d71eb
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1ef890>
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_c849a46ca108e7ca5716bfcd4c6906dd.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_c849a46ca108e7ca5716bfcd4c6906dd.jpg saved to cache
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 263f08e8-a9d3-54e0-a966-ccd267923967
2026-03-27 10:33:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1382d0>
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_9f2d95201ea1ac155999237c77ebefde.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_9f2d95201ea1ac155999237c77ebefde.jpg saved to cache
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 57aa10a7-6db1-545d-a03e-a3af09cabb59
2026-03-27 10:33:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be174210>
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_14b205809fc75d38c194915a4982df2b.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_14b205809fc75d38c194915a4982df2b.jpg saved to cache
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 57aa10a7-6db1-545d-a03e-a3af09cabb59
2026-03-27 10:33:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e7b10>
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_8fd49a116c4a44a136ba9310855880ae.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_8fd49a116c4a44a136ba9310855880ae.jpg saved to cache
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57aa10a7-6db1-545d-a03e-a3af09cabb59
2026-03-27 10:33:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2ef690>
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_1eddc495f1a338a58379ad6aa4a022ed.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_1eddc495f1a338a58379ad6aa4a022ed.jpg saved to cache
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2649402-d15a-58da-8f45-22e6df2d71eb
2026-03-27 10:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_e0526686e9d38b18e53a20364364b9c0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_c19e2fc82868f777021a882c2d687439.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_b90d82d5832237e4bec46471ac077028.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_0b99d21cbbf5b7880db5e7c0de0edc5c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f02acfc2-5aee-56b6-b9c8-5a8782c753c8 with identifier: JM99769
2026-03-27 10:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f02acfc2-5aee-56b6-b9c8-5a8782c753c8 with scrape type 1
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f02acfc2-5aee-56b6-b9c8-5a8782c753c8
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fc8%252F70c83b3b6a4bd167b95e02937051a06d%252Fpa%252FJM99769_ad21a4499f5c87497e018c2bf0d20d65.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_ad21a4499f5c87497e018c2bf0d20d65.jpg not downloaded yet
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fc8%252F70c83b3b6a4bd167b95e02937051a06d%252Fpa%252FJM99769_e63ecc87998266f485afef79e9b39eed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_e63ecc87998266f485afef79e9b39eed.jpg not downloaded yet
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fc8%252F70c83b3b6a4bd167b95e02937051a06d%252Fpa%252FJM99769_088adb79d925ecd628ae88f8e86980a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_088adb79d925ecd628ae88f8e86980a4.jpg not downloaded yet
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fc8%252F70c83b3b6a4bd167b95e02937051a06d%252Fpa%252FJM99769_cf96bd06fbae48f8a5e142cb5f87bb6f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_cf96bd06fbae48f8a5e142cb5f87bb6f.jpg not downloaded yet
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fc8%252F70c83b3b6a4bd167b95e02937051a06d%252Fpa%252FJM99769_8ae089f20c3205bd33a4515755eba985.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_8ae089f20c3205bd33a4515755eba985.jpg not downloaded yet
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fc8%252F70c83b3b6a4bd167b95e02937051a06d%252Fpa%252FJM99769_afde00dca964038434d131fd72417d59.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_afde00dca964038434d131fd72417d59.jpg not downloaded yet
2026-03-27 10:33:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf545290>
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_e0526686e9d38b18e53a20364364b9c0.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_e0526686e9d38b18e53a20364364b9c0.jpg saved to cache
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2649402-d15a-58da-8f45-22e6df2d71eb
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1c9b90>
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_c19e2fc82868f777021a882c2d687439.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_c19e2fc82868f777021a882c2d687439.jpg saved to cache
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 263f08e8-a9d3-54e0-a966-ccd267923967
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1f1990>
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_b90d82d5832237e4bec46471ac077028.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_b90d82d5832237e4bec46471ac077028.jpg saved to cache
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 263f08e8-a9d3-54e0-a966-ccd267923967
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be103dd0>
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_0b99d21cbbf5b7880db5e7c0de0edc5c.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_0b99d21cbbf5b7880db5e7c0de0edc5c.jpg saved to cache
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2649402-d15a-58da-8f45-22e6df2d71eb
2026-03-27 10:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_b75548432cf523fcdad66b21f5d8b142.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_2b6cc740360d59e430ba13e1a5c8021e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_06c767fb71431bee7b78f41ad4630534.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_07d5e1a9cdb028f540ca7d0709ca2117.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_a9248f961ae2f771e174ab59b21d4b8d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_4d49b90ebcf88f4e806fd3719bcf4d71.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_215e3272770929785d8b30971571823a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_810f3d80bc51fd35cb6b58af2629eb84.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_088adb79d925ecd628ae88f8e86980a4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_afde00dca964038434d131fd72417d59.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1bddd0>
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6/0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F23%252Fb2237aa9116e78c02115c5f002f3bbb2%252Fpa%252FLF68869_b75548432cf523fcdad66b21f5d8b142.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_b75548432cf523fcdad66b21f5d8b142.jpg saved to cache
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5ed910>
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6/0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F23%252Fb2237aa9116e78c02115c5f002f3bbb2%252Fpa%252FLF68869_2b6cc740360d59e430ba13e1a5c8021e.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_2b6cc740360d59e430ba13e1a5c8021e.jpg saved to cache
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6
2026-03-27 10:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_fd4b27b09205c05f0ead7d779db9fa06.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_7f44b35e51360cdb12f03339225109b8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5599d0>
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6/0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F23%252Fb2237aa9116e78c02115c5f002f3bbb2%252Fpa%252FLF68869_06c767fb71431bee7b78f41ad4630534.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_06c767fb71431bee7b78f41ad4630534.jpg saved to cache
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6
2026-03-27 10:33:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be02ccd0>
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_07d5e1a9cdb028f540ca7d0709ca2117.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_07d5e1a9cdb028f540ca7d0709ca2117.jpg saved to cache
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2649402-d15a-58da-8f45-22e6df2d71eb
2026-03-27 10:33:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4df150>
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_a9248f961ae2f771e174ab59b21d4b8d.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_a9248f961ae2f771e174ab59b21d4b8d.jpg saved to cache
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 263f08e8-a9d3-54e0-a966-ccd267923967
2026-03-27 10:33:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be02d6d0>
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_4d49b90ebcf88f4e806fd3719bcf4d71.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_4d49b90ebcf88f4e806fd3719bcf4d71.jpg saved to cache
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2649402-d15a-58da-8f45-22e6df2d71eb
2026-03-27 10:33:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf389790>
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_215e3272770929785d8b30971571823a.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_215e3272770929785d8b30971571823a.jpg saved to cache
2026-03-27 10:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2649402-d15a-58da-8f45-22e6df2d71eb
2026-03-27 10:33:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3afbd0>
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_810f3d80bc51fd35cb6b58af2629eb84.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_810f3d80bc51fd35cb6b58af2629eb84.jpg saved to cache
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 263f08e8-a9d3-54e0-a966-ccd267923967
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4de410>
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f02acfc2-5aee-56b6-b9c8-5a8782c753c8/f02acfc2-5aee-56b6-b9c8-5a8782c753c8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fc8%252F70c83b3b6a4bd167b95e02937051a06d%252Fpa%252FJM99769_088adb79d925ecd628ae88f8e86980a4.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_088adb79d925ecd628ae88f8e86980a4.jpg saved to cache
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f02acfc2-5aee-56b6-b9c8-5a8782c753c8
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4f7790>
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f02acfc2-5aee-56b6-b9c8-5a8782c753c8/f02acfc2-5aee-56b6-b9c8-5a8782c753c8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fc8%252F70c83b3b6a4bd167b95e02937051a06d%252Fpa%252FJM99769_afde00dca964038434d131fd72417d59.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_afde00dca964038434d131fd72417d59.jpg saved to cache
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f02acfc2-5aee-56b6-b9c8-5a8782c753c8
2026-03-27 10:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_b42592e5d54bf01373a5b4b33eb4a078.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_cf96bd06fbae48f8a5e142cb5f87bb6f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_8ae089f20c3205bd33a4515755eba985.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f67d0>
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_fd4b27b09205c05f0ead7d779db9fa06.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_fd4b27b09205c05f0ead7d779db9fa06.jpg saved to cache
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 263f08e8-a9d3-54e0-a966-ccd267923967
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf386990>
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_7f44b35e51360cdb12f03339225109b8.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_7f44b35e51360cdb12f03339225109b8.jpg saved to cache
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2649402-d15a-58da-8f45-22e6df2d71eb
2026-03-27 10:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_37e8849b939eee7e38f41ecfa8adf810.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_ad21a4499f5c87497e018c2bf0d20d65.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_fcbea428937ba293e54f49c9d18ec763.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5bddd0>
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6/0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F23%252Fb2237aa9116e78c02115c5f002f3bbb2%252Fpa%252FLF68869_b42592e5d54bf01373a5b4b33eb4a078.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_b42592e5d54bf01373a5b4b33eb4a078.jpg saved to cache
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf386e10>
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f02acfc2-5aee-56b6-b9c8-5a8782c753c8/f02acfc2-5aee-56b6-b9c8-5a8782c753c8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fc8%252F70c83b3b6a4bd167b95e02937051a06d%252Fpa%252FJM99769_cf96bd06fbae48f8a5e142cb5f87bb6f.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_cf96bd06fbae48f8a5e142cb5f87bb6f.jpg saved to cache
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f02acfc2-5aee-56b6-b9c8-5a8782c753c8
2026-03-27 10:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_833ad1ae5b8e0fcbde6244edd13d5179.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1c6050>
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f02acfc2-5aee-56b6-b9c8-5a8782c753c8/f02acfc2-5aee-56b6-b9c8-5a8782c753c8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fc8%252F70c83b3b6a4bd167b95e02937051a06d%252Fpa%252FJM99769_8ae089f20c3205bd33a4515755eba985.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_8ae089f20c3205bd33a4515755eba985.jpg saved to cache
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f02acfc2-5aee-56b6-b9c8-5a8782c753c8
2026-03-27 10:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_1f1473f0aa241db421db19ac4b89c990.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_a1ba69585317e548aa4712878756fa13.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f45d0>
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678cd928a7d1187c64d565627757e42%252Fpa%252FMV69505_37e8849b939eee7e38f41ecfa8adf810.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_37e8849b939eee7e38f41ecfa8adf810.jpg saved to cache
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7264d6f-1a5e-58d9-a331-975c677af46b
2026-03-27 10:33:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7264d6f-1a5e-58d9-a331-975c677af46b, skipping ID generation
2026-03-27 10:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7264d6f-1a5e-58d9-a331-975c677af46b with scrape type 1
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7264d6f-1a5e-58d9-a331-975c677af46b sending to next pipeline
2026-03-27 10:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7264d6f-1a5e-58d9-a331-975c677af46b, identifier: MV69505
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1c5890>
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f02acfc2-5aee-56b6-b9c8-5a8782c753c8/f02acfc2-5aee-56b6-b9c8-5a8782c753c8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fc8%252F70c83b3b6a4bd167b95e02937051a06d%252Fpa%252FJM99769_ad21a4499f5c87497e018c2bf0d20d65.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_ad21a4499f5c87497e018c2bf0d20d65.jpg saved to cache
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f02acfc2-5aee-56b6-b9c8-5a8782c753c8
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5357790>
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6/0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F23%252Fb2237aa9116e78c02115c5f002f3bbb2%252Fpa%252FLF68869_fcbea428937ba293e54f49c9d18ec763.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_fcbea428937ba293e54f49c9d18ec763.jpg saved to cache
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6
2026-03-27 10:33:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6, skipping ID generation
2026-03-27 10:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6 with scrape type 1
2026-03-27 10:33:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6 sending to next pipeline
2026-03-27 10:33:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6, identifier: LF68869
2026-03-27 10:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7264d6f-1a5e-58d9-a331-975c677af46b with identifier: MV69505
2026-03-27 10:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7264d6f-1a5e-58d9-a331-975c677af46b with identifier: MV69505
2026-03-27 10:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7264d6f-1a5e-58d9-a331-975c677af46b with identifier: MV69505 to the API
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_37e8849b939eee7e38f41ecfa8adf810.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:59:38Z',
'fuel_type': 'diesel',
'id': 'f7264d6f-1a5e-58d9-a331-975c677af46b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV69505',
'listing': 'auction',
'location': 'DE',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 72898,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_37e8849b939eee7e38f41ecfa8adf810.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_4c555fee5051443a56fe717be6757d52.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118885,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_d1f7c588e167168dc7d2aa15eac53f2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111525,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_70e08c16407a1d01a36d8d2fe75d394a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_fe16695b8c727599118331972b46f7f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_2da210c2b8df6157eac52d11da558d84.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108174,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_1f638fe53d74d3156104ec0fbefbba09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_41755dd391873d970a2691ff2d9e307f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103009,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_0a77913e00e2982e6405d096c0337a8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7264d6f-1a5e-58d9-a331-975c677af46b/f7264d6f-1a5e-58d9-a331-975c677af46b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678cd928a7d1187c64d565627757e42/pa/MV69505_c9ba8bf728faf593fe67a126fd3a00a5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-20',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2023}
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV69505%27 HTTP/1.1" 200 None
2026-03-27 10:33:43 [auto1.de] INFO: Saving data for MV69505: {'created_time': 1774607623.476868, 'last_price_update_time': 1774607623.47688, 'auction_closing_time': 1774717178.0}
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV69505') HTTP/1.1" 204 0
2026-03-27 10:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6 with identifier: LF68869
2026-03-27 10:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6 with identifier: LF68869
2026-03-27 10:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6 with identifier: LF68869 to the API
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_fcbea428937ba293e54f49c9d18ec763.jpg>
{'auction_title': '',
'c_o_2_emission_value': 168,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:42:59Z',
'fuel_type': 'petrol',
'id': '0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF68869',
'listing': 'auction',
'location': 'DE, Wilhelmshaven',
'make': 'Toyota',
'model': 'Corolla',
'odometer': 177784,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6/0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92384,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_fcbea428937ba293e54f49c9d18ec763.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6/0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93643,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_b42592e5d54bf01373a5b4b33eb4a078.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6/0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66231,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_b75548432cf523fcdad66b21f5d8b142.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6/0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_2b6cc740360d59e430ba13e1a5c8021e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6/0f97eea3-73f7-54fb-a0c6-e6cf3bcb92e6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130770,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/23/b2237aa9116e78c02115c5f002f3bbb2/pa/LF68869_06c767fb71431bee7b78f41ad4630534.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-05-11',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Corolla 1.6 Compact Edition',
'transmission': 'manual',
'trim': 'Compact Edition',
'year': 2006}
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF68869%27 HTTP/1.1" 200 None
2026-03-27 10:33:43 [auto1.de] INFO: Saving data for LF68869: {'created_time': 1774607623.862005, 'last_price_update_time': 1774607623.862018, 'auction_closing_time': 1774716179.0}
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF68869') HTTP/1.1" 204 0
2026-03-27 10:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_e63ecc87998266f485afef79e9b39eed.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2c86f11bc26c6f0c7afb12a65b72b3/pa/XX31314_c19d675e62af93648fb7002a9fce8aa9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2c86f11bc26c6f0c7afb12a65b72b3/pa/XX31314_8169b043f25cdfd74595cfafcf390b11.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JL47940/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2c86f11bc26c6f0c7afb12a65b72b3/pa/XX31314_27564b7811ad82bdd058f9104703926c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5376ed0>
2026-03-27 10:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_833ad1ae5b8e0fcbde6244edd13d5179.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_833ad1ae5b8e0fcbde6244edd13d5179.jpg saved to cache
2026-03-27 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 674728a0-6417-5cf5-9af8-cfd213d65b26
2026-03-27 10:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1c0f50>
2026-03-27 10:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F43%252Fa44394561d934950effce0e4d0d36689%252Fpa%252FWE78461_1f1473f0aa241db421db19ac4b89c990.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_1f1473f0aa241db421db19ac4b89c990.jpg saved to cache
2026-03-27 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2649402-d15a-58da-8f45-22e6df2d71eb
2026-03-27 10:33:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2649402-d15a-58da-8f45-22e6df2d71eb, skipping ID generation
2026-03-27 10:33:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2649402-d15a-58da-8f45-22e6df2d71eb with scrape type 1
2026-03-27 10:33:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2649402-d15a-58da-8f45-22e6df2d71eb sending to next pipeline
2026-03-27 10:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2649402-d15a-58da-8f45-22e6df2d71eb, identifier: WE78461
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1c0c10>
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_a1ba69585317e548aa4712878756fa13.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_a1ba69585317e548aa4712878756fa13.jpg saved to cache
2026-03-27 10:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57aa10a7-6db1-545d-a03e-a3af09cabb59
2026-03-27 10:33:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2649402-d15a-58da-8f45-22e6df2d71eb with identifier: WE78461
2026-03-27 10:33:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2649402-d15a-58da-8f45-22e6df2d71eb with identifier: WE78461
2026-03-27 10:33:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2649402-d15a-58da-8f45-22e6df2d71eb with identifier: WE78461 to the API
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:33:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_1f1473f0aa241db421db19ac4b89c990.jpg>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:57:21Z',
'fuel_type': 'diesel',
'id': 'd2649402-d15a-58da-8f45-22e6df2d71eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE78461',
'listing': 'auction',
'location': 'DE, Lübeck',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 193408,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_1f1473f0aa241db421db19ac4b89c990.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_7f44b35e51360cdb12f03339225109b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83175,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_0334cc673b45f038f4fd528df0dab9c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2872401,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_1eddc495f1a338a58379ad6aa4a022ed.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2791008,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_e0526686e9d38b18e53a20364364b9c0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2643893,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_215e3272770929785d8b30971571823a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57657,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_8323e3fada12896229d6c8bbcac32592.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_0b99d21cbbf5b7880db5e7c0de0edc5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2911258,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_07d5e1a9cdb028f540ca7d0709ca2117.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2649402-d15a-58da-8f45-22e6df2d71eb/d2649402-d15a-58da-8f45-22e6df2d71eb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2756360,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga4/43/a44394561d934950effce0e4d0d36689/pa/WE78461_4d49b90ebcf88f4e806fd3719bcf4d71.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2016}
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE78461%27 HTTP/1.1" 200 None
2026-03-27 10:33:44 [auto1.de] INFO: Saving data for WE78461: {'created_time': 1774607624.516571, 'last_price_update_time': 1774607624.516587, 'auction_closing_time': 1774717041.0}
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE78461') HTTP/1.1" 204 0
2026-03-27 10:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE44691/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK16576> (referer: https://www.auto1.com/v1/car-details-view/UK16576/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f20d0>
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f02acfc2-5aee-56b6-b9c8-5a8782c753c8/f02acfc2-5aee-56b6-b9c8-5a8782c753c8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fc8%252F70c83b3b6a4bd167b95e02937051a06d%252Fpa%252FJM99769_e63ecc87998266f485afef79e9b39eed.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_e63ecc87998266f485afef79e9b39eed.jpg saved to cache
2026-03-27 10:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f02acfc2-5aee-56b6-b9c8-5a8782c753c8
2026-03-27 10:33:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f02acfc2-5aee-56b6-b9c8-5a8782c753c8, skipping ID generation
2026-03-27 10:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f02acfc2-5aee-56b6-b9c8-5a8782c753c8 with scrape type 1
2026-03-27 10:33:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f02acfc2-5aee-56b6-b9c8-5a8782c753c8 sending to next pipeline
2026-03-27 10:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f02acfc2-5aee-56b6-b9c8-5a8782c753c8, identifier: JM99769
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1f90d0>
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929769ef-7a25-57f3-bcc9-86c4e988916c/929769ef-7a25-57f3-bcc9-86c4e988916c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2c86f11bc26c6f0c7afb12a65b72b3%252Fpa%252FXX31314_c19d675e62af93648fb7002a9fce8aa9.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2c86f11bc26c6f0c7afb12a65b72b3/pa/XX31314_c19d675e62af93648fb7002a9fce8aa9.jpg saved to cache
2026-03-27 10:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 929769ef-7a25-57f3-bcc9-86c4e988916c
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be13af10>
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929769ef-7a25-57f3-bcc9-86c4e988916c/929769ef-7a25-57f3-bcc9-86c4e988916c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2c86f11bc26c6f0c7afb12a65b72b3%252Fpa%252FXX31314_8169b043f25cdfd74595cfafcf390b11.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2c86f11bc26c6f0c7afb12a65b72b3/pa/XX31314_8169b043f25cdfd74595cfafcf390b11.jpg saved to cache
2026-03-27 10:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 929769ef-7a25-57f3-bcc9-86c4e988916c
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3a5e50>
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929769ef-7a25-57f3-bcc9-86c4e988916c/929769ef-7a25-57f3-bcc9-86c4e988916c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2c86f11bc26c6f0c7afb12a65b72b3%252Fpa%252FXX31314_27564b7811ad82bdd058f9104703926c.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2c86f11bc26c6f0c7afb12a65b72b3/pa/XX31314_27564b7811ad82bdd058f9104703926c.jpg saved to cache
2026-03-27 10:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 929769ef-7a25-57f3-bcc9-86c4e988916c
2026-03-27 10:33:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 929769ef-7a25-57f3-bcc9-86c4e988916c, skipping ID generation
2026-03-27 10:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 929769ef-7a25-57f3-bcc9-86c4e988916c with scrape type 1
2026-03-27 10:33:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 929769ef-7a25-57f3-bcc9-86c4e988916c sending to next pipeline
2026-03-27 10:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 929769ef-7a25-57f3-bcc9-86c4e988916c, identifier: XX31314
2026-03-27 10:33:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f02acfc2-5aee-56b6-b9c8-5a8782c753c8 with identifier: JM99769
2026-03-27 10:33:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f02acfc2-5aee-56b6-b9c8-5a8782c753c8 with identifier: JM99769
2026-03-27 10:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f02acfc2-5aee-56b6-b9c8-5a8782c753c8 with identifier: JM99769 to the API
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_e63ecc87998266f485afef79e9b39eed.jpg>
{'auction_title': '',
'c_o_2_emission_value': 98,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:57:59Z',
'fuel_type': 'diesel',
'id': 'f02acfc2-5aee-56b6-b9c8-5a8782c753c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM99769',
'listing': 'auction',
'location': 'DE, Saarlouis',
'make': 'Ford',
'model': 'Focus',
'odometer': 350351,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02acfc2-5aee-56b6-b9c8-5a8782c753c8/f02acfc2-5aee-56b6-b9c8-5a8782c753c8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86697,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_ad21a4499f5c87497e018c2bf0d20d65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02acfc2-5aee-56b6-b9c8-5a8782c753c8/f02acfc2-5aee-56b6-b9c8-5a8782c753c8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95603,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_e63ecc87998266f485afef79e9b39eed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02acfc2-5aee-56b6-b9c8-5a8782c753c8/f02acfc2-5aee-56b6-b9c8-5a8782c753c8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_088adb79d925ecd628ae88f8e86980a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02acfc2-5aee-56b6-b9c8-5a8782c753c8/f02acfc2-5aee-56b6-b9c8-5a8782c753c8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63065,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_cf96bd06fbae48f8a5e142cb5f87bb6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02acfc2-5aee-56b6-b9c8-5a8782c753c8/f02acfc2-5aee-56b6-b9c8-5a8782c753c8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114393,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_8ae089f20c3205bd33a4515755eba985.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02acfc2-5aee-56b6-b9c8-5a8782c753c8/f02acfc2-5aee-56b6-b9c8-5a8782c753c8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/c8/70c83b3b6a4bd167b95e02937051a06d/pa/JM99769_afde00dca964038434d131fd72417d59.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-12-09',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.5 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM99769%27 HTTP/1.1" 200 None
2026-03-27 10:33:45 [auto1.de] INFO: Saving data for JM99769: {'created_time': 1774607625.25785, 'last_price_update_time': 1774607625.257862, 'auction_closing_time': 1774717079.0}
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM99769') HTTP/1.1" 204 0
2026-03-27 10:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 929769ef-7a25-57f3-bcc9-86c4e988916c with identifier: XX31314
2026-03-27 10:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 929769ef-7a25-57f3-bcc9-86c4e988916c with identifier: XX31314
2026-03-27 10:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 929769ef-7a25-57f3-bcc9-86c4e988916c with identifier: XX31314 to the API
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/2c/cf2c86f11bc26c6f0c7afb12a65b72b3/pa/XX31314_27564b7811ad82bdd058f9104703926c.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:00:42Z',
'fuel_type': 'petrol',
'id': '929769ef-7a25-57f3-bcc9-86c4e988916c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX31314',
'listing': 'auction',
'location': 'DE',
'make': 'Opel',
'model': 'Astra',
'odometer': 32274,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 4,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929769ef-7a25-57f3-bcc9-86c4e988916c/929769ef-7a25-57f3-bcc9-86c4e988916c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119935,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2c86f11bc26c6f0c7afb12a65b72b3/pa/XX31314_27564b7811ad82bdd058f9104703926c.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929769ef-7a25-57f3-bcc9-86c4e988916c/929769ef-7a25-57f3-bcc9-86c4e988916c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113422,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2c86f11bc26c6f0c7afb12a65b72b3/pa/XX31314_8169b043f25cdfd74595cfafcf390b11.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929769ef-7a25-57f3-bcc9-86c4e988916c/929769ef-7a25-57f3-bcc9-86c4e988916c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110552,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2c86f11bc26c6f0c7afb12a65b72b3/pa/XX31314_c19d675e62af93648fb7002a9fce8aa9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929769ef-7a25-57f3-bcc9-86c4e988916c/929769ef-7a25-57f3-bcc9-86c4e988916c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72253,
'Height': 960,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2c86f11bc26c6f0c7afb12a65b72b3/pa/XX31314_55b2d87f71fd5514f625bc63987b10c2.jpg',
'Width': 1280}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-05-26',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Astra 1.2 Turbo Ultimate',
'transmission': 'automatic',
'trim': 'Ultimate',
'year': 2024}
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX31314%27 HTTP/1.1" 200 None
2026-03-27 10:33:45 [auto1.de] INFO: Saving data for XX31314: {'created_time': 1774607625.671864, 'last_price_update_time': 1774607625.671874, 'auction_closing_time': 1774713642.0}
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX31314') HTTP/1.1" 204 0
2026-03-27 10:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH43158/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TL45864/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 254deee2-96fb-5ddf-803a-b30cfd31c70f with identifier: UK16576
2026-03-27 10:33:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 254deee2-96fb-5ddf-803a-b30cfd31c70f with scrape type 1
2026-03-27 10:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 254deee2-96fb-5ddf-803a-b30cfd31c70f
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F18%252F5a183b786ea81250873f5125f03716bb%252Fpa%252FUK16576_6f58c66cf656bd9f089fb2cffe201484.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_6f58c66cf656bd9f089fb2cffe201484.jpg not downloaded yet
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F18%252F5a183b786ea81250873f5125f03716bb%252Fpa%252FUK16576_a5dd1f18e469d8e4dc1972f12e3c629a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_a5dd1f18e469d8e4dc1972f12e3c629a.jpg not downloaded yet
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F18%252F5a183b786ea81250873f5125f03716bb%252Fpa%252FUK16576_87fddb1077673d14f67c8a814edd807f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_87fddb1077673d14f67c8a814edd807f.jpg not downloaded yet
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F18%252F5a183b786ea81250873f5125f03716bb%252Fpa%252FUK16576_d733af810c0485d85df80193ca1d1e5f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_d733af810c0485d85df80193ca1d1e5f.jpg not downloaded yet
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F18%252F5a183b786ea81250873f5125f03716bb%252Fpa%252FUK16576_9489f794985c03adda82bcc2c5911631.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_9489f794985c03adda82bcc2c5911631.jpg not downloaded yet
2026-03-27 10:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_41ce2b67f786e70817c9dcffb7fc1121.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_78aab353b2717f997371e47263ac62e4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_400805bdee2f09e796786fbe9877eff2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_0a9958c285e7e33f6fb7a005f76e602b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf477b90>
2026-03-27 10:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fbc%252F8fbcc70449e8ecc82a034d5284936c7a%252Fpa%252FZD23716_41ce2b67f786e70817c9dcffb7fc1121.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_41ce2b67f786e70817c9dcffb7fc1121.jpg saved to cache
2026-03-27 10:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 263f08e8-a9d3-54e0-a966-ccd267923967
2026-03-27 10:33:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 263f08e8-a9d3-54e0-a966-ccd267923967, skipping ID generation
2026-03-27 10:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 263f08e8-a9d3-54e0-a966-ccd267923967 with scrape type 1
2026-03-27 10:33:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 263f08e8-a9d3-54e0-a966-ccd267923967 sending to next pipeline
2026-03-27 10:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 263f08e8-a9d3-54e0-a966-ccd267923967, identifier: ZD23716
2026-03-27 10:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 263f08e8-a9d3-54e0-a966-ccd267923967 with identifier: ZD23716
2026-03-27 10:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 263f08e8-a9d3-54e0-a966-ccd267923967 with identifier: ZD23716
2026-03-27 10:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 263f08e8-a9d3-54e0-a966-ccd267923967 with identifier: ZD23716 to the API
2026-03-27 10:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:33:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_41ce2b67f786e70817c9dcffb7fc1121.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:37:41Z',
'fuel_type': 'diesel',
'id': '263f08e8-a9d3-54e0-a966-ccd267923967',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD23716',
'listing': 'auction',
'location': 'DE, Zweibrücken',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 154895,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2849972,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_41ce2b67f786e70817c9dcffb7fc1121.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_fd4b27b09205c05f0ead7d779db9fa06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79019,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_edc6cd9d916fbf77bfa6262a057e2ae0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_4c2e847e6acebf2f694d7f65b4bb9329.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_978274ac56f1db08cede8935a2b39d2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2640249,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_810f3d80bc51fd35cb6b58af2629eb84.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53201,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_c849a46ca108e7ca5716bfcd4c6906dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_c19e2fc82868f777021a882c2d687439.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2668241,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_a9248f961ae2f771e174ab59b21d4b8d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_263f08e8-a9d3-54e0-a966-ccd267923967/263f08e8-a9d3-54e0-a966-ccd267923967_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92006,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/bc/8fbcc70449e8ecc82a034d5284936c7a/pa/ZD23716_b90d82d5832237e4bec46471ac077028.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-07-02',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI RS',
'transmission': 'automatic',
'trim': 'RS',
'year': 2014}
2026-03-27 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD23716%27 HTTP/1.1" 200 None
2026-03-27 10:33:46 [auto1.de] INFO: Saving data for ZD23716: {'created_time': 1774607626.546128, 'last_price_update_time': 1774607626.54614, 'auction_closing_time': 1774715861.0}
2026-03-27 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD23716') HTTP/1.1" 204 0
2026-03-27 10:33:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be128910>
2026-03-27 10:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F43%252Fa643f373be7660dba79e6d610c9cf9e2%252Fpa%252FHF06660_78aab353b2717f997371e47263ac62e4.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_78aab353b2717f997371e47263ac62e4.jpg saved to cache
2026-03-27 10:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 57aa10a7-6db1-545d-a03e-a3af09cabb59
2026-03-27 10:33:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57aa10a7-6db1-545d-a03e-a3af09cabb59, skipping ID generation
2026-03-27 10:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57aa10a7-6db1-545d-a03e-a3af09cabb59 with scrape type 1
2026-03-27 10:33:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57aa10a7-6db1-545d-a03e-a3af09cabb59 sending to next pipeline
2026-03-27 10:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57aa10a7-6db1-545d-a03e-a3af09cabb59, identifier: HF06660
2026-03-27 10:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57aa10a7-6db1-545d-a03e-a3af09cabb59 with identifier: HF06660
2026-03-27 10:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57aa10a7-6db1-545d-a03e-a3af09cabb59 with identifier: HF06660
2026-03-27 10:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57aa10a7-6db1-545d-a03e-a3af09cabb59 with identifier: HF06660 to the API
2026-03-27 10:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_78aab353b2717f997371e47263ac62e4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 146,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:35:17Z',
'fuel_type': 'petrol',
'id': '57aa10a7-6db1-545d-a03e-a3af09cabb59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF06660',
'listing': 'auction',
'location': 'DE, Dormagen',
'make': 'Ford',
'model': 'Focus',
'odometer': 72681,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2862490,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_8ce0806f621dd1a35f01d4574312b663.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2682643,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_78aab353b2717f997371e47263ac62e4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_a1ba69585317e548aa4712878756fa13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2685967,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_8fd49a116c4a44a136ba9310855880ae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_024336fa802ac6cf534eec46c124076d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_aa205a16f31147758f98a2bb23570a7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64441,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_0a2007952e6f162a53f05abc924f041e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2488882,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_14b205809fc75d38c194915a4982df2b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2494764,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_9f2d95201ea1ac155999237c77ebefde.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aa10a7-6db1-545d-a03e-a3af09cabb59/57aa10a7-6db1-545d-a03e-a3af09cabb59_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79213,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/43/a643f373be7660dba79e6d610c9cf9e2/pa/HF06660_a81e9815de4083399c9d0cb05f7e86d3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-01-06',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2020}
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF06660%27 HTTP/1.1" 200 None
2026-03-27 10:33:47 [auto1.de] INFO: Saving data for HF06660: {'created_time': 1774607627.149307, 'last_price_update_time': 1774607627.149317, 'auction_closing_time': 1774715717.0}
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF06660') HTTP/1.1" 204 0
2026-03-27 10:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DW23670/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS13064/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c57ed3d0>
2026-03-27 10:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F00%252F24000114bad3441f4600168baa7c7fed%252Fpa%252FLW83066_400805bdee2f09e796786fbe9877eff2.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_400805bdee2f09e796786fbe9877eff2.jpg saved to cache
2026-03-27 10:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d
2026-03-27 10:33:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d, skipping ID generation
2026-03-27 10:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d with scrape type 1
2026-03-27 10:33:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d sending to next pipeline
2026-03-27 10:33:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d, identifier: LW83066
2026-03-27 10:33:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b7510>
2026-03-27 10:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F5c%252F3b5c20282ce9ecdfa553390b798c7cf2%252Fpa%252FDF69059_0a9958c285e7e33f6fb7a005f76e602b.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_0a9958c285e7e33f6fb7a005f76e602b.jpg saved to cache
2026-03-27 10:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 674728a0-6417-5cf5-9af8-cfd213d65b26
2026-03-27 10:33:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 674728a0-6417-5cf5-9af8-cfd213d65b26, skipping ID generation
2026-03-27 10:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 674728a0-6417-5cf5-9af8-cfd213d65b26 with scrape type 1
2026-03-27 10:33:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 674728a0-6417-5cf5-9af8-cfd213d65b26 sending to next pipeline
2026-03-27 10:33:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 674728a0-6417-5cf5-9af8-cfd213d65b26, identifier: DF69059
2026-03-27 10:33:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d with identifier: LW83066
2026-03-27 10:33:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d with identifier: LW83066
2026-03-27 10:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 469fef8c-8a0a-54ee-a6ef-8e49d1498e8d with identifier: LW83066 to the API
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_400805bdee2f09e796786fbe9877eff2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:24:11Z',
'fuel_type': 'petrol',
'id': '469fef8c-8a0a-54ee-a6ef-8e49d1498e8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW83066',
'listing': 'auction',
'location': 'DE, Dortmund',
'make': 'Kia',
'model': 'Stonic',
'odometer': 46790,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2684978,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_400805bdee2f09e796786fbe9877eff2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_92aa4d5627dc44d7319c73d6876f6cfe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77776,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_d06df7cbbf38e1156cf6b22d25964c58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2674545,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_69795b52c1deb3a896f9da2b9b962618.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75806,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_368969ddcb18bbc417b0a25765a4b392.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_e424c7ee05879fa24a891c7bc58b4316.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_0444c7f6f59a2e08a2349bb9fbe5a9b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2632217,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_b4f07e409a2a4972752b35c6b99c888c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_14e0f95d3fdfa76d4d4c7568f7ca41c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469fef8c-8a0a-54ee-a6ef-8e49d1498e8d/469fef8c-8a0a-54ee-a6ef-8e49d1498e8d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2805420,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img24/00/24000114bad3441f4600168baa7c7fed/pa/LW83066_3d243a8f811a122e7c74502a5ea801e3.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Stonic 1.2 Vision',
'transmission': 'manual',
'trim': 'Vision',
'year': 2018}
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW83066%27 HTTP/1.1" 200 None
2026-03-27 10:33:47 [auto1.de] INFO: Saving data for LW83066: {'created_time': 1774607627.93582, 'last_price_update_time': 1774607627.935834, 'auction_closing_time': 1774715051.0}
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW83066') HTTP/1.1" 204 0
2026-03-27 10:33:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 674728a0-6417-5cf5-9af8-cfd213d65b26 with identifier: DF69059
2026-03-27 10:33:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 674728a0-6417-5cf5-9af8-cfd213d65b26 with identifier: DF69059
2026-03-27 10:33:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 674728a0-6417-5cf5-9af8-cfd213d65b26 with identifier: DF69059 to the API
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_0a9958c285e7e33f6fb7a005f76e602b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:59:25Z',
'fuel_type': 'petrol',
'id': '674728a0-6417-5cf5-9af8-cfd213d65b26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF69059',
'listing': 'auction',
'location': 'DE, Karlsruhe',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 9380,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98267,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_833ad1ae5b8e0fcbde6244edd13d5179.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3188322,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_0a9958c285e7e33f6fb7a005f76e602b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3050783,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_3d3481f7c3b64896f4fabfcf046c6d5f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69292,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_b1fcd3c47475988dee22af016ef96d53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3068114,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_21d23d34df4e530b5321b5f54586d9fb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_4652693c95b3b2a31bec722fc468f092.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3117342,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_2bf7b6b27ac7630e7dc7e0b2ec79b6b9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3100034,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_061af295276b2795f29a509191974696.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3173154,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_910c5ede71459806afecc9942f38525a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_674728a0-6417-5cf5-9af8-cfd213d65b26/674728a0-6417-5cf5-9af8-cfd213d65b26_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3154579,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3b/5c/3b5c20282ce9ecdfa553390b798c7cf2/pa/DF69059_f1f27dce81513a7a5dada5bf78835ca0.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2020}
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF69059%27 HTTP/1.1" 200 None
2026-03-27 10:33:48 [auto1.de] INFO: Saving data for DF69059: {'created_time': 1774607628.346798, 'last_price_update_time': 1774607628.346809, 'auction_closing_time': 1774717165.0}
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF69059') HTTP/1.1" 204 0
2026-03-27 10:33:48 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.992(s), this was the 1st time calling it.
2026-03-27 10:33:48 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.899330004714321 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MK74159/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ96778/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_9489f794985c03adda82bcc2c5911631.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_6f58c66cf656bd9f089fb2cffe201484.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_87fddb1077673d14f67c8a814edd807f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b4190>
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_254deee2-96fb-5ddf-803a-b30cfd31c70f/254deee2-96fb-5ddf-803a-b30cfd31c70f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F18%252F5a183b786ea81250873f5125f03716bb%252Fpa%252FUK16576_9489f794985c03adda82bcc2c5911631.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_9489f794985c03adda82bcc2c5911631.jpg saved to cache
2026-03-27 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 254deee2-96fb-5ddf-803a-b30cfd31c70f
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5360b10>
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_254deee2-96fb-5ddf-803a-b30cfd31c70f/254deee2-96fb-5ddf-803a-b30cfd31c70f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F18%252F5a183b786ea81250873f5125f03716bb%252Fpa%252FUK16576_6f58c66cf656bd9f089fb2cffe201484.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_6f58c66cf656bd9f089fb2cffe201484.jpg saved to cache
2026-03-27 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 254deee2-96fb-5ddf-803a-b30cfd31c70f
2026-03-27 10:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_a5dd1f18e469d8e4dc1972f12e3c629a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_d733af810c0485d85df80193ca1d1e5f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5362490>
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_254deee2-96fb-5ddf-803a-b30cfd31c70f/254deee2-96fb-5ddf-803a-b30cfd31c70f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F18%252F5a183b786ea81250873f5125f03716bb%252Fpa%252FUK16576_87fddb1077673d14f67c8a814edd807f.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_87fddb1077673d14f67c8a814edd807f.jpg saved to cache
2026-03-27 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 254deee2-96fb-5ddf-803a-b30cfd31c70f
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1d4850>
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_254deee2-96fb-5ddf-803a-b30cfd31c70f/254deee2-96fb-5ddf-803a-b30cfd31c70f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F18%252F5a183b786ea81250873f5125f03716bb%252Fpa%252FUK16576_a5dd1f18e469d8e4dc1972f12e3c629a.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_a5dd1f18e469d8e4dc1972f12e3c629a.jpg saved to cache
2026-03-27 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 254deee2-96fb-5ddf-803a-b30cfd31c70f
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1d4fd0>
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_254deee2-96fb-5ddf-803a-b30cfd31c70f/254deee2-96fb-5ddf-803a-b30cfd31c70f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F18%252F5a183b786ea81250873f5125f03716bb%252Fpa%252FUK16576_d733af810c0485d85df80193ca1d1e5f.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_d733af810c0485d85df80193ca1d1e5f.jpg saved to cache
2026-03-27 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 254deee2-96fb-5ddf-803a-b30cfd31c70f
2026-03-27 10:33:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 254deee2-96fb-5ddf-803a-b30cfd31c70f, skipping ID generation
2026-03-27 10:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 254deee2-96fb-5ddf-803a-b30cfd31c70f with scrape type 1
2026-03-27 10:33:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 254deee2-96fb-5ddf-803a-b30cfd31c70f sending to next pipeline
2026-03-27 10:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 254deee2-96fb-5ddf-803a-b30cfd31c70f, identifier: UK16576
2026-03-27 10:33:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 254deee2-96fb-5ddf-803a-b30cfd31c70f with identifier: UK16576
2026-03-27 10:33:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 254deee2-96fb-5ddf-803a-b30cfd31c70f with identifier: UK16576
2026-03-27 10:33:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 254deee2-96fb-5ddf-803a-b30cfd31c70f with identifier: UK16576 to the API
2026-03-27 10:33:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_d733af810c0485d85df80193ca1d1e5f.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 209,
'expiration_date': '2026-03-28T16:26:16Z',
'fuel_type': 'diesel',
'id': '254deee2-96fb-5ddf-803a-b30cfd31c70f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK16576',
'listing': 'auction',
'location': 'DE',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 22335,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_254deee2-96fb-5ddf-803a-b30cfd31c70f/254deee2-96fb-5ddf-803a-b30cfd31c70f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25048,
'Height': 351,
'OriginUrl': 'https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_6f58c66cf656bd9f089fb2cffe201484.jpg',
'Width': 468},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_254deee2-96fb-5ddf-803a-b30cfd31c70f/254deee2-96fb-5ddf-803a-b30cfd31c70f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23851,
'Height': 351,
'OriginUrl': 'https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_a5dd1f18e469d8e4dc1972f12e3c629a.jpg',
'Width': 468},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_254deee2-96fb-5ddf-803a-b30cfd31c70f/254deee2-96fb-5ddf-803a-b30cfd31c70f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25664,
'Height': 351,
'OriginUrl': 'https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_87fddb1077673d14f67c8a814edd807f.jpg',
'Width': 468},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_254deee2-96fb-5ddf-803a-b30cfd31c70f/254deee2-96fb-5ddf-803a-b30cfd31c70f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21385,
'Height': 354,
'OriginUrl': 'https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_d733af810c0485d85df80193ca1d1e5f.jpg',
'Width': 472},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_254deee2-96fb-5ddf-803a-b30cfd31c70f/254deee2-96fb-5ddf-803a-b30cfd31c70f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 9527,
'Height': 354,
'OriginUrl': 'https://img-pa.auto1.com/img5a/18/5a183b786ea81250873f5125f03716bb/pa/UK16576_9489f794985c03adda82bcc2c5911631.jpg',
'Width': 472}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2025-03-26',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Veloce Q4',
'transmission': 'automatic',
'trim': 'Veloce Q4',
'year': 2025}
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK16576%27 HTTP/1.1" 200 None
2026-03-27 10:33:49 [auto1.de] INFO: Saving data for UK16576: {'created_time': 1774607629.295932, 'last_price_update_time': 1774607629.295945, 'auction_closing_time': 1774715176.0}
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK16576') HTTP/1.1" 204 0
2026-03-27 10:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JL47940> (referer: https://www.auto1.com/v1/car-details-view/JL47940/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b12afdfb-a057-5f57-bd1c-b5c68901f4b5 with identifier: JL47940
2026-03-27 10:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b12afdfb-a057-5f57-bd1c-b5c68901f4b5 with scrape type 1
2026-03-27 10:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b12afdfb-a057-5f57-bd1c-b5c68901f4b5
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F70%252Ff270cef90f9a69b8feb4704125c9b603%252Fpa%252FJL47940_6c91cea292102170a38a0155f34987aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_6c91cea292102170a38a0155f34987aa.jpg not downloaded yet
2026-03-27 10:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_1bb9c6b4d95c404e4512b7924c20938c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F70%252Ff270cef90f9a69b8feb4704125c9b603%252Fpa%252FJL47940_f791c3327a724b3e4a8309b99d78789c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_f791c3327a724b3e4a8309b99d78789c.jpg not downloaded yet
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F70%252Ff270cef90f9a69b8feb4704125c9b603%252Fpa%252FJL47940_094bf6973dd8977274bc110002b1c5b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_094bf6973dd8977274bc110002b1c5b0.jpg not downloaded yet
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F70%252Ff270cef90f9a69b8feb4704125c9b603%252Fpa%252FJL47940_9ed9faad1e90c46be2851d97650e1f92.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_9ed9faad1e90c46be2851d97650e1f92.jpg not downloaded yet
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F70%252Ff270cef90f9a69b8feb4704125c9b603%252Fpa%252FJL47940_12675efd43f5d343c770e3f1d56bbd89.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_12675efd43f5d343c770e3f1d56bbd89.jpg not downloaded yet
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F70%252Ff270cef90f9a69b8feb4704125c9b603%252Fpa%252FJL47940_489fefcff44eca5959fa491cc1acb190.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_489fefcff44eca5959fa491cc1acb190.jpg not downloaded yet
2026-03-27 10:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5376ad0>
2026-03-27 10:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611/d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F8a%252F268a501677789702aeff149630b184cc%252Fpa%252FHL17570_1bb9c6b4d95c404e4512b7924c20938c.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_1bb9c6b4d95c404e4512b7924c20938c.jpg saved to cache
2026-03-27 10:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611
2026-03-27 10:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_6c91cea292102170a38a0155f34987aa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_489fefcff44eca5959fa491cc1acb190.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c53c7790>
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b12afdfb-a057-5f57-bd1c-b5c68901f4b5/b12afdfb-a057-5f57-bd1c-b5c68901f4b5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F70%252Ff270cef90f9a69b8feb4704125c9b603%252Fpa%252FJL47940_6c91cea292102170a38a0155f34987aa.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_6c91cea292102170a38a0155f34987aa.jpg saved to cache
2026-03-27 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b12afdfb-a057-5f57-bd1c-b5c68901f4b5
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2a9590>
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b12afdfb-a057-5f57-bd1c-b5c68901f4b5/b12afdfb-a057-5f57-bd1c-b5c68901f4b5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F70%252Ff270cef90f9a69b8feb4704125c9b603%252Fpa%252FJL47940_489fefcff44eca5959fa491cc1acb190.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_489fefcff44eca5959fa491cc1acb190.jpg saved to cache
2026-03-27 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b12afdfb-a057-5f57-bd1c-b5c68901f4b5
2026-03-27 10:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_12675efd43f5d343c770e3f1d56bbd89.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be025210>
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b12afdfb-a057-5f57-bd1c-b5c68901f4b5/b12afdfb-a057-5f57-bd1c-b5c68901f4b5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F70%252Ff270cef90f9a69b8feb4704125c9b603%252Fpa%252FJL47940_12675efd43f5d343c770e3f1d56bbd89.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_12675efd43f5d343c770e3f1d56bbd89.jpg saved to cache
2026-03-27 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b12afdfb-a057-5f57-bd1c-b5c68901f4b5
2026-03-27 10:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_9ed9faad1e90c46be2851d97650e1f92.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3ddd90>
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b12afdfb-a057-5f57-bd1c-b5c68901f4b5/b12afdfb-a057-5f57-bd1c-b5c68901f4b5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F70%252Ff270cef90f9a69b8feb4704125c9b603%252Fpa%252FJL47940_9ed9faad1e90c46be2851d97650e1f92.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_9ed9faad1e90c46be2851d97650e1f92.jpg saved to cache
2026-03-27 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b12afdfb-a057-5f57-bd1c-b5c68901f4b5
2026-03-27 10:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_094bf6973dd8977274bc110002b1c5b0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be257d10>
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b12afdfb-a057-5f57-bd1c-b5c68901f4b5/b12afdfb-a057-5f57-bd1c-b5c68901f4b5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F70%252Ff270cef90f9a69b8feb4704125c9b603%252Fpa%252FJL47940_094bf6973dd8977274bc110002b1c5b0.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_094bf6973dd8977274bc110002b1c5b0.jpg saved to cache
2026-03-27 10:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b12afdfb-a057-5f57-bd1c-b5c68901f4b5
2026-03-27 10:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_f791c3327a724b3e4a8309b99d78789c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_97f32209863f70588d1681973a76b8e3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3df990>
2026-03-27 10:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b12afdfb-a057-5f57-bd1c-b5c68901f4b5/b12afdfb-a057-5f57-bd1c-b5c68901f4b5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F70%252Ff270cef90f9a69b8feb4704125c9b603%252Fpa%252FJL47940_f791c3327a724b3e4a8309b99d78789c.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_f791c3327a724b3e4a8309b99d78789c.jpg saved to cache
2026-03-27 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b12afdfb-a057-5f57-bd1c-b5c68901f4b5
2026-03-27 10:33:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b12afdfb-a057-5f57-bd1c-b5c68901f4b5, skipping ID generation
2026-03-27 10:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b12afdfb-a057-5f57-bd1c-b5c68901f4b5 with scrape type 1
2026-03-27 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b12afdfb-a057-5f57-bd1c-b5c68901f4b5 sending to next pipeline
2026-03-27 10:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b12afdfb-a057-5f57-bd1c-b5c68901f4b5, identifier: JL47940
2026-03-27 10:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b12afdfb-a057-5f57-bd1c-b5c68901f4b5 with identifier: JL47940
2026-03-27 10:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b12afdfb-a057-5f57-bd1c-b5c68901f4b5 with identifier: JL47940
2026-03-27 10:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b12afdfb-a057-5f57-bd1c-b5c68901f4b5 with identifier: JL47940 to the API
2026-03-27 10:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_f791c3327a724b3e4a8309b99d78789c.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:48:54Z',
'fuel_type': 'petrol',
'id': 'b12afdfb-a057-5f57-bd1c-b5c68901f4b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL47940',
'listing': 'auction',
'location': 'DE, Norderstedt',
'make': 'Ford',
'model': 'Focus',
'odometer': 167475,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b12afdfb-a057-5f57-bd1c-b5c68901f4b5/b12afdfb-a057-5f57-bd1c-b5c68901f4b5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93610,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_6c91cea292102170a38a0155f34987aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b12afdfb-a057-5f57-bd1c-b5c68901f4b5/b12afdfb-a057-5f57-bd1c-b5c68901f4b5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76680,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_f791c3327a724b3e4a8309b99d78789c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b12afdfb-a057-5f57-bd1c-b5c68901f4b5/b12afdfb-a057-5f57-bd1c-b5c68901f4b5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81008,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_094bf6973dd8977274bc110002b1c5b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b12afdfb-a057-5f57-bd1c-b5c68901f4b5/b12afdfb-a057-5f57-bd1c-b5c68901f4b5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78656,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_9ed9faad1e90c46be2851d97650e1f92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b12afdfb-a057-5f57-bd1c-b5c68901f4b5/b12afdfb-a057-5f57-bd1c-b5c68901f4b5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93644,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_12675efd43f5d343c770e3f1d56bbd89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b12afdfb-a057-5f57-bd1c-b5c68901f4b5/b12afdfb-a057-5f57-bd1c-b5c68901f4b5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67830,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/70/f270cef90f9a69b8feb4704125c9b603/pa/JL47940_489fefcff44eca5959fa491cc1acb190.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-08-23',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.6 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2011}
2026-03-27 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL47940%27 HTTP/1.1" 200 None
2026-03-27 10:33:51 [auto1.de] INFO: Saving data for JL47940: {'created_time': 1774607631.600559, 'last_price_update_time': 1774607631.600571, 'auction_closing_time': 1774716534.0}
2026-03-27 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL47940') HTTP/1.1" 204 0
2026-03-27 10:33:51 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.013(s), this was the 1st time calling it.
2026-03-27 10:33:51 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.717967596534902 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4e2790>
2026-03-27 10:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611/d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F8a%252F268a501677789702aeff149630b184cc%252Fpa%252FHL17570_97f32209863f70588d1681973a76b8e3.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_97f32209863f70588d1681973a76b8e3.jpg saved to cache
2026-03-27 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611
2026-03-27 10:33:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611, skipping ID generation
2026-03-27 10:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611 with scrape type 1
2026-03-27 10:33:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611 sending to next pipeline
2026-03-27 10:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611, identifier: HL17570
2026-03-27 10:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611 with identifier: HL17570
2026-03-27 10:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611 with identifier: HL17570
2026-03-27 10:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611 with identifier: HL17570 to the API
2026-03-27 10:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_97f32209863f70588d1681973a76b8e3.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-03-28T16:16:06Z',
'fuel_type': 'petrol',
'id': 'd421f7bd-1b5a-5bd2-9fd9-1bd19eebd611',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL17570',
'listing': 'auction',
'location': 'DE',
'make': 'Citroen',
'model': 'C3',
'odometer': 17192,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611/d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115590,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_8ed9624cd0e4fd33394739892cb23c86.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611/d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111651,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_97f32209863f70588d1681973a76b8e3.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611/d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_1bb9c6b4d95c404e4512b7924c20938c.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611/d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118563,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_b220ff1687d29e5eddc8bac9c0639c09.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611/d421f7bd-1b5a-5bd2-9fd9-1bd19eebd611_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81072,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/8a/268a501677789702aeff149630b184cc/pa/HL17570_e95127602410464d4b0e1cb0b5b426fb.jpg',
'Width': 799}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2025-08-25',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech MAX',
'transmission': 'manual',
'trim': 'MAX',
'year': 2025}
2026-03-27 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL17570%27 HTTP/1.1" 200 None
2026-03-27 10:33:52 [auto1.de] INFO: Saving data for HL17570: {'created_time': 1774607632.140542, 'last_price_update_time': 1774607632.140554, 'auction_closing_time': 1774714566.0}
2026-03-27 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL17570') HTTP/1.1" 204 0
2026-03-27 10:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_08619076bca05d8b934789a7b6d18a83.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf326390>
2026-03-27 10:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_08619076bca05d8b934789a7b6d18a83.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_08619076bca05d8b934789a7b6d18a83.jpg saved to cache
2026-03-27 10:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7a430bd-5867-52e7-bb37-7078639a2673
2026-03-27 10:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MC50567/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_e8aeda0ecca304c675b94cc5a8a8898c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:33:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf41cf90>
2026-03-27 10:33:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_e8aeda0ecca304c675b94cc5a8a8898c.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_e8aeda0ecca304c675b94cc5a8a8898c.jpg saved to cache
2026-03-27 10:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7a430bd-5867-52e7-bb37-7078639a2673
2026-03-27 10:33:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM13070> (referer: https://www.auto1.com/v1/car-details-view/PM13070/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84782f19-aa98-5fdc-97da-0f34e89c699a with identifier: PM13070
2026-03-27 10:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84782f19-aa98-5fdc-97da-0f34e89c699a with scrape type 1
2026-03-27 10:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84782f19-aa98-5fdc-97da-0f34e89c699a
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_5cb68f16e4ad5dbaba523e1ee666fff1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_5cb68f16e4ad5dbaba523e1ee666fff1.jpg not downloaded yet
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_4e98f00ee29fb66c243a78e02461638a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_4e98f00ee29fb66c243a78e02461638a.jpg not downloaded yet
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_cbc831a00c96b6c2a9b3f03507a20265.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_cbc831a00c96b6c2a9b3f03507a20265.jpg not downloaded yet
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_2d554ce0c356aa37792b5596ea8167e9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_2d554ce0c356aa37792b5596ea8167e9.jpg not downloaded yet
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_094aa8ec2a1fb9682b685d778853fba4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_094aa8ec2a1fb9682b685d778853fba4.jpg not downloaded yet
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_6188960c38bb10df0764fcb8ac24705e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_6188960c38bb10df0764fcb8ac24705e.jpg not downloaded yet
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_5e03ea2d7e07e087ade8f6bcee970ce9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_5e03ea2d7e07e087ade8f6bcee970ce9.jpg not downloaded yet
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_06d700e2e4ebe42a54d91919d2ab51fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_06d700e2e4ebe42a54d91919d2ab51fc.jpg not downloaded yet
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_24bc467e2e03ac400e9e11a7de9f2d22.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_24bc467e2e03ac400e9e11a7de9f2d22.jpg not downloaded yet
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_b5cd093cb6d4581da7f2658350d114fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_b5cd093cb6d4581da7f2658350d114fe.jpg not downloaded yet
2026-03-27 10:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB74339/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_b5cd093cb6d4581da7f2658350d114fe.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_24bc467e2e03ac400e9e11a7de9f2d22.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf35afd0>
2026-03-27 10:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_b5cd093cb6d4581da7f2658350d114fe.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_b5cd093cb6d4581da7f2658350d114fe.jpg saved to cache
2026-03-27 10:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84782f19-aa98-5fdc-97da-0f34e89c699a
2026-03-27 10:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be254290>
2026-03-27 10:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_24bc467e2e03ac400e9e11a7de9f2d22.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_24bc467e2e03ac400e9e11a7de9f2d22.jpg saved to cache
2026-03-27 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84782f19-aa98-5fdc-97da-0f34e89c699a
2026-03-27 10:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK69536/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_06d700e2e4ebe42a54d91919d2ab51fc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_5e03ea2d7e07e087ade8f6bcee970ce9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be206850>
2026-03-27 10:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_06d700e2e4ebe42a54d91919d2ab51fc.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_06d700e2e4ebe42a54d91919d2ab51fc.jpg saved to cache
2026-03-27 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84782f19-aa98-5fdc-97da-0f34e89c699a
2026-03-27 10:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be28ba90>
2026-03-27 10:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_5e03ea2d7e07e087ade8f6bcee970ce9.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_5e03ea2d7e07e087ade8f6bcee970ce9.jpg saved to cache
2026-03-27 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84782f19-aa98-5fdc-97da-0f34e89c699a
2026-03-27 10:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP27245/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_6188960c38bb10df0764fcb8ac24705e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be128790>
2026-03-27 10:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_6188960c38bb10df0764fcb8ac24705e.jpg') HTTP/1.1" 204 0
2026-03-27 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_6188960c38bb10df0764fcb8ac24705e.jpg saved to cache
2026-03-27 10:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84782f19-aa98-5fdc-97da-0f34e89c699a
2026-03-27 10:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TL45864> (referer: https://www.auto1.com/v1/car-details-view/TL45864/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:33:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9912a6b1-651e-56a7-ba17-8ee1a975cea1 with identifier: TL45864
2026-03-27 10:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9912a6b1-651e-56a7-ba17-8ee1a975cea1 with scrape type 1
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9912a6b1-651e-56a7-ba17-8ee1a975cea1
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F7d%252Fd07d3ca2df337563ea8ad40e421a28aa%252Fpa%252FTL45864_2c73a3d758d198da9015274efa175dac.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_2c73a3d758d198da9015274efa175dac.jpg already downloaded
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F7d%252Fd07d3ca2df337563ea8ad40e421a28aa%252Fpa%252FTL45864_d2650f7f7f12748602c59e9265a3e272.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_d2650f7f7f12748602c59e9265a3e272.jpg already downloaded
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F7d%252Fd07d3ca2df337563ea8ad40e421a28aa%252Fpa%252FTL45864_a6df075e3192210f37838a77d223c045.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_a6df075e3192210f37838a77d223c045.jpg already downloaded
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F7d%252Fd07d3ca2df337563ea8ad40e421a28aa%252Fpa%252FTL45864_e59ed81a50d1e5f45b8f5848bd087c66.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_e59ed81a50d1e5f45b8f5848bd087c66.jpg already downloaded
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F7d%252Fd07d3ca2df337563ea8ad40e421a28aa%252Fpa%252FTL45864_8df36f2863785dd03e666cca11b372bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_8df36f2863785dd03e666cca11b372bc.jpg already downloaded
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F7d%252Fd07d3ca2df337563ea8ad40e421a28aa%252Fpa%252FTL45864_78ba490954df5706dc913b67101c75c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_78ba490954df5706dc913b67101c75c8.jpg already downloaded
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F7d%252Fd07d3ca2df337563ea8ad40e421a28aa%252Fpa%252FTL45864_b19ecfab1c579fcc21eabc1fa79de8b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_b19ecfab1c579fcc21eabc1fa79de8b2.jpg already downloaded
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F7d%252Fd07d3ca2df337563ea8ad40e421a28aa%252Fpa%252FTL45864_7451a6ed7ba8a22da387c671de420959.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_7451a6ed7ba8a22da387c671de420959.jpg already downloaded
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F7d%252Fd07d3ca2df337563ea8ad40e421a28aa%252Fpa%252FTL45864_8244b3ff1a5a941d09cb8dcaa68b0f13.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_8244b3ff1a5a941d09cb8dcaa68b0f13.jpg already downloaded
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F7d%252Fd07d3ca2df337563ea8ad40e421a28aa%252Fpa%252FTL45864_0e43320c64837af9d56bc6ee0f6173cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_0e43320c64837af9d56bc6ee0f6173cf.jpg already downloaded
2026-03-27 10:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9912a6b1-651e-56a7-ba17-8ee1a975cea1, identifier: TL45864
2026-03-27 10:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9912a6b1-651e-56a7-ba17-8ee1a975cea1 with identifier: TL45864
2026-03-27 10:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9912a6b1-651e-56a7-ba17-8ee1a975cea1 with identifier: TL45864
2026-03-27 10:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9912a6b1-651e-56a7-ba17-8ee1a975cea1 with identifier: TL45864 to the API
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TL45864>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:20:59Z',
'fuel_type': 'petrol',
'id': '9912a6b1-651e-56a7-ba17-8ee1a975cea1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL45864',
'listing': 'auction',
'location': 'DE, Ellerau',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 100299,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_2c73a3d758d198da9015274efa175dac.jpg',
'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_d2650f7f7f12748602c59e9265a3e272.jpg',
'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_a6df075e3192210f37838a77d223c045.jpg',
'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_e59ed81a50d1e5f45b8f5848bd087c66.jpg',
'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_8df36f2863785dd03e666cca11b372bc.jpg',
'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_78ba490954df5706dc913b67101c75c8.jpg',
'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_b19ecfab1c579fcc21eabc1fa79de8b2.jpg',
'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_7451a6ed7ba8a22da387c671de420959.jpg',
'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_8244b3ff1a5a941d09cb8dcaa68b0f13.jpg',
'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_0e43320c64837af9d56bc6ee0f6173cf.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9912a6b1-651e-56a7-ba17-8ee1a975cea1/9912a6b1-651e-56a7-ba17-8ee1a975cea1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70716,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_2c73a3d758d198da9015274efa175dac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9912a6b1-651e-56a7-ba17-8ee1a975cea1/9912a6b1-651e-56a7-ba17-8ee1a975cea1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72485,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_d2650f7f7f12748602c59e9265a3e272.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9912a6b1-651e-56a7-ba17-8ee1a975cea1/9912a6b1-651e-56a7-ba17-8ee1a975cea1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_a6df075e3192210f37838a77d223c045.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9912a6b1-651e-56a7-ba17-8ee1a975cea1/9912a6b1-651e-56a7-ba17-8ee1a975cea1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65287,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_e59ed81a50d1e5f45b8f5848bd087c66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9912a6b1-651e-56a7-ba17-8ee1a975cea1/9912a6b1-651e-56a7-ba17-8ee1a975cea1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67378,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_8df36f2863785dd03e666cca11b372bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9912a6b1-651e-56a7-ba17-8ee1a975cea1/9912a6b1-651e-56a7-ba17-8ee1a975cea1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_78ba490954df5706dc913b67101c75c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9912a6b1-651e-56a7-ba17-8ee1a975cea1/9912a6b1-651e-56a7-ba17-8ee1a975cea1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_b19ecfab1c579fcc21eabc1fa79de8b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9912a6b1-651e-56a7-ba17-8ee1a975cea1/9912a6b1-651e-56a7-ba17-8ee1a975cea1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78709,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_7451a6ed7ba8a22da387c671de420959.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9912a6b1-651e-56a7-ba17-8ee1a975cea1/9912a6b1-651e-56a7-ba17-8ee1a975cea1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66697,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_8244b3ff1a5a941d09cb8dcaa68b0f13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9912a6b1-651e-56a7-ba17-8ee1a975cea1/9912a6b1-651e-56a7-ba17-8ee1a975cea1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77859,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/7d/d07d3ca2df337563ea8ad40e421a28aa/pa/TL45864_0e43320c64837af9d56bc6ee0f6173cf.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.0 TSI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2017}
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL45864%27 HTTP/1.1" 200 None
2026-03-27 10:34:00 [auto1.de] INFO: Saving data for TL45864: {'created_time': 1774607640.727272, 'last_price_update_time': 1774607640.727288, 'auction_closing_time': 1774714859.0}
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL45864') HTTP/1.1" 204 0
2026-03-27 10:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_094aa8ec2a1fb9682b685d778853fba4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH43158> (referer: https://www.auto1.com/v1/car-details-view/KH43158/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_2d554ce0c356aa37792b5596ea8167e9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be01bd10>
2026-03-27 10:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_094aa8ec2a1fb9682b685d778853fba4.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_094aa8ec2a1fb9682b685d778853fba4.jpg saved to cache
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84782f19-aa98-5fdc-97da-0f34e89c699a
2026-03-27 10:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_cbc831a00c96b6c2a9b3f03507a20265.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab with identifier: KH43158
2026-03-27 10:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab with scrape type 1
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_06f03c741c760f5a86662b591fb51a37.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_06f03c741c760f5a86662b591fb51a37.jpg not downloaded yet
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_a4069735567d87cd5080e44a4429d486.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_a4069735567d87cd5080e44a4429d486.jpg not downloaded yet
2026-03-27 10:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_4e98f00ee29fb66c243a78e02461638a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_20760c1c40bf020d72112fd91652ac28.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_20760c1c40bf020d72112fd91652ac28.jpg not downloaded yet
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_d2dd7f22c8fedc9d7648f737c15a7ba1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_d2dd7f22c8fedc9d7648f737c15a7ba1.jpg not downloaded yet
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_6c4d62c48c7ea62c3cde6a871cee920f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_6c4d62c48c7ea62c3cde6a871cee920f.jpg not downloaded yet
2026-03-27 10:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1004d0>
2026-03-27 10:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_2d554ce0c356aa37792b5596ea8167e9.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_2d554ce0c356aa37792b5596ea8167e9.jpg saved to cache
2026-03-27 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84782f19-aa98-5fdc-97da-0f34e89c699a
2026-03-27 10:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_5cb68f16e4ad5dbaba523e1ee666fff1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_f32c62e3a19534d70c9a2b73c6f0db4e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_f32c62e3a19534d70c9a2b73c6f0db4e.jpg not downloaded yet
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_d6b133cdb55f6fd358dcf0d40c391b1d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_d6b133cdb55f6fd358dcf0d40c391b1d.jpg not downloaded yet
2026-03-27 10:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1efa10>
2026-03-27 10:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_cbc831a00c96b6c2a9b3f03507a20265.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_cbc831a00c96b6c2a9b3f03507a20265.jpg saved to cache
2026-03-27 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84782f19-aa98-5fdc-97da-0f34e89c699a
2026-03-27 10:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf599790>
2026-03-27 10:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_4e98f00ee29fb66c243a78e02461638a.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_4e98f00ee29fb66c243a78e02461638a.jpg saved to cache
2026-03-27 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84782f19-aa98-5fdc-97da-0f34e89c699a
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_387531cd9ce10d11bba9b2b977c12947.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_387531cd9ce10d11bba9b2b977c12947.jpg not downloaded yet
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_0618a063e51e6c56590e0b576580960a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_0618a063e51e6c56590e0b576580960a.jpg not downloaded yet
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_c97c8f3933feb90e59a0b003dd460556.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_c97c8f3933feb90e59a0b003dd460556.jpg not downloaded yet
2026-03-27 10:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5887d0>
2026-03-27 10:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fab%252F14ab28ffd9c57de7a2a765eb7cb66ff1%252Fpa%252FPM13070_5cb68f16e4ad5dbaba523e1ee666fff1.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_5cb68f16e4ad5dbaba523e1ee666fff1.jpg saved to cache
2026-03-27 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84782f19-aa98-5fdc-97da-0f34e89c699a
2026-03-27 10:34:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84782f19-aa98-5fdc-97da-0f34e89c699a, skipping ID generation
2026-03-27 10:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84782f19-aa98-5fdc-97da-0f34e89c699a with scrape type 1
2026-03-27 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84782f19-aa98-5fdc-97da-0f34e89c699a sending to next pipeline
2026-03-27 10:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84782f19-aa98-5fdc-97da-0f34e89c699a, identifier: PM13070
2026-03-27 10:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84782f19-aa98-5fdc-97da-0f34e89c699a with identifier: PM13070
2026-03-27 10:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84782f19-aa98-5fdc-97da-0f34e89c699a with identifier: PM13070
2026-03-27 10:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84782f19-aa98-5fdc-97da-0f34e89c699a with identifier: PM13070 to the API
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_5cb68f16e4ad5dbaba523e1ee666fff1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:24:48Z',
'fuel_type': 'petrol',
'id': '84782f19-aa98-5fdc-97da-0f34e89c699a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM13070',
'listing': 'auction',
'location': 'DE, Berlin',
'make': 'Kia',
'model': "cee'd",
'odometer': 60894,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71555,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_5cb68f16e4ad5dbaba523e1ee666fff1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83750,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_4e98f00ee29fb66c243a78e02461638a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_cbc831a00c96b6c2a9b3f03507a20265.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_2d554ce0c356aa37792b5596ea8167e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_094aa8ec2a1fb9682b685d778853fba4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_6188960c38bb10df0764fcb8ac24705e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69722,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_5e03ea2d7e07e087ade8f6bcee970ce9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117806,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_06d700e2e4ebe42a54d91919d2ab51fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71556,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_24bc467e2e03ac400e9e11a7de9f2d22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84782f19-aa98-5fdc-97da-0f34e89c699a/84782f19-aa98-5fdc-97da-0f34e89c699a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/ab/14ab28ffd9c57de7a2a765eb7cb66ff1/pa/PM13070_b5cd093cb6d4581da7f2658350d114fe.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-07-28',
'seats_number': 5,
'seller_name': None,
'title': "Kia cee'd 1.4 UEFA Euro 2016",
'transmission': 'manual',
'trim': 'UEFA Euro 2016',
'year': 2016}
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM13070%27 HTTP/1.1" 200 None
2026-03-27 10:34:01 [auto1.de] INFO: Saving data for PM13070: {'created_time': 1774607641.754233, 'last_price_update_time': 1774607641.754246, 'auction_closing_time': 1774715088.0}
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM13070') HTTP/1.1" 204 0
2026-03-27 10:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_6c4d62c48c7ea62c3cde6a871cee920f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MK74159> (referer: https://www.auto1.com/v1/car-details-view/MK74159/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_a4069735567d87cd5080e44a4429d486.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf497190>
2026-03-27 10:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_6c4d62c48c7ea62c3cde6a871cee920f.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_6c4d62c48c7ea62c3cde6a871cee920f.jpg saved to cache
2026-03-27 10:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab
2026-03-27 10:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_c97c8f3933feb90e59a0b003dd460556.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b328be0f-faf5-54e8-abc9-06a3d8c84d10 with identifier: MK74159
2026-03-27 10:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b328be0f-faf5-54e8-abc9-06a3d8c84d10 with scrape type 1
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b328be0f-faf5-54e8-abc9-06a3d8c84d10
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_bcef0b00e0df32d75df5aee8d2f83de2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_bcef0b00e0df32d75df5aee8d2f83de2.jpg not downloaded yet
2026-03-27 10:34:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf58b350>
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_a4069735567d87cd5080e44a4429d486.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_a4069735567d87cd5080e44a4429d486.jpg saved to cache
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab
2026-03-27 10:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_0618a063e51e6c56590e0b576580960a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_fd9b9f39c349e333f6a569eae321d9e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_fd9b9f39c349e333f6a569eae321d9e1.jpg not downloaded yet
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be032290>
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_c97c8f3933feb90e59a0b003dd460556.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_c97c8f3933feb90e59a0b003dd460556.jpg saved to cache
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_7f82de4639e78f2647000a7410679dc9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_7f82de4639e78f2647000a7410679dc9.jpg not downloaded yet
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_4f51adde7402e9d0af28d1e6684016c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_4f51adde7402e9d0af28d1e6684016c0.jpg not downloaded yet
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_2f49ee4a61dbca0e8a8804606078d630.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_2f49ee4a61dbca0e8a8804606078d630.jpg not downloaded yet
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_d3eda003d87ee3d10d640215410f88c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_d3eda003d87ee3d10d640215410f88c0.jpg not downloaded yet
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be021e10>
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_0618a063e51e6c56590e0b576580960a.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_0618a063e51e6c56590e0b576580960a.jpg saved to cache
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_bd5ba1b7d26d414895fd4d69b240752d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_bd5ba1b7d26d414895fd4d69b240752d.jpg not downloaded yet
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_2068e495a5bbed281a0fe04f5d66cc59.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_2068e495a5bbed281a0fe04f5d66cc59.jpg not downloaded yet
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_5a85cd83e3daf9abb95ffcb3156245f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_5a85cd83e3daf9abb95ffcb3156245f4.jpg not downloaded yet
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_9c7c863fb8d25622ab3fe1082d2b4674.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_9c7c863fb8d25622ab3fe1082d2b4674.jpg not downloaded yet
2026-03-27 10:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_387531cd9ce10d11bba9b2b977c12947.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_d6b133cdb55f6fd358dcf0d40c391b1d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_f32c62e3a19534d70c9a2b73c6f0db4e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_9c7c863fb8d25622ab3fe1082d2b4674.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4761d0>
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_387531cd9ce10d11bba9b2b977c12947.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_387531cd9ce10d11bba9b2b977c12947.jpg saved to cache
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab
2026-03-27 10:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_5a85cd83e3daf9abb95ffcb3156245f4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1c2590>
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_d6b133cdb55f6fd358dcf0d40c391b1d.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_d6b133cdb55f6fd358dcf0d40c391b1d.jpg saved to cache
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab
2026-03-27 10:34:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf59bfd0>
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_f32c62e3a19534d70c9a2b73c6f0db4e.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_f32c62e3a19534d70c9a2b73c6f0db4e.jpg saved to cache
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f2dd0>
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_9c7c863fb8d25622ab3fe1082d2b4674.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_9c7c863fb8d25622ab3fe1082d2b4674.jpg saved to cache
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b328be0f-faf5-54e8-abc9-06a3d8c84d10
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3ee310>
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_5a85cd83e3daf9abb95ffcb3156245f4.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_5a85cd83e3daf9abb95ffcb3156245f4.jpg saved to cache
2026-03-27 10:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b328be0f-faf5-54e8-abc9-06a3d8c84d10
2026-03-27 10:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_2068e495a5bbed281a0fe04f5d66cc59.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_2f49ee4a61dbca0e8a8804606078d630.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_bd5ba1b7d26d414895fd4d69b240752d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be254490>
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_2068e495a5bbed281a0fe04f5d66cc59.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_2068e495a5bbed281a0fe04f5d66cc59.jpg saved to cache
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b328be0f-faf5-54e8-abc9-06a3d8c84d10
2026-03-27 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_d3eda003d87ee3d10d640215410f88c0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_4f51adde7402e9d0af28d1e6684016c0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ96778> (referer: https://www.auto1.com/v1/car-details-view/JZ96778/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be254190>
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_2f49ee4a61dbca0e8a8804606078d630.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_2f49ee4a61dbca0e8a8804606078d630.jpg saved to cache
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b328be0f-faf5-54e8-abc9-06a3d8c84d10
2026-03-27 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_bcef0b00e0df32d75df5aee8d2f83de2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_7f82de4639e78f2647000a7410679dc9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf41d250>
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_bd5ba1b7d26d414895fd4d69b240752d.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_bd5ba1b7d26d414895fd4d69b240752d.jpg saved to cache
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b328be0f-faf5-54e8-abc9-06a3d8c84d10
2026-03-27 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_fd9b9f39c349e333f6a569eae321d9e1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1ba3d0>
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_d3eda003d87ee3d10d640215410f88c0.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_d3eda003d87ee3d10d640215410f88c0.jpg saved to cache
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b328be0f-faf5-54e8-abc9-06a3d8c84d10
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2f2cd0>
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_4f51adde7402e9d0af28d1e6684016c0.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_4f51adde7402e9d0af28d1e6684016c0.jpg saved to cache
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b328be0f-faf5-54e8-abc9-06a3d8c84d10
2026-03-27 10:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ced0e941-4b30-58ce-865e-e5008967fd8f with identifier: JZ96778
2026-03-27 10:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ced0e941-4b30-58ce-865e-e5008967fd8f with scrape type 1
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ced0e941-4b30-58ce-865e-e5008967fd8f
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_0c187a55c5dfc6c3648aff24dce172db.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_0c187a55c5dfc6c3648aff24dce172db.jpg not downloaded yet
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_0951413c78c1ee73762244ea38f699b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_0951413c78c1ee73762244ea38f699b1.jpg not downloaded yet
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_56b621257a4c1a0565bc8ebc92fe32f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_56b621257a4c1a0565bc8ebc92fe32f7.jpg not downloaded yet
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f3510>
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_bcef0b00e0df32d75df5aee8d2f83de2.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_bcef0b00e0df32d75df5aee8d2f83de2.jpg saved to cache
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b328be0f-faf5-54e8-abc9-06a3d8c84d10
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3a78d0>
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_7f82de4639e78f2647000a7410679dc9.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_7f82de4639e78f2647000a7410679dc9.jpg saved to cache
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b328be0f-faf5-54e8-abc9-06a3d8c84d10
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_de5fcb7937895487c4f70388ca18e1b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_de5fcb7937895487c4f70388ca18e1b9.jpg not downloaded yet
2026-03-27 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_fb32b751247152010d5c7b017411b987.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_06f03c741c760f5a86662b591fb51a37.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5bc410>
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F65%252F0a65a2a8f46bf857d1d6fbcbb8449a64%252Fpa%252FMK74159_fd9b9f39c349e333f6a569eae321d9e1.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_fd9b9f39c349e333f6a569eae321d9e1.jpg saved to cache
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b328be0f-faf5-54e8-abc9-06a3d8c84d10
2026-03-27 10:34:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b328be0f-faf5-54e8-abc9-06a3d8c84d10, skipping ID generation
2026-03-27 10:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b328be0f-faf5-54e8-abc9-06a3d8c84d10 with scrape type 1
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b328be0f-faf5-54e8-abc9-06a3d8c84d10 sending to next pipeline
2026-03-27 10:34:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b328be0f-faf5-54e8-abc9-06a3d8c84d10, identifier: MK74159
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_0c8d093db515636f99eaee3d879debe9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_0c8d093db515636f99eaee3d879debe9.jpg not downloaded yet
2026-03-27 10:34:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b328be0f-faf5-54e8-abc9-06a3d8c84d10 with identifier: MK74159
2026-03-27 10:34:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b328be0f-faf5-54e8-abc9-06a3d8c84d10 with identifier: MK74159
2026-03-27 10:34:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b328be0f-faf5-54e8-abc9-06a3d8c84d10 with identifier: MK74159 to the API
2026-03-27 10:34:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_fd9b9f39c349e333f6a569eae321d9e1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 175,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 3',
'engine': '1.8L',
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:11:55Z',
'fuel_type': 'petrol',
'id': 'b328be0f-faf5-54e8-abc9-06a3d8c84d10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK74159',
'listing': 'auction',
'location': 'DE, Aachen',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 194088,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_bcef0b00e0df32d75df5aee8d2f83de2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_fd9b9f39c349e333f6a569eae321d9e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_7f82de4639e78f2647000a7410679dc9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81744,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_4f51adde7402e9d0af28d1e6684016c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_2f49ee4a61dbca0e8a8804606078d630.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73019,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_d3eda003d87ee3d10d640215410f88c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_bd5ba1b7d26d414895fd4d69b240752d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_2068e495a5bbed281a0fe04f5d66cc59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_5a85cd83e3daf9abb95ffcb3156245f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b328be0f-faf5-54e8-abc9-06a3d8c84d10/b328be0f-faf5-54e8-abc9-06a3d8c84d10_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/65/0a65a2a8f46bf857d1d6fbcbb8449a64/pa/MK74159_9c7c863fb8d25622ab3fe1082d2b4674.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2003-08-06',
'seats_number': 4,
'seller_name': None,
'title': 'Toyota RAV 4 1.8 Bblue',
'transmission': 'manual',
'trim': 'Bblue',
'year': 2003}
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK74159%27 HTTP/1.1" 200 None
2026-03-27 10:34:04 [auto1.de] INFO: Saving data for MK74159: {'created_time': 1774607644.142176, 'last_price_update_time': 1774607644.142188, 'auction_closing_time': 1774714315.0}
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK74159') HTTP/1.1" 204 0
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_5d344442315a62ef1b39ccb8e649591d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_5d344442315a62ef1b39ccb8e649591d.jpg not downloaded yet
2026-03-27 10:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f5ed0>
2026-03-27 10:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fc7%252F89c7d16c52752f489b859a4081198d8a%252Fpa%252FWM50806_fb32b751247152010d5c7b017411b987.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_fb32b751247152010d5c7b017411b987.jpg saved to cache
2026-03-27 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f834236-0c7f-557c-9693-c1c9802a73b0
2026-03-27 10:34:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f834236-0c7f-557c-9693-c1c9802a73b0, skipping ID generation
2026-03-27 10:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f834236-0c7f-557c-9693-c1c9802a73b0 with scrape type 1
2026-03-27 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f834236-0c7f-557c-9693-c1c9802a73b0 sending to next pipeline
2026-03-27 10:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f834236-0c7f-557c-9693-c1c9802a73b0, identifier: WM50806
2026-03-27 10:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be28af90>
2026-03-27 10:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_06f03c741c760f5a86662b591fb51a37.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_06f03c741c760f5a86662b591fb51a37.jpg saved to cache
2026-03-27 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab
2026-03-27 10:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f834236-0c7f-557c-9693-c1c9802a73b0 with identifier: WM50806
2026-03-27 10:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f834236-0c7f-557c-9693-c1c9802a73b0 with identifier: WM50806
2026-03-27 10:34:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f834236-0c7f-557c-9693-c1c9802a73b0 with identifier: WM50806 to the API
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_fb32b751247152010d5c7b017411b987.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:12:04Z',
'fuel_type': 'petrol',
'id': '7f834236-0c7f-557c-9693-c1c9802a73b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM50806',
'listing': 'auction',
'location': 'DE, Überherrn',
'make': 'MINI',
'model': 'Countryman',
'odometer': 189207,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79910,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_06292c1dfc3699ed60e1024673d6adf5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_fb32b751247152010d5c7b017411b987.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_9c309c4445876249cee6dc86c8bceabe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_c8250dc6104a599642d995c0f785e983.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75812,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_d7e8b25f3164c1cc5c754dff0798e8f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81676,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_9807036a9c6585047f11f159fd76dd65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71416,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_f247a014924c67a6c41e22c329627218.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_5ab95a540cfea8b488828d9a205358ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_9f5ff665f7a158bfacc99c94b8fe0248.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f834236-0c7f-557c-9693-c1c9802a73b0/7f834236-0c7f-557c-9693-c1c9802a73b0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81499,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/c7/89c7d16c52752f489b859a4081198d8a/pa/WM50806_93e0039802460ffc71ee0e4258fb52c3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman Cooper',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM50806%27 HTTP/1.1" 200 None
2026-03-27 10:34:04 [auto1.de] INFO: Saving data for WM50806: {'created_time': 1774607644.782619, 'last_price_update_time': 1774607644.782631, 'auction_closing_time': 1774714324.0}
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM50806') HTTP/1.1" 204 0
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_a33feb665431bf5c5f3ae14653783ffb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_a33feb665431bf5c5f3ae14653783ffb.jpg not downloaded yet
2026-03-27 10:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_56b621257a4c1a0565bc8ebc92fe32f7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_0951413c78c1ee73762244ea38f699b1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_3336c58a2fc963866646c090d7681903.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_3336c58a2fc963866646c090d7681903.jpg not downloaded yet
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_8d9aba28b36019e748f463d08c8e0ac7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_8d9aba28b36019e748f463d08c8e0ac7.jpg not downloaded yet
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_50ccf9221c7e062c97c80f8e40e3cb37.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_50ccf9221c7e062c97c80f8e40e3cb37.jpg not downloaded yet
2026-03-27 10:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_d2dd7f22c8fedc9d7648f737c15a7ba1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_20760c1c40bf020d72112fd91652ac28.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MC50567> (referer: https://www.auto1.com/v1/car-details-view/MC50567/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be139550>
2026-03-27 10:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_56b621257a4c1a0565bc8ebc92fe32f7.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_56b621257a4c1a0565bc8ebc92fe32f7.jpg saved to cache
2026-03-27 10:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ced0e941-4b30-58ce-865e-e5008967fd8f
2026-03-27 10:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE44691> (referer: https://www.auto1.com/v1/car-details-view/BE44691/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf486d50>
2026-03-27 10:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_0951413c78c1ee73762244ea38f699b1.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_0951413c78c1ee73762244ea38f699b1.jpg saved to cache
2026-03-27 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ced0e941-4b30-58ce-865e-e5008967fd8f
2026-03-27 10:34:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5395690>
2026-03-27 10:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_d2dd7f22c8fedc9d7648f737c15a7ba1.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_d2dd7f22c8fedc9d7648f737c15a7ba1.jpg saved to cache
2026-03-27 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab
2026-03-27 10:34:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf58be90>
2026-03-27 10:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fb5%252Fd1b5d7c5ff41fc0531a2897ea7b0a489%252Fpa%252FKH43158_20760c1c40bf020d72112fd91652ac28.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_20760c1c40bf020d72112fd91652ac28.jpg saved to cache
2026-03-27 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab
2026-03-27 10:34:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab, skipping ID generation
2026-03-27 10:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab with scrape type 1
2026-03-27 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab sending to next pipeline
2026-03-27 10:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab, identifier: KH43158
2026-03-27 10:34:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b504f5ac-fce6-5635-92ee-8eb589c7cdcf with identifier: MC50567
2026-03-27 10:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b504f5ac-fce6-5635-92ee-8eb589c7cdcf with scrape type 1
2026-03-27 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b504f5ac-fce6-5635-92ee-8eb589c7cdcf
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_740e23419ddda2193e01dba0618e6955.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_740e23419ddda2193e01dba0618e6955.jpg not downloaded yet
2026-03-27 10:34:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab with identifier: KH43158
2026-03-27 10:34:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab with identifier: KH43158
2026-03-27 10:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab with identifier: KH43158 to the API
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_20760c1c40bf020d72112fd91652ac28.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:49:53Z',
'fuel_type': 'petrol',
'id': 'be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH43158',
'listing': 'auction',
'location': 'DE, Berlin',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 137838,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83758,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_06f03c741c760f5a86662b591fb51a37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2604399,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_a4069735567d87cd5080e44a4429d486.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2503853,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_20760c1c40bf020d72112fd91652ac28.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2560672,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_d2dd7f22c8fedc9d7648f737c15a7ba1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_6c4d62c48c7ea62c3cde6a871cee920f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2301691,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_f32c62e3a19534d70c9a2b73c6f0db4e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2228906,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_d6b133cdb55f6fd358dcf0d40c391b1d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2536836,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_387531cd9ce10d11bba9b2b977c12947.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_0618a063e51e6c56590e0b576580960a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab/be54cdab-0a2f-5f9c-92d0-44dfc1ebdfab_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57252,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/b5/d1b5d7c5ff41fc0531a2897ea7b0a489/pa/KH43158_c97c8f3933feb90e59a0b003dd460556.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Yeti 1.2 TSI Experience',
'transmission': 'manual',
'trim': 'Experience',
'year': 2011}
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH43158%27 HTTP/1.1" 200 None
2026-03-27 10:34:05 [auto1.de] INFO: Saving data for KH43158: {'created_time': 1774607645.875535, 'last_price_update_time': 1774607645.875546, 'auction_closing_time': 1774716593.0}
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH43158') HTTP/1.1" 204 0
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_88e483149fcdc55661ea713217d5625c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_88e483149fcdc55661ea713217d5625c.jpg not downloaded yet
2026-03-27 10:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_5d344442315a62ef1b39ccb8e649591d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_50ccf9221c7e062c97c80f8e40e3cb37.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_0c8d093db515636f99eaee3d879debe9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe0432bc-4c9b-536f-b039-9859227085e4 with identifier: BE44691
2026-03-27 10:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe0432bc-4c9b-536f-b039-9859227085e4 with scrape type 1
2026-03-27 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fe0432bc-4c9b-536f-b039-9859227085e4
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_64fd9ee188ae7e50669942c6237fadf5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_64fd9ee188ae7e50669942c6237fadf5.jpg not downloaded yet
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_c6245839d024b6b35c9124da2500290f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_c6245839d024b6b35c9124da2500290f.jpg not downloaded yet
2026-03-27 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_4cc99a26c75c56c2677715993eb99f99.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_4cc99a26c75c56c2677715993eb99f99.jpg not downloaded yet
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_a70ea667e4425e6b5bccf1018967ca3e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_a70ea667e4425e6b5bccf1018967ca3e.jpg not downloaded yet
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_d0c85d0ab27d4000ac29cfffb1a1746e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_d0c85d0ab27d4000ac29cfffb1a1746e.jpg not downloaded yet
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_58a79a986b18837eae9827ad96e51234.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_58a79a986b18837eae9827ad96e51234.jpg not downloaded yet
2026-03-27 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_740e23419ddda2193e01dba0618e6955.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_e07ad89fb22f59c7cfcef425374b4273.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_e07ad89fb22f59c7cfcef425374b4273.jpg not downloaded yet
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf35e590>
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_5d344442315a62ef1b39ccb8e649591d.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_5d344442315a62ef1b39ccb8e649591d.jpg saved to cache
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ced0e941-4b30-58ce-865e-e5008967fd8f
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf36f6d0>
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_50ccf9221c7e062c97c80f8e40e3cb37.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_50ccf9221c7e062c97c80f8e40e3cb37.jpg saved to cache
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ced0e941-4b30-58ce-865e-e5008967fd8f
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be20ae90>
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_0c8d093db515636f99eaee3d879debe9.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_0c8d093db515636f99eaee3d879debe9.jpg saved to cache
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ced0e941-4b30-58ce-865e-e5008967fd8f
2026-03-27 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_0c187a55c5dfc6c3648aff24dce172db.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_8d9aba28b36019e748f463d08c8e0ac7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_b861cf1965e7c997c4ff6d1fd90fb880.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_b861cf1965e7c997c4ff6d1fd90fb880.jpg not downloaded yet
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_c675ebef891cfee400765395cd554d2c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_c675ebef891cfee400765395cd554d2c.jpg not downloaded yet
2026-03-27 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_a33feb665431bf5c5f3ae14653783ffb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_3336c58a2fc963866646c090d7681903.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_2a66571bc90825efd145fef7e63603ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_2a66571bc90825efd145fef7e63603ce.jpg not downloaded yet
2026-03-27 10:34:06 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 10488 | hits on page: 40
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be00a550>
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_740e23419ddda2193e01dba0618e6955.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_740e23419ddda2193e01dba0618e6955.jpg saved to cache
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b504f5ac-fce6-5635-92ee-8eb589c7cdcf
2026-03-27 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_de5fcb7937895487c4f70388ca18e1b9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_c6245839d024b6b35c9124da2500290f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_e1e14f2cbbfd03c35cb06c325ffd2fcf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_e1e14f2cbbfd03c35cb06c325ffd2fcf.jpg not downloaded yet
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_ceb7eb39559ba69c131eb01673c80c88.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_ceb7eb39559ba69c131eb01673c80c88.jpg not downloaded yet
2026-03-27 10:34:06 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL45864%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [auto1.de] INFO: Scrape type for TL45864: 0
2026-03-27 10:34:06 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-27 10:34:06 [auto1.de] INFO: Found listing with ID: KH43158
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH43158%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [auto1.de] INFO: Scrape type for KH43158: 0
2026-03-27 10:34:06 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_5b442dd33209287dd7f2c8cf33bb572d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_5b442dd33209287dd7f2c8cf33bb572d.jpg not downloaded yet
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c564a350>
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_0c187a55c5dfc6c3648aff24dce172db.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_0c187a55c5dfc6c3648aff24dce172db.jpg saved to cache
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ced0e941-4b30-58ce-865e-e5008967fd8f
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1d3d10>
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_8d9aba28b36019e748f463d08c8e0ac7.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_8d9aba28b36019e748f463d08c8e0ac7.jpg saved to cache
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ced0e941-4b30-58ce-865e-e5008967fd8f
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_1d04873545d2172eefac2e3a18481f61.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_1d04873545d2172eefac2e3a18481f61.jpg not downloaded yet
2026-03-27 10:34:06 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-27 10:34:06 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM99769%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [auto1.de] INFO: Scrape type for JM99769: 0
2026-03-27 10:34:06 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-27 10:34:06 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-27 10:34:06 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB59587%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [auto1.de] INFO: Scrape type for GB59587: 1
2026-03-27 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_a70ea667e4425e6b5bccf1018967ca3e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_58a79a986b18837eae9827ad96e51234.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_60050309bae57e1ffee0583906218eb7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_60050309bae57e1ffee0583906218eb7.jpg not downloaded yet
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3ac190>
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_a33feb665431bf5c5f3ae14653783ffb.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_a33feb665431bf5c5f3ae14653783ffb.jpg saved to cache
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ced0e941-4b30-58ce-865e-e5008967fd8f
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf554710>
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_3336c58a2fc963866646c090d7681903.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_3336c58a2fc963866646c090d7681903.jpg saved to cache
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ced0e941-4b30-58ce-865e-e5008967fd8f
2026-03-27 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_d0c85d0ab27d4000ac29cfffb1a1746e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_6bd2b425c8d8702418ead4a82dad2697.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_6bd2b425c8d8702418ead4a82dad2697.jpg not downloaded yet
2026-03-27 10:34:06 [auto1.de] INFO: Found listing with ID: WN28352
2026-03-27 10:34:06 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX80624%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [auto1.de] INFO: Scrape type for FX80624: 2
2026-03-27 10:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e24b636-5475-51f6-984d-8436e3a131d2 with identifier: FX80624
2026-03-27 10:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e24b636-5475-51f6-984d-8436e3a131d2 with scrape type 2
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e24b636-5475-51f6-984d-8436e3a131d2 with scrape type 2
2026-03-27 10:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e24b636-5475-51f6-984d-8436e3a131d2, identifier: FX80624
2026-03-27 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_b861cf1965e7c997c4ff6d1fd90fb880.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_e07ad89fb22f59c7cfcef425374b4273.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_c675ebef891cfee400765395cd554d2c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_e6bd92c3b7ed9d90e3e5a3da3e552b34.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_e6bd92c3b7ed9d90e3e5a3da3e552b34.jpg not downloaded yet
2026-03-27 10:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e24b636-5475-51f6-984d-8436e3a131d2 with identifier: FX80624
2026-03-27 10:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e24b636-5475-51f6-984d-8436e3a131d2 with identifier: FX80624
2026-03-27 10:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e24b636-5475-51f6-984d-8436e3a131d2 with identifier: FX80624 to the API
2026-03-27 10:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:11:39Z',
'fuel_type': 'diesel',
'id': '1e24b636-5475-51f6-984d-8436e3a131d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX80624',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 160568,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-04',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2016}
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX80624%27 HTTP/1.1" 200 None
2026-03-27 10:34:07 [auto1.de] INFO: Saving data for FX80624: {'auction_closing_time': 1774714299.0, 'created_time': 1773945872.686088, 'last_price_update_time': 1774607647.176689}
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX80624') HTTP/1.1" 204 0
2026-03-27 10:34:07 [scrapy.extensions.logstats] INFO: Crawled 100 pages (at 47 pages/min), scraped 51 items (at 22 items/min)
2026-03-27 10:34:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 187MiB
2026-03-27 10:34:07 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF42457%27 HTTP/1.1" 200 None
2026-03-27 10:34:07 [auto1.de] INFO: Scrape type for AF42457: 2
2026-03-27 10:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97 with identifier: AF42457
2026-03-27 10:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97 with scrape type 2
2026-03-27 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97 with scrape type 2
2026-03-27 10:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97, identifier: AF42457
2026-03-27 10:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5c1790>
2026-03-27 10:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F37%252Fe2373364da1679240784a82bbf1ef917%252Fpa%252FJZ96778_de5fcb7937895487c4f70388ca18e1b9.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_de5fcb7937895487c4f70388ca18e1b9.jpg saved to cache
2026-03-27 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ced0e941-4b30-58ce-865e-e5008967fd8f
2026-03-27 10:34:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ced0e941-4b30-58ce-865e-e5008967fd8f, skipping ID generation
2026-03-27 10:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ced0e941-4b30-58ce-865e-e5008967fd8f with scrape type 1
2026-03-27 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ced0e941-4b30-58ce-865e-e5008967fd8f sending to next pipeline
2026-03-27 10:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ced0e941-4b30-58ce-865e-e5008967fd8f, identifier: JZ96778
2026-03-27 10:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be12ff90>
2026-03-27 10:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_c6245839d024b6b35c9124da2500290f.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_c6245839d024b6b35c9124da2500290f.jpg saved to cache
2026-03-27 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b504f5ac-fce6-5635-92ee-8eb589c7cdcf
2026-03-27 10:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_5b442dd33209287dd7f2c8cf33bb572d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_4cc99a26c75c56c2677715993eb99f99.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_0b8b69692c90bfc96d52c3f961685ddd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_0b8b69692c90bfc96d52c3f961685ddd.jpg not downloaded yet
2026-03-27 10:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97 with identifier: AF42457
2026-03-27 10:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97 with identifier: AF42457
2026-03-27 10:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97 with identifier: AF42457 to the API
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:35:42Z',
'fuel_type': 'diesel',
'id': '04f8e67c-8a94-5d93-a2fb-ce4f4ddd3d97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF42457',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 269135,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-20',
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI DPF Energy',
'transmission': 'manual',
'trim': 'Energy',
'year': 2014}
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF42457%27 HTTP/1.1" 200 None
2026-03-27 10:34:07 [auto1.de] INFO: Saving data for AF42457: {'auction_closing_time': 1774715742.0, 'created_time': 1774349774.413642, 'last_price_update_time': 1774607647.823358}
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF42457') HTTP/1.1" 204 0
2026-03-27 10:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ced0e941-4b30-58ce-865e-e5008967fd8f with identifier: JZ96778
2026-03-27 10:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ced0e941-4b30-58ce-865e-e5008967fd8f with identifier: JZ96778
2026-03-27 10:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ced0e941-4b30-58ce-865e-e5008967fd8f with identifier: JZ96778 to the API
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_de5fcb7937895487c4f70388ca18e1b9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 189,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '3.0L',
'engine_horse_power': 245,
'expiration_date': '2026-03-28T16:55:40Z',
'fuel_type': 'diesel',
'id': 'ced0e941-4b30-58ce-865e-e5008967fd8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ96778',
'listing': 'auction',
'location': 'DE, Hoyerswerda',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 243132,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_0c187a55c5dfc6c3648aff24dce172db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_0951413c78c1ee73762244ea38f699b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_56b621257a4c1a0565bc8ebc92fe32f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_de5fcb7937895487c4f70388ca18e1b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91771,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_0c8d093db515636f99eaee3d879debe9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80316,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_5d344442315a62ef1b39ccb8e649591d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_a33feb665431bf5c5f3ae14653783ffb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_3336c58a2fc963866646c090d7681903.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_8d9aba28b36019e748f463d08c8e0ac7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced0e941-4b30-58ce-865e-e5008967fd8f/ced0e941-4b30-58ce-865e-e5008967fd8f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/37/e2373364da1679240784a82bbf1ef917/pa/JZ96778_50ccf9221c7e062c97c80f8e40e3cb37.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-06-13',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
'transmission': 'automatic',
'trim': 'BlueMotion',
'year': 2012}
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ96778%27 HTTP/1.1" 200 None
2026-03-27 10:34:08 [auto1.de] INFO: Saving data for JZ96778: {'created_time': 1774607648.338541, 'last_price_update_time': 1774607648.338554, 'auction_closing_time': 1774716940.0}
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ96778') HTTP/1.1" 204 0
2026-03-27 10:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_ceb7eb39559ba69c131eb01673c80c88.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:08 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-27 10:34:08 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-27 10:34:08 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES42650%27 HTTP/1.1" 200 None
2026-03-27 10:34:08 [auto1.de] INFO: Scrape type for ES42650: 2
2026-03-27 10:34:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73380efc-b2b9-51d6-a886-aa1de7481157 with identifier: ES42650
2026-03-27 10:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73380efc-b2b9-51d6-a886-aa1de7481157 with scrape type 2
2026-03-27 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73380efc-b2b9-51d6-a886-aa1de7481157 with scrape type 2
2026-03-27 10:34:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73380efc-b2b9-51d6-a886-aa1de7481157, identifier: ES42650
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c53b1690>
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_a70ea667e4425e6b5bccf1018967ca3e.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_a70ea667e4425e6b5bccf1018967ca3e.jpg saved to cache
2026-03-27 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b504f5ac-fce6-5635-92ee-8eb589c7cdcf
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf44f590>
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_58a79a986b18837eae9827ad96e51234.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_58a79a986b18837eae9827ad96e51234.jpg saved to cache
2026-03-27 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b504f5ac-fce6-5635-92ee-8eb589c7cdcf
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf477110>
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_d0c85d0ab27d4000ac29cfffb1a1746e.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_d0c85d0ab27d4000ac29cfffb1a1746e.jpg saved to cache
2026-03-27 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe0432bc-4c9b-536f-b039-9859227085e4
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be030e90>
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_b861cf1965e7c997c4ff6d1fd90fb880.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_b861cf1965e7c997c4ff6d1fd90fb880.jpg saved to cache
2026-03-27 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b504f5ac-fce6-5635-92ee-8eb589c7cdcf
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf382150>
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_e07ad89fb22f59c7cfcef425374b4273.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_e07ad89fb22f59c7cfcef425374b4273.jpg saved to cache
2026-03-27 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe0432bc-4c9b-536f-b039-9859227085e4
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf44cc50>
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_c675ebef891cfee400765395cd554d2c.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_c675ebef891cfee400765395cd554d2c.jpg saved to cache
2026-03-27 10:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe0432bc-4c9b-536f-b039-9859227085e4
2026-03-27 10:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_1d04873545d2172eefac2e3a18481f61.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73380efc-b2b9-51d6-a886-aa1de7481157 with identifier: ES42650
2026-03-27 10:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73380efc-b2b9-51d6-a886-aa1de7481157 with identifier: ES42650
2026-03-27 10:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73380efc-b2b9-51d6-a886-aa1de7481157 with identifier: ES42650 to the API
2026-03-27 10:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:52:05Z',
'fuel_type': 'petrol',
'id': '73380efc-b2b9-51d6-a886-aa1de7481157',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES42650',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 119463,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-23',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.4 TSI Match',
'transmission': 'manual',
'trim': 'Match',
'year': 2012}
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES42650%27 HTTP/1.1" 200 None
2026-03-27 10:34:09 [auto1.de] INFO: Saving data for ES42650: {'auction_closing_time': 1774716725.0, 'created_time': 1773830834.98912, 'last_price_update_time': 1774607649.147051}
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES42650') HTTP/1.1" 204 0
2026-03-27 10:34:09 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 132.485(s), this was the 1st time calling it.
2026-03-27 10:34:09 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.510032400008101 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_6bd2b425c8d8702418ead4a82dad2697.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:09 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-27 10:34:09 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13561%27 HTTP/1.1" 200 None
2026-03-27 10:34:09 [auto1.de] INFO: Scrape type for EA13561: 1
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3c6d50>
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_5b442dd33209287dd7f2c8cf33bb572d.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_5b442dd33209287dd7f2c8cf33bb572d.jpg saved to cache
2026-03-27 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe0432bc-4c9b-536f-b039-9859227085e4
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf368c10>
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_4cc99a26c75c56c2677715993eb99f99.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_4cc99a26c75c56c2677715993eb99f99.jpg saved to cache
2026-03-27 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe0432bc-4c9b-536f-b039-9859227085e4
2026-03-27 10:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_60050309bae57e1ffee0583906218eb7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be265e10>
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_ceb7eb39559ba69c131eb01673c80c88.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_ceb7eb39559ba69c131eb01673c80c88.jpg saved to cache
2026-03-27 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b504f5ac-fce6-5635-92ee-8eb589c7cdcf
2026-03-27 10:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_e1e14f2cbbfd03c35cb06c325ffd2fcf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_e6bd92c3b7ed9d90e3e5a3da3e552b34.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:09 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-27 10:34:09 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-27 10:34:09 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-27 10:34:09 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-27 10:34:09 [auto1.de] INFO: Found listing with ID: TR96754
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR96754%27 HTTP/1.1" 200 None
2026-03-27 10:34:09 [auto1.de] INFO: Scrape type for TR96754: 1
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be260f50>
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_1d04873545d2172eefac2e3a18481f61.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_1d04873545d2172eefac2e3a18481f61.jpg saved to cache
2026-03-27 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b504f5ac-fce6-5635-92ee-8eb589c7cdcf
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3c51d0>
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_6bd2b425c8d8702418ead4a82dad2697.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_6bd2b425c8d8702418ead4a82dad2697.jpg saved to cache
2026-03-27 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b504f5ac-fce6-5635-92ee-8eb589c7cdcf
2026-03-27 10:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_2a66571bc90825efd145fef7e63603ce.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:09 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH02109%27 HTTP/1.1" 200 None
2026-03-27 10:34:09 [auto1.de] INFO: Scrape type for GH02109: 1
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be105790>
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_60050309bae57e1ffee0583906218eb7.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_60050309bae57e1ffee0583906218eb7.jpg saved to cache
2026-03-27 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe0432bc-4c9b-536f-b039-9859227085e4
2026-03-27 10:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_0b8b69692c90bfc96d52c3f961685ddd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:09 [auto1.de] INFO: Found listing with ID: RP70991
2026-03-27 10:34:09 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89253%27 HTTP/1.1" 200 None
2026-03-27 10:34:09 [auto1.de] INFO: Scrape type for SS89253: 2
2026-03-27 10:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 236cca1f-c6f8-590b-b5ab-ba94fa420791 with identifier: SS89253
2026-03-27 10:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 236cca1f-c6f8-590b-b5ab-ba94fa420791 with scrape type 2
2026-03-27 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 236cca1f-c6f8-590b-b5ab-ba94fa420791 with scrape type 2
2026-03-27 10:34:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 236cca1f-c6f8-590b-b5ab-ba94fa420791, identifier: SS89253
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b1ed0>
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_e1e14f2cbbfd03c35cb06c325ffd2fcf.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_e1e14f2cbbfd03c35cb06c325ffd2fcf.jpg saved to cache
2026-03-27 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe0432bc-4c9b-536f-b039-9859227085e4
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2c4090>
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_e6bd92c3b7ed9d90e3e5a3da3e552b34.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_e6bd92c3b7ed9d90e3e5a3da3e552b34.jpg saved to cache
2026-03-27 10:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fe0432bc-4c9b-536f-b039-9859227085e4
2026-03-27 10:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_64fd9ee188ae7e50669942c6237fadf5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_88e483149fcdc55661ea713217d5625c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 236cca1f-c6f8-590b-b5ab-ba94fa420791 with identifier: SS89253
2026-03-27 10:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 236cca1f-c6f8-590b-b5ab-ba94fa420791 with identifier: SS89253
2026-03-27 10:34:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 236cca1f-c6f8-590b-b5ab-ba94fa420791 with identifier: SS89253 to the API
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-03-28T16:54:17Z',
'fuel_type': 'diesel',
'id': '236cca1f-c6f8-590b-b5ab-ba94fa420791',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS89253',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 103162,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-20',
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Momentum Pro 2WD',
'transmission': 'automatic',
'trim': 'Momentum Pro 2WD',
'year': 2020}
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89253%27 HTTP/1.1" 200 None
2026-03-27 10:34:10 [auto1.de] INFO: Saving data for SS89253: {'auction_closing_time': 1774716857.0, 'created_time': 1773345363.901135, 'last_price_update_time': 1774607650.082944}
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS89253') HTTP/1.1" 204 0
2026-03-27 10:34:10 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-27 10:34:10 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-27 10:34:10 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-27 10:34:10 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN13946%27 HTTP/1.1" 200 None
2026-03-27 10:34:10 [auto1.de] INFO: Scrape type for JN13946: 2
2026-03-27 10:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8 with identifier: JN13946
2026-03-27 10:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8 with scrape type 2
2026-03-27 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8 with scrape type 2
2026-03-27 10:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8, identifier: JN13946
2026-03-27 10:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8 with identifier: JN13946
2026-03-27 10:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8 with identifier: JN13946
2026-03-27 10:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9dd1b142-46ab-5d6d-83d1-f944a52c4dc8 with identifier: JN13946 to the API
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-28T16:05:08Z',
'fuel_type': 'petrol',
'id': '9dd1b142-46ab-5d6d-83d1-f944a52c4dc8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN13946',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 144763,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-10-14',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 Kompressor T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2004}
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN13946%27 HTTP/1.1" 200 None
2026-03-27 10:34:10 [auto1.de] INFO: Saving data for JN13946: {'auction_closing_time': 1774713908.0, 'created_time': 1774002840.940945, 'last_price_update_time': 1774607650.63584}
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN13946') HTTP/1.1" 204 0
2026-03-27 10:34:10 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-27 10:34:10 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS13151%27 HTTP/1.1" 200 None
2026-03-27 10:34:10 [auto1.de] INFO: Scrape type for JS13151: 1
2026-03-27 10:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB74339> (referer: https://www.auto1.com/v1/car-details-view/GB74339/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be23fa90>
2026-03-27 10:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_2a66571bc90825efd145fef7e63603ce.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_2a66571bc90825efd145fef7e63603ce.jpg saved to cache
2026-03-27 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b504f5ac-fce6-5635-92ee-8eb589c7cdcf
2026-03-27 10:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3c4510>
2026-03-27 10:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_0b8b69692c90bfc96d52c3f961685ddd.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_0b8b69692c90bfc96d52c3f961685ddd.jpg saved to cache
2026-03-27 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fe0432bc-4c9b-536f-b039-9859227085e4
2026-03-27 10:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4e3090>
2026-03-27 10:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F41%252F414188e6bc93ea232d11b8c0b6d54852%252Fpa%252FBE44691_64fd9ee188ae7e50669942c6237fadf5.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_64fd9ee188ae7e50669942c6237fadf5.jpg saved to cache
2026-03-27 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe0432bc-4c9b-536f-b039-9859227085e4
2026-03-27 10:34:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe0432bc-4c9b-536f-b039-9859227085e4, skipping ID generation
2026-03-27 10:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe0432bc-4c9b-536f-b039-9859227085e4 with scrape type 1
2026-03-27 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe0432bc-4c9b-536f-b039-9859227085e4 sending to next pipeline
2026-03-27 10:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe0432bc-4c9b-536f-b039-9859227085e4, identifier: BE44691
2026-03-27 10:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2dbdd0>
2026-03-27 10:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fbf%252F66bf7f0da9391f57efc40fe5f626af2f%252Fpa%252FMC50567_88e483149fcdc55661ea713217d5625c.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_88e483149fcdc55661ea713217d5625c.jpg saved to cache
2026-03-27 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b504f5ac-fce6-5635-92ee-8eb589c7cdcf
2026-03-27 10:34:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b504f5ac-fce6-5635-92ee-8eb589c7cdcf, skipping ID generation
2026-03-27 10:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b504f5ac-fce6-5635-92ee-8eb589c7cdcf with scrape type 1
2026-03-27 10:34:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b504f5ac-fce6-5635-92ee-8eb589c7cdcf sending to next pipeline
2026-03-27 10:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b504f5ac-fce6-5635-92ee-8eb589c7cdcf, identifier: MC50567
2026-03-27 10:34:11 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-27 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV56207%27 HTTP/1.1" 200 None
2026-03-27 10:34:11 [auto1.de] INFO: Scrape type for PV56207: 1
2026-03-27 10:34:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS13064> (referer: https://www.auto1.com/v1/car-details-view/YS13064/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW88691> (referer: https://www.auto1.com/v1/car-details-view/YW88691/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe0432bc-4c9b-536f-b039-9859227085e4 with identifier: BE44691
2026-03-27 10:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe0432bc-4c9b-536f-b039-9859227085e4 with identifier: BE44691
2026-03-27 10:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe0432bc-4c9b-536f-b039-9859227085e4 with identifier: BE44691 to the API
2026-03-27 10:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_64fd9ee188ae7e50669942c6237fadf5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:59:38Z',
'fuel_type': 'petrol',
'id': 'fe0432bc-4c9b-536f-b039-9859227085e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE44691',
'listing': 'auction',
'location': 'DE, Saarbrücken',
'make': 'Ford',
'model': 'C-Max',
'odometer': 99478,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_64fd9ee188ae7e50669942c6237fadf5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_4cc99a26c75c56c2677715993eb99f99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76139,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_d0c85d0ab27d4000ac29cfffb1a1746e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67966,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_e07ad89fb22f59c7cfcef425374b4273.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_c675ebef891cfee400765395cd554d2c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_e1e14f2cbbfd03c35cb06c325ffd2fcf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_5b442dd33209287dd7f2c8cf33bb572d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66810,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_60050309bae57e1ffee0583906218eb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69440,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_e6bd92c3b7ed9d90e3e5a3da3e552b34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0432bc-4c9b-536f-b039-9859227085e4/fe0432bc-4c9b-536f-b039-9859227085e4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71425,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/41/414188e6bc93ea232d11b8c0b6d54852/pa/BE44691_0b8b69692c90bfc96d52c3f961685ddd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-05-11',
'seats_number': 5,
'seller_name': None,
'title': 'Ford C-Max 1.5 EcoBoost Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2016}
2026-03-27 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE44691%27 HTTP/1.1" 200 None
2026-03-27 10:34:11 [auto1.de] INFO: Saving data for BE44691: {'created_time': 1774607651.424672, 'last_price_update_time': 1774607651.424684, 'auction_closing_time': 1774717178.0}
2026-03-27 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE44691') HTTP/1.1" 204 0
2026-03-27 10:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b504f5ac-fce6-5635-92ee-8eb589c7cdcf with identifier: MC50567
2026-03-27 10:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b504f5ac-fce6-5635-92ee-8eb589c7cdcf with identifier: MC50567
2026-03-27 10:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b504f5ac-fce6-5635-92ee-8eb589c7cdcf with identifier: MC50567 to the API
2026-03-27 10:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_88e483149fcdc55661ea713217d5625c.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 129,
'expiration_date': '2026-03-28T16:16:45Z',
'fuel_type': 'petrol',
'id': 'b504f5ac-fce6-5635-92ee-8eb589c7cdcf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC50567',
'listing': 'auction',
'location': 'DE, Mannheim',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 22242,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82029,
'Height': 530,
'OriginUrl': 'https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_740e23419ddda2193e01dba0618e6955.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23184,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_88e483149fcdc55661ea713217d5625c.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104957,
'Height': 530,
'OriginUrl': 'https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_c6245839d024b6b35c9124da2500290f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23184,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_a70ea667e4425e6b5bccf1018967ca3e.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23184,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_58a79a986b18837eae9827ad96e51234.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82029,
'Height': 530,
'OriginUrl': 'https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_b861cf1965e7c997c4ff6d1fd90fb880.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23184,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_2a66571bc90825efd145fef7e63603ce.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81404,
'Height': 530,
'OriginUrl': 'https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_ceb7eb39559ba69c131eb01673c80c88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59375,
'Height': 530,
'OriginUrl': 'https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_1d04873545d2172eefac2e3a18481f61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504f5ac-fce6-5635-92ee-8eb589c7cdcf/b504f5ac-fce6-5635-92ee-8eb589c7cdcf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 23184,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/bf/66bf7f0da9391f57efc40fe5f626af2f/pa/MC50567_6bd2b425c8d8702418ead4a82dad2697.jpg',
'Width': 799}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-07-16',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.5 GSE T4 e-Hybrid Longitude FWD',
'transmission': 'automatic',
'trim': 'Longitude FWD',
'year': 2023}
2026-03-27 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC50567%27 HTTP/1.1" 200 None
2026-03-27 10:34:11 [auto1.de] INFO: Saving data for MC50567: {'created_time': 1774607651.843726, 'last_price_update_time': 1774607651.843737, 'auction_closing_time': 1774714605.0}
2026-03-27 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC50567') HTTP/1.1" 204 0
2026-03-27 10:34:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_464ae512817e0f47c30d7692f9c12070.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:11 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-27 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR99181%27 HTTP/1.1" 200 None
2026-03-27 10:34:11 [auto1.de] INFO: Scrape type for WR99181: 1
2026-03-27 10:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK69536> (referer: https://www.auto1.com/v1/car-details-view/ZK69536/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:11 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-27 10:34:11 [auto1.de] INFO: Found listing with ID: VT05460
2026-03-27 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT05460%27 HTTP/1.1" 200 None
2026-03-27 10:34:11 [auto1.de] INFO: Scrape type for VT05460: 2
2026-03-27 10:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3098c60f-f7e5-5f22-92b1-f404aca20a4b with identifier: VT05460
2026-03-27 10:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3098c60f-f7e5-5f22-92b1-f404aca20a4b with scrape type 2
2026-03-27 10:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3098c60f-f7e5-5f22-92b1-f404aca20a4b with scrape type 2
2026-03-27 10:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3098c60f-f7e5-5f22-92b1-f404aca20a4b, identifier: VT05460
2026-03-27 10:34:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d with identifier: GB74339
2026-03-27 10:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d with scrape type 1
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_7f05947ec0c080f4ef36b6a2f7f5f343.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_7f05947ec0c080f4ef36b6a2f7f5f343.jpg not downloaded yet
2026-03-27 10:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1d0c80b-d4ae-5cc4-a782-626d2367a789 with identifier: YS13064
2026-03-27 10:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1d0c80b-d4ae-5cc4-a782-626d2367a789 with scrape type 1
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d1d0c80b-d4ae-5cc4-a782-626d2367a789
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5f%252F335f98e35cc659bff28022e76809c6b0%252Fpa%252FYS13064_b41c6ec8d802feb02ab11af8b9053271.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_b41c6ec8d802feb02ab11af8b9053271.jpg not downloaded yet
2026-03-27 10:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2636e10-6ba9-578c-ada5-3013d96fdaad with identifier: YW88691
2026-03-27 10:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2636e10-6ba9-578c-ada5-3013d96fdaad with scrape type 1
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2636e10-6ba9-578c-ada5-3013d96fdaad
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_e311c87d0b895945583945ef71d58369.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_e311c87d0b895945583945ef71d58369.jpg not downloaded yet
2026-03-27 10:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3098c60f-f7e5-5f22-92b1-f404aca20a4b with identifier: VT05460
2026-03-27 10:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3098c60f-f7e5-5f22-92b1-f404aca20a4b with identifier: VT05460
2026-03-27 10:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3098c60f-f7e5-5f22-92b1-f404aca20a4b with identifier: VT05460 to the API
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:18:40Z',
'fuel_type': 'diesel',
'id': '3098c60f-f7e5-5f22-92b1-f404aca20a4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT05460',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 144641,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-03',
'seller_name': None,
'title': 'Ford Focus 1.5 TDCi Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2015}
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT05460%27 HTTP/1.1" 200 None
2026-03-27 10:34:12 [auto1.de] INFO: Saving data for VT05460: {'auction_closing_time': 1774714720.0, 'created_time': 1774032313.540244, 'last_price_update_time': 1774607652.410609}
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT05460') HTTP/1.1" 204 0
2026-03-27 10:34:12 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV46830%27 HTTP/1.1" 200 None
2026-03-27 10:34:12 [auto1.de] INFO: Scrape type for LV46830: 1
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_696b642a7854b90dae7d8f1058de321f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_696b642a7854b90dae7d8f1058de321f.jpg not downloaded yet
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5f%252F335f98e35cc659bff28022e76809c6b0%252Fpa%252FYS13064_b2a736641fa0a47bf85afe93a63f1b58.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_b2a736641fa0a47bf85afe93a63f1b58.jpg not downloaded yet
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_91aa59e93aaa1bd64cb50b8f08f74986.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_91aa59e93aaa1bd64cb50b8f08f74986.jpg not downloaded yet
2026-03-27 10:34:12 [auto1.de] INFO: Found listing with ID: SJ46577
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ46577%27 HTTP/1.1" 200 None
2026-03-27 10:34:12 [auto1.de] INFO: Scrape type for SJ46577: 1
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_8022c74097d0723835c88e983ce3cc04.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_8022c74097d0723835c88e983ce3cc04.jpg not downloaded yet
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5f%252F335f98e35cc659bff28022e76809c6b0%252Fpa%252FYS13064_9a4419523503aa5501e97830e35b9ecd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_9a4419523503aa5501e97830e35b9ecd.jpg not downloaded yet
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_4333fcf6635963eaea9477ee1a6cc6d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_4333fcf6635963eaea9477ee1a6cc6d7.jpg not downloaded yet
2026-03-27 10:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3c4d50>
2026-03-27 10:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_464ae512817e0f47c30d7692f9c12070.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_464ae512817e0f47c30d7692f9c12070.jpg saved to cache
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7a430bd-5867-52e7-bb37-7078639a2673
2026-03-27 10:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0e5d654-c934-59e0-8631-c7e648c17b03 with identifier: ZK69536
2026-03-27 10:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0e5d654-c934-59e0-8631-c7e648c17b03 with scrape type 1
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0e5d654-c934-59e0-8631-c7e648c17b03
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_8468369c458165147766cef5bc8e3d2e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_8468369c458165147766cef5bc8e3d2e.jpg not downloaded yet
2026-03-27 10:34:12 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-27 10:34:12 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE22716%27 HTTP/1.1" 200 None
2026-03-27 10:34:12 [auto1.de] INFO: Scrape type for FE22716: 2
2026-03-27 10:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19e4b5d2-d01e-5883-9a4c-4d9267968632 with identifier: FE22716
2026-03-27 10:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19e4b5d2-d01e-5883-9a4c-4d9267968632 with scrape type 2
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19e4b5d2-d01e-5883-9a4c-4d9267968632 with scrape type 2
2026-03-27 10:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19e4b5d2-d01e-5883-9a4c-4d9267968632, identifier: FE22716
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_39db3e8dab57656076ffa8a3d27893d9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_39db3e8dab57656076ffa8a3d27893d9.jpg not downloaded yet
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5f%252F335f98e35cc659bff28022e76809c6b0%252Fpa%252FYS13064_ce3c608b8f489722e4200bd494aba8b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_ce3c608b8f489722e4200bd494aba8b0.jpg not downloaded yet
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_c40d41634330ea66055aa08a62e36667.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_c40d41634330ea66055aa08a62e36667.jpg not downloaded yet
2026-03-27 10:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19e4b5d2-d01e-5883-9a4c-4d9267968632 with identifier: FE22716
2026-03-27 10:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19e4b5d2-d01e-5883-9a4c-4d9267968632 with identifier: FE22716
2026-03-27 10:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19e4b5d2-d01e-5883-9a4c-4d9267968632 with identifier: FE22716 to the API
2026-03-27 10:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:34:15Z',
'fuel_type': 'diesel',
'id': '19e4b5d2-d01e-5883-9a4c-4d9267968632',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE22716',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai+2',
'odometer': 218551,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-07',
'seller_name': None,
'title': 'Nissan Qashqai+2 2.0 dCi Acenta 4x4',
'transmission': 'automatic',
'trim': 'Acenta 4x4',
'year': 2012}
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE22716%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [auto1.de] INFO: Saving data for FE22716: {'auction_closing_time': 1774715655.0, 'created_time': 1774032081.666348, 'last_price_update_time': 1774607653.155926}
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE22716') HTTP/1.1" 204 0
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_e927e118b88916560711a6f454aa0be8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_e927e118b88916560711a6f454aa0be8.jpg not downloaded yet
2026-03-27 10:34:13 [auto1.de] INFO: Found listing with ID: VM88719
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM88719%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [auto1.de] INFO: Scrape type for VM88719: 1
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_6bcc0aa6cc05f5f6fc551196899e486e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_6bcc0aa6cc05f5f6fc551196899e486e.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5f%252F335f98e35cc659bff28022e76809c6b0%252Fpa%252FYS13064_6a34b10722f3a0664d2151822363a1a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_6a34b10722f3a0664d2151822363a1a0.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_78a363d97ea2487175d1c04427ddb4dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_78a363d97ea2487175d1c04427ddb4dd.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_5cd2322444577a98dc76e3795a7c0222.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_5cd2322444577a98dc76e3795a7c0222.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_ac311aacdeb153d79bc215c478313513.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_ac311aacdeb153d79bc215c478313513.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_0a984d17813f0479eb41edb6b1f7a755.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_0a984d17813f0479eb41edb6b1f7a755.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_da45aa6c0a53ce7a649b45237fabbae0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_da45aa6c0a53ce7a649b45237fabbae0.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_58782b179469e9e3cfff707ace041a87.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_58782b179469e9e3cfff707ace041a87.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_1653935775a896116793745054ba0824.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_1653935775a896116793745054ba0824.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_1cc49ad3c744ab686ff962ad84a8a124.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_1cc49ad3c744ab686ff962ad84a8a124.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_da0b913709705d0843d80004e0cd6b7d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_da0b913709705d0843d80004e0cd6b7d.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_422e72e217ac01ff8861c13a343162f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_422e72e217ac01ff8861c13a343162f0.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_ca59ce054988815aadd0176ece655771.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_ca59ce054988815aadd0176ece655771.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_e90b0db832b8586c2eeaaa15bf8b93aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_e90b0db832b8586c2eeaaa15bf8b93aa.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_e7a19637928d944dbdf0fd2cbbc61b5f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_e7a19637928d944dbdf0fd2cbbc61b5f.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_0bfa550468fbef543cb885bfe2966bcf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_0bfa550468fbef543cb885bfe2966bcf.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_d44f1e611ac9e649642b919080828807.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_d44f1e611ac9e649642b919080828807.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_b76dac533aed6b216f125bd2cb4c1894.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_b76dac533aed6b216f125bd2cb4c1894.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_06e4bf06e852d287ce16437e03757c43.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_06e4bf06e852d287ce16437e03757c43.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_9b19c8c4017ae6c219e363a837727674.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_9b19c8c4017ae6c219e363a837727674.jpg not downloaded yet
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_4c25d67bb0c634487885cd1c4a555e80.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_4c25d67bb0c634487885cd1c4a555e80.jpg not downloaded yet
2026-03-27 10:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_aa8bb07a3b3ae768d8786d3e762a1ba0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf35fa90>
2026-03-27 10:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F37%252Fb737d8faa1ae0fee375ae8be07063c37%252Fpa%252FYL92844_aa8bb07a3b3ae768d8786d3e762a1ba0.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_aa8bb07a3b3ae768d8786d3e762a1ba0.jpg saved to cache
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7a430bd-5867-52e7-bb37-7078639a2673
2026-03-27 10:34:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7a430bd-5867-52e7-bb37-7078639a2673, skipping ID generation
2026-03-27 10:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7a430bd-5867-52e7-bb37-7078639a2673 with scrape type 1
2026-03-27 10:34:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7a430bd-5867-52e7-bb37-7078639a2673 sending to next pipeline
2026-03-27 10:34:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7a430bd-5867-52e7-bb37-7078639a2673, identifier: YL92844
2026-03-27 10:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7a430bd-5867-52e7-bb37-7078639a2673 with identifier: YL92844
2026-03-27 10:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7a430bd-5867-52e7-bb37-7078639a2673 with identifier: YL92844
2026-03-27 10:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7a430bd-5867-52e7-bb37-7078639a2673 with identifier: YL92844 to the API
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_aa8bb07a3b3ae768d8786d3e762a1ba0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 60,
'expiration_date': '2026-03-28T16:24:40Z',
'fuel_type': 'petrol',
'id': 'c7a430bd-5867-52e7-bb37-7078639a2673',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL92844',
'listing': 'auction',
'location': 'DE, Laatzen',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 46532,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2670680,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_44c42876497317aea5d2664b567efce3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_8ad3730a73f63033c61d8464a061e803.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2853092,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_aa8bb07a3b3ae768d8786d3e762a1ba0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_464ae512817e0f47c30d7692f9c12070.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2769382,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_e8aeda0ecca304c675b94cc5a8a8898c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2823167,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_08619076bca05d8b934789a7b6d18a83.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2922975,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_86f5e36d3a5082e554f5dde04c67b715.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_e284e411b510476cd0c1f846982936d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2743852,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_3514f2f00c1f292ffcf4b240f368731f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7a430bd-5867-52e7-bb37-7078639a2673/c7a430bd-5867-52e7-bb37-7078639a2673_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3196676,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/37/b737d8faa1ae0fee375ae8be07063c37/pa/YL92844_8b447d8803686602ee5da7a5382305c6.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-07-14',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2014}
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL92844%27 HTTP/1.1" 200 None
2026-03-27 10:34:14 [auto1.de] INFO: Saving data for YL92844: {'created_time': 1774607654.392144, 'last_price_update_time': 1774607654.392157, 'auction_closing_time': 1774715080.0}
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL92844') HTTP/1.1" 204 0
2026-03-27 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_4c25d67bb0c634487885cd1c4a555e80.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA13561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB59587/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP27245> (referer: https://www.auto1.com/v1/car-details-view/KP27245/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4f8fd0>
2026-03-27 10:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_4c25d67bb0c634487885cd1c4a555e80.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_4c25d67bb0c634487885cd1c4a555e80.jpg saved to cache
2026-03-27 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0e5d654-c934-59e0-8631-c7e648c17b03
2026-03-27 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DW23670> (referer: https://www.auto1.com/v1/car-details-view/DW23670/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:14 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 10488 | hits on page: 40
2026-03-27 10:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612708e7-8aa9-5dc5-a611-84b01b85751b with identifier: KP27245
2026-03-27 10:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612708e7-8aa9-5dc5-a611-84b01b85751b with scrape type 1
2026-03-27 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 612708e7-8aa9-5dc5-a611-84b01b85751b
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_7265448cee89d26f28be5f9751a52346.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_7265448cee89d26f28be5f9751a52346.jpg not downloaded yet
2026-03-27 10:34:14 [auto1.de] INFO: Found listing with ID: BB84550
2026-03-27 10:34:14 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-27 10:34:14 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-27 10:34:14 [auto1.de] INFO: Found listing with ID: YV97613
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV97613%27 HTTP/1.1" 200 None
2026-03-27 10:34:14 [auto1.de] INFO: Scrape type for YV97613: 1
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_4bde3a83539d3c79a26c49667dd5dd7e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_4bde3a83539d3c79a26c49667dd5dd7e.jpg not downloaded yet
2026-03-27 10:34:14 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT90816%27 HTTP/1.1" 200 None
2026-03-27 10:34:14 [auto1.de] INFO: Scrape type for PT90816: 1
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_552ea78dc1fc6763d2cb1a24755d0aed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_552ea78dc1fc6763d2cb1a24755d0aed.jpg not downloaded yet
2026-03-27 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_d44f1e611ac9e649642b919080828807.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:14 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-27 10:34:14 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY33610%27 HTTP/1.1" 200 None
2026-03-27 10:34:14 [auto1.de] INFO: Scrape type for JY33610: 1
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_ab9a847cc4677535256a47d1832f3232.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_ab9a847cc4677535256a47d1832f3232.jpg not downloaded yet
2026-03-27 10:34:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09229703-dce0-55c9-9182-c8b672313250 with identifier: DW23670
2026-03-27 10:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09229703-dce0-55c9-9182-c8b672313250 with scrape type 1
2026-03-27 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09229703-dce0-55c9-9182-c8b672313250
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_31128fa4287ccf2a5309685d9a467bcf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_31128fa4287ccf2a5309685d9a467bcf.jpg not downloaded yet
2026-03-27 10:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_b76dac533aed6b216f125bd2cb4c1894.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:14 [auto1.de] INFO: Found listing with ID: ZC71941
2026-03-27 10:34:14 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW75956%27 HTTP/1.1" 200 None
2026-03-27 10:34:14 [auto1.de] INFO: Scrape type for DW75956: 2
2026-03-27 10:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a090868e-41c7-51ba-ab0d-3328efc78207 with identifier: DW75956
2026-03-27 10:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a090868e-41c7-51ba-ab0d-3328efc78207 with scrape type 2
2026-03-27 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a090868e-41c7-51ba-ab0d-3328efc78207 with scrape type 2
2026-03-27 10:34:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a090868e-41c7-51ba-ab0d-3328efc78207, identifier: DW75956
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_0db31468e32344435587f1de1860db7c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_0db31468e32344435587f1de1860db7c.jpg not downloaded yet
2026-03-27 10:34:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a090868e-41c7-51ba-ab0d-3328efc78207 with identifier: DW75956
2026-03-27 10:34:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a090868e-41c7-51ba-ab0d-3328efc78207 with identifier: DW75956
2026-03-27 10:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a090868e-41c7-51ba-ab0d-3328efc78207 with identifier: DW75956 to the API
2026-03-27 10:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:59:54Z',
'fuel_type': 'diesel',
'id': 'a090868e-41c7-51ba-ab0d-3328efc78207',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW75956',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 138817,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-01',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 CDI Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2016}
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW75956%27 HTTP/1.1" 200 None
2026-03-27 10:34:15 [auto1.de] INFO: Saving data for DW75956: {'auction_closing_time': 1774717194.0, 'created_time': 1773226019.331426, 'last_price_update_time': 1774607655.237086}
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW75956') HTTP/1.1" 204 0
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_c4425ac685e85584ac13ae71c26afa6a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_c4425ac685e85584ac13ae71c26afa6a.jpg not downloaded yet
2026-03-27 10:34:15 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-27 10:34:15 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-27 10:34:15 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-27 10:34:15 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT94626%27 HTTP/1.1" 200 None
2026-03-27 10:34:15 [auto1.de] INFO: Scrape type for JT94626: 1
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_2b6b4db7d29c1ff06ad8ba5c3c3ec7c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_2b6b4db7d29c1ff06ad8ba5c3c3ec7c8.jpg not downloaded yet
2026-03-27 10:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_e7a19637928d944dbdf0fd2cbbc61b5f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_27e17802010d2cf3830db27d9726c7b7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_27e17802010d2cf3830db27d9726c7b7.jpg not downloaded yet
2026-03-27 10:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56d3be6e90>
2026-03-27 10:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_d44f1e611ac9e649642b919080828807.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_d44f1e611ac9e649642b919080828807.jpg saved to cache
2026-03-27 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d
2026-03-27 10:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf389290>
2026-03-27 10:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_b76dac533aed6b216f125bd2cb4c1894.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_b76dac533aed6b216f125bd2cb4c1894.jpg saved to cache
2026-03-27 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2636e10-6ba9-578c-ada5-3013d96fdaad
2026-03-27 10:34:15 [auto1.de] INFO: Found listing with ID: XK99060
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK99060%27 HTTP/1.1" 200 None
2026-03-27 10:34:15 [auto1.de] INFO: Scrape type for XK99060: 1
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_b70d8abdb9567a218d0d343594aeda6e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_b70d8abdb9567a218d0d343594aeda6e.jpg not downloaded yet
2026-03-27 10:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_ab9a847cc4677535256a47d1832f3232.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_fed3abf6b3bdf8b3bb31abd7ad057c51.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_fed3abf6b3bdf8b3bb31abd7ad057c51.jpg not downloaded yet
2026-03-27 10:34:15 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-27 10:34:15 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-27 10:34:15 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA10285%27 HTTP/1.1" 200 None
2026-03-27 10:34:15 [auto1.de] INFO: Scrape type for SA10285: 1
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_f03c4685bb07cba3d5516676a99a91be.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_f03c4685bb07cba3d5516676a99a91be.jpg not downloaded yet
2026-03-27 10:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be196510>
2026-03-27 10:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_e7a19637928d944dbdf0fd2cbbc61b5f.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_e7a19637928d944dbdf0fd2cbbc61b5f.jpg saved to cache
2026-03-27 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2636e10-6ba9-578c-ada5-3013d96fdaad
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_8d3551973abaceeac87a0cef17309453.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_8d3551973abaceeac87a0cef17309453.jpg not downloaded yet
2026-03-27 10:34:15 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-27 10:34:15 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN90928%27 HTTP/1.1" 200 None
2026-03-27 10:34:15 [auto1.de] INFO: Scrape type for EN90928: 2
2026-03-27 10:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1156df4f-c722-5115-9af4-73ce3228f788 with identifier: EN90928
2026-03-27 10:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1156df4f-c722-5115-9af4-73ce3228f788 with scrape type 2
2026-03-27 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1156df4f-c722-5115-9af4-73ce3228f788 with scrape type 2
2026-03-27 10:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1156df4f-c722-5115-9af4-73ce3228f788, identifier: EN90928
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_a3b7767869b76e01bd2b3b4bb5c3c6d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_a3b7767869b76e01bd2b3b4bb5c3c6d1.jpg not downloaded yet
2026-03-27 10:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_c4425ac685e85584ac13ae71c26afa6a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1156df4f-c722-5115-9af4-73ce3228f788 with identifier: EN90928
2026-03-27 10:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1156df4f-c722-5115-9af4-73ce3228f788 with identifier: EN90928
2026-03-27 10:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1156df4f-c722-5115-9af4-73ce3228f788 with identifier: EN90928 to the API
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:33:21Z',
'fuel_type': 'diesel',
'id': '1156df4f-c722-5115-9af4-73ce3228f788',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN90928',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 96705,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-26',
'seller_name': None,
'title': 'BMW 3er 320d Mild-Hybrid M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2021}
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN90928%27 HTTP/1.1" 200 None
2026-03-27 10:34:16 [auto1.de] INFO: Saving data for EN90928: {'auction_closing_time': 1774715601.0, 'created_time': 1774034104.837985, 'last_price_update_time': 1774607656.098644}
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN90928') HTTP/1.1" 204 0
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_9c1bf622162537882e7a101ac7070372.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_9c1bf622162537882e7a101ac7070372.jpg not downloaded yet
2026-03-27 10:34:16 [auto1.de] INFO: Found listing with ID: LA44092
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA44092%27 HTTP/1.1" 200 None
2026-03-27 10:34:16 [auto1.de] INFO: Scrape type for LA44092: 1
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_a4df40570268975a93ee414928185b68.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_a4df40570268975a93ee414928185b68.jpg not downloaded yet
2026-03-27 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_b70d8abdb9567a218d0d343594aeda6e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_6a705df4f54d62fa5fcd4591b8a651f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_6a705df4f54d62fa5fcd4591b8a651f4.jpg not downloaded yet
2026-03-27 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AE12757/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:16 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL12737%27 HTTP/1.1" 200 None
2026-03-27 10:34:16 [auto1.de] INFO: Scrape type for JL12737: 1
2026-03-27 10:34:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR96754/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH02109/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC61336/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS13151/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0134d0>
2026-03-27 10:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_ab9a847cc4677535256a47d1832f3232.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_ab9a847cc4677535256a47d1832f3232.jpg saved to cache
2026-03-27 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 612708e7-8aa9-5dc5-a611-84b01b85751b
2026-03-27 10:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be13ac10>
2026-03-27 10:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_c4425ac685e85584ac13ae71c26afa6a.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_c4425ac685e85584ac13ae71c26afa6a.jpg saved to cache
2026-03-27 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09229703-dce0-55c9-9182-c8b672313250
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_00c824f8d13b5d37d359856a87cbe96e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_00c824f8d13b5d37d359856a87cbe96e.jpg not downloaded yet
2026-03-27 10:34:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:16 [auto1.de] INFO: Found listing with ID: GL18465
2026-03-27 10:34:16 [auto1.de] INFO: Found listing with ID: AX51342
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX51342%27 HTTP/1.1" 200 None
2026-03-27 10:34:16 [auto1.de] INFO: Scrape type for AX51342: 1
2026-03-27 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_8d3551973abaceeac87a0cef17309453.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_aa83f3e5c29a72db24e2b625bcfcb115.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_aa83f3e5c29a72db24e2b625bcfcb115.jpg not downloaded yet
2026-03-27 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM63340> (referer: https://www.auto1.com/v1/car-details-view/EM63340/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be022710>
2026-03-27 10:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_b70d8abdb9567a218d0d343594aeda6e.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_b70d8abdb9567a218d0d343594aeda6e.jpg saved to cache
2026-03-27 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 612708e7-8aa9-5dc5-a611-84b01b85751b
2026-03-27 10:34:16 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ55484%27 HTTP/1.1" 200 None
2026-03-27 10:34:16 [auto1.de] INFO: Scrape type for HJ55484: 2
2026-03-27 10:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a4352be-c350-58e6-a2e7-0dd00772eb46 with identifier: HJ55484
2026-03-27 10:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a4352be-c350-58e6-a2e7-0dd00772eb46 with scrape type 2
2026-03-27 10:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a4352be-c350-58e6-a2e7-0dd00772eb46 with scrape type 2
2026-03-27 10:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a4352be-c350-58e6-a2e7-0dd00772eb46, identifier: HJ55484
2026-03-27 10:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_0bfa550468fbef543cb885bfe2966bcf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a4352be-c350-58e6-a2e7-0dd00772eb46 with identifier: HJ55484
2026-03-27 10:34:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a4352be-c350-58e6-a2e7-0dd00772eb46 with identifier: HJ55484
2026-03-27 10:34:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a4352be-c350-58e6-a2e7-0dd00772eb46 with identifier: HJ55484 to the API
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:39:53Z',
'fuel_type': 'diesel',
'id': '2a4352be-c350-58e6-a2e7-0dd00772eb46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ55484',
'listing': 'auction',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 283137,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-16',
'seller_name': None,
'title': 'Skoda Karoq 2.0 TDI Style 4x4',
'transmission': 'manual',
'trim': 'Style 4x4',
'year': 2019}
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ55484%27 HTTP/1.1" 200 None
2026-03-27 10:34:17 [auto1.de] INFO: Saving data for HJ55484: {'auction_closing_time': 1774715993.0, 'created_time': 1774350130.575712, 'last_price_update_time': 1774607657.013252}
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ55484') HTTP/1.1" 204 0
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_872d195b0e5cf6d23d8cecc05247708b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_872d195b0e5cf6d23d8cecc05247708b.jpg not downloaded yet
2026-03-27 10:34:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_6a705df4f54d62fa5fcd4591b8a651f4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:17 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-27 10:34:17 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW22662%27 HTTP/1.1" 200 None
2026-03-27 10:34:17 [auto1.de] INFO: Scrape type for MW22662: 1
2026-03-27 10:34:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_a4df40570268975a93ee414928185b68.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_9c1bf622162537882e7a101ac7070372.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_a3b7767869b76e01bd2b3b4bb5c3c6d1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:17 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69443%27 HTTP/1.1" 200 None
2026-03-27 10:34:17 [auto1.de] INFO: Scrape type for HB69443: 1
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2202d0>
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_8d3551973abaceeac87a0cef17309453.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_8d3551973abaceeac87a0cef17309453.jpg saved to cache
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09229703-dce0-55c9-9182-c8b672313250
2026-03-27 10:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68f83d7a-9e20-5a0f-ade1-0a60276be417 with identifier: EM63340
2026-03-27 10:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68f83d7a-9e20-5a0f-ade1-0a60276be417 with scrape type 1
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68f83d7a-9e20-5a0f-ade1-0a60276be417
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_edbb89c99b38dc55bcb82a9f1d95556a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_edbb89c99b38dc55bcb82a9f1d95556a.jpg not downloaded yet
2026-03-27 10:34:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be035450>
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_0bfa550468fbef543cb885bfe2966bcf.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_0bfa550468fbef543cb885bfe2966bcf.jpg saved to cache
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0e5d654-c934-59e0-8631-c7e648c17b03
2026-03-27 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_06e4bf06e852d287ce16437e03757c43.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:17 [auto1.de] INFO: Found listing with ID: MV22283
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV22283%27 HTTP/1.1" 200 None
2026-03-27 10:34:17 [auto1.de] INFO: Scrape type for MV22283: 1
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_1b5ea1e728b40a357be51be96c97e704.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_1b5ea1e728b40a357be51be96c97e704.jpg not downloaded yet
2026-03-27 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_9b19c8c4017ae6c219e363a837727674.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_00c824f8d13b5d37d359856a87cbe96e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2eadd0>
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_6a705df4f54d62fa5fcd4591b8a651f4.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_6a705df4f54d62fa5fcd4591b8a651f4.jpg saved to cache
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09229703-dce0-55c9-9182-c8b672313250
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3ec6d0>
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_a4df40570268975a93ee414928185b68.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_a4df40570268975a93ee414928185b68.jpg saved to cache
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 612708e7-8aa9-5dc5-a611-84b01b85751b
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2ecad0>
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_9c1bf622162537882e7a101ac7070372.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_9c1bf622162537882e7a101ac7070372.jpg saved to cache
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09229703-dce0-55c9-9182-c8b672313250
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2bb290>
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_a3b7767869b76e01bd2b3b4bb5c3c6d1.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_a3b7767869b76e01bd2b3b4bb5c3c6d1.jpg saved to cache
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 612708e7-8aa9-5dc5-a611-84b01b85751b
2026-03-27 10:34:17 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-27 10:34:17 [auto1.de] INFO: Found listing with ID: WT41205
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT41205%27 HTTP/1.1" 200 None
2026-03-27 10:34:17 [auto1.de] INFO: Scrape type for WT41205: 1
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_c9007eabc837b4dbcb1a159435938bd3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_c9007eabc837b4dbcb1a159435938bd3.jpg not downloaded yet
2026-03-27 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_872d195b0e5cf6d23d8cecc05247708b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PV56207/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:17 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-27 10:34:17 [auto1.de] INFO: Found listing with ID: DA44697
2026-03-27 10:34:17 [auto1.de] INFO: Found listing with ID: NL59666
2026-03-27 10:34:17 [auto1.de] INFO: Found listing with ID: MN72943
2026-03-27 10:34:17 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU24928%27 HTTP/1.1" 200 None
2026-03-27 10:34:17 [auto1.de] INFO: Scrape type for AU24928: 2
2026-03-27 10:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5e13eef-5664-50f8-bdfc-5969f3249f90 with identifier: AU24928
2026-03-27 10:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5e13eef-5664-50f8-bdfc-5969f3249f90 with scrape type 2
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5e13eef-5664-50f8-bdfc-5969f3249f90 with scrape type 2
2026-03-27 10:34:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5e13eef-5664-50f8-bdfc-5969f3249f90, identifier: AU24928
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_beee3676ebfcd99f1a6f7ce0bd0be648.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_beee3676ebfcd99f1a6f7ce0bd0be648.jpg not downloaded yet
2026-03-27 10:34:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5e13eef-5664-50f8-bdfc-5969f3249f90 with identifier: AU24928
2026-03-27 10:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5e13eef-5664-50f8-bdfc-5969f3249f90 with identifier: AU24928
2026-03-27 10:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5e13eef-5664-50f8-bdfc-5969f3249f90 with identifier: AU24928 to the API
2026-03-27 10:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:36:58Z',
'fuel_type': 'petrol',
'id': 'a5e13eef-5664-50f8-bdfc-5969f3249f90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU24928',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 132756,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-20',
'seller_name': None,
'title': 'Volkswagen Caddy 1.4 TSI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2017}
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU24928%27 HTTP/1.1" 200 None
2026-03-27 10:34:18 [auto1.de] INFO: Saving data for AU24928: {'auction_closing_time': 1774715818.0, 'created_time': 1773466810.388461, 'last_price_update_time': 1774607658.187856}
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU24928') HTTP/1.1" 204 0
2026-03-27 10:34:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf47b290>
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_06e4bf06e852d287ce16437e03757c43.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_06e4bf06e852d287ce16437e03757c43.jpg saved to cache
2026-03-27 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0e5d654-c934-59e0-8631-c7e648c17b03
2026-03-27 10:34:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5395b90>
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_9b19c8c4017ae6c219e363a837727674.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_9b19c8c4017ae6c219e363a837727674.jpg saved to cache
2026-03-27 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0e5d654-c934-59e0-8631-c7e648c17b03
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1c1490>
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_00c824f8d13b5d37d359856a87cbe96e.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_00c824f8d13b5d37d359856a87cbe96e.jpg saved to cache
2026-03-27 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09229703-dce0-55c9-9182-c8b672313250
2026-03-27 10:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_edbb89c99b38dc55bcb82a9f1d95556a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:18 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK59777%27 HTTP/1.1" 200 None
2026-03-27 10:34:18 [auto1.de] INFO: Scrape type for BK59777: 1
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_06c276417b29415778338ea82ee47908.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_06c276417b29415778338ea82ee47908.jpg not downloaded yet
2026-03-27 10:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS13151> (referer: https://www.auto1.com/v1/car-details-view/JS13151/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH02109> (referer: https://www.auto1.com/v1/car-details-view/GH02109/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2a84d0>
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_872d195b0e5cf6d23d8cecc05247708b.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_872d195b0e5cf6d23d8cecc05247708b.jpg saved to cache
2026-03-27 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09229703-dce0-55c9-9182-c8b672313250
2026-03-27 10:34:18 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB09525%27 HTTP/1.1" 200 None
2026-03-27 10:34:18 [auto1.de] INFO: Scrape type for FB09525: 1
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_85ecde1aba9872ef39388794c58302a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_85ecde1aba9872ef39388794c58302a4.jpg not downloaded yet
2026-03-27 10:34:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA44092/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WR99181/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:18 [auto1.de] INFO: Found listing with ID: NL50541
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL50541%27 HTTP/1.1" 200 None
2026-03-27 10:34:18 [auto1.de] INFO: Scrape type for NL50541: 1
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_55db09adbde689503d045bd0ba50116b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_55db09adbde689503d045bd0ba50116b.jpg not downloaded yet
2026-03-27 10:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_1b5ea1e728b40a357be51be96c97e704.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:18 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB87355%27 HTTP/1.1" 200 None
2026-03-27 10:34:18 [auto1.de] INFO: Scrape type for AB87355: 2
2026-03-27 10:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 682cc8fc-7570-5a7c-80e9-f8a66b55e40c with identifier: AB87355
2026-03-27 10:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 682cc8fc-7570-5a7c-80e9-f8a66b55e40c with scrape type 2
2026-03-27 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 682cc8fc-7570-5a7c-80e9-f8a66b55e40c with scrape type 2
2026-03-27 10:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 682cc8fc-7570-5a7c-80e9-f8a66b55e40c, identifier: AB87355
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_f039f4c8d4477e0ef6bbadc09dc915cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_f039f4c8d4477e0ef6bbadc09dc915cf.jpg not downloaded yet
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be29c610>
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_edbb89c99b38dc55bcb82a9f1d95556a.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_edbb89c99b38dc55bcb82a9f1d95556a.jpg saved to cache
2026-03-27 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68f83d7a-9e20-5a0f-ade1-0a60276be417
2026-03-27 10:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 682cc8fc-7570-5a7c-80e9-f8a66b55e40c with identifier: AB87355
2026-03-27 10:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 682cc8fc-7570-5a7c-80e9-f8a66b55e40c with identifier: AB87355
2026-03-27 10:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 682cc8fc-7570-5a7c-80e9-f8a66b55e40c with identifier: AB87355 to the API
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:49:03Z',
'fuel_type': 'diesel',
'id': '682cc8fc-7570-5a7c-80e9-f8a66b55e40c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB87355',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 135653,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-31',
'seller_name': None,
'title': 'Nissan Qashqai 1.7 dCi Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2020}
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB87355%27 HTTP/1.1" 200 None
2026-03-27 10:34:19 [auto1.de] INFO: Saving data for AB87355: {'auction_closing_time': 1774716543.0, 'created_time': 1773135611.397026, 'last_price_update_time': 1774607659.336139}
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB87355') HTTP/1.1" 204 0
2026-03-27 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC61336> (referer: https://www.auto1.com/v1/car-details-view/NC61336/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_c9007eabc837b4dbcb1a159435938bd3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_beee3676ebfcd99f1a6f7ce0bd0be648.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:19 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68666%27 HTTP/1.1" 200 None
2026-03-27 10:34:19 [auto1.de] INFO: Scrape type for NX68666: 2
2026-03-27 10:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0edef07e-dd48-59ca-bd0d-b906c2156b4e with identifier: NX68666
2026-03-27 10:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0edef07e-dd48-59ca-bd0d-b906c2156b4e with scrape type 2
2026-03-27 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0edef07e-dd48-59ca-bd0d-b906c2156b4e with scrape type 2
2026-03-27 10:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0edef07e-dd48-59ca-bd0d-b906c2156b4e, identifier: NX68666
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_f437c7308d152514924951a15484c5ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_f437c7308d152514924951a15484c5ec.jpg not downloaded yet
2026-03-27 10:34:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_06c276417b29415778338ea82ee47908.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0edef07e-dd48-59ca-bd0d-b906c2156b4e with identifier: NX68666
2026-03-27 10:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0edef07e-dd48-59ca-bd0d-b906c2156b4e with identifier: NX68666
2026-03-27 10:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0edef07e-dd48-59ca-bd0d-b906c2156b4e with identifier: NX68666 to the API
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:41:55Z',
'fuel_type': 'diesel',
'id': '0edef07e-dd48-59ca-bd0d-b906c2156b4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX68666',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 257580,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-03',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2014}
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68666%27 HTTP/1.1" 200 None
2026-03-27 10:34:19 [auto1.de] INFO: Saving data for NX68666: {'auction_closing_time': 1774716115.0, 'created_time': 1773306693.534233, 'last_price_update_time': 1774607659.812058}
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX68666') HTTP/1.1" 204 0
2026-03-27 10:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d42e471d-29d6-5e33-9d9d-5152535fa1a9 with identifier: JS13151
2026-03-27 10:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d42e471d-29d6-5e33-9d9d-5152535fa1a9 with scrape type 1
2026-03-27 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d42e471d-29d6-5e33-9d9d-5152535fa1a9
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_378dd001439d0dd3fb9f48e3bc9a4372.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_378dd001439d0dd3fb9f48e3bc9a4372.jpg not downloaded yet
2026-03-27 10:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ec27e1a-c227-5dad-b824-0d399b539a74 with identifier: GH02109
2026-03-27 10:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ec27e1a-c227-5dad-b824-0d399b539a74 with scrape type 1
2026-03-27 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ec27e1a-c227-5dad-b824-0d399b539a74
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_f44746e896b44a81daea118615552d31.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_f44746e896b44a81daea118615552d31.jpg not downloaded yet
2026-03-27 10:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf300350>
2026-03-27 10:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_1b5ea1e728b40a357be51be96c97e704.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_1b5ea1e728b40a357be51be96c97e704.jpg saved to cache
2026-03-27 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68f83d7a-9e20-5a0f-ade1-0a60276be417
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_40d23f693c381b73dd0aad805f13be42.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_40d23f693c381b73dd0aad805f13be42.jpg not downloaded yet
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_b97a646d1a2398a0c414e942db90e818.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_b97a646d1a2398a0c414e942db90e818.jpg not downloaded yet
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_b47bec5f0e6146f20192e5c0fca23cf4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_b47bec5f0e6146f20192e5c0fca23cf4.jpg not downloaded yet
2026-03-27 10:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_55db09adbde689503d045bd0ba50116b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02a6a7a4-25da-57f9-8a5f-b8f397006911 with identifier: NC61336
2026-03-27 10:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02a6a7a4-25da-57f9-8a5f-b8f397006911 with scrape type 1
2026-03-27 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02a6a7a4-25da-57f9-8a5f-b8f397006911
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_41a5de322ad4cbeb1297bfcb9a161682.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_41a5de322ad4cbeb1297bfcb9a161682.jpg not downloaded yet
2026-03-27 10:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be160910>
2026-03-27 10:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_c9007eabc837b4dbcb1a159435938bd3.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_c9007eabc837b4dbcb1a159435938bd3.jpg saved to cache
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68f83d7a-9e20-5a0f-ade1-0a60276be417
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be205910>
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_beee3676ebfcd99f1a6f7ce0bd0be648.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_beee3676ebfcd99f1a6f7ce0bd0be648.jpg saved to cache
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68f83d7a-9e20-5a0f-ade1-0a60276be417
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2cc690>
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_06c276417b29415778338ea82ee47908.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_06c276417b29415778338ea82ee47908.jpg saved to cache
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68f83d7a-9e20-5a0f-ade1-0a60276be417
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_86aa108f35d7b757318384e402b1ad75.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_86aa108f35d7b757318384e402b1ad75.jpg not downloaded yet
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_657dc4667ba85323850823e1b68494b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_657dc4667ba85323850823e1b68494b8.jpg not downloaded yet
2026-03-27 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_552ea78dc1fc6763d2cb1a24755d0aed.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_12c1547a1d1af0da9cc3bb1fde5dabe6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_12c1547a1d1af0da9cc3bb1fde5dabe6.jpg not downloaded yet
2026-03-27 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_85ecde1aba9872ef39388794c58302a4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_f039f4c8d4477e0ef6bbadc09dc915cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_be1c4e91fe1fa30bf82a636f2a39316c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_be1c4e91fe1fa30bf82a636f2a39316c.jpg not downloaded yet
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_6fb6c5eecaaec64a2c377015ea2928c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_6fb6c5eecaaec64a2c377015ea2928c1.jpg not downloaded yet
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf39c950>
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_55db09adbde689503d045bd0ba50116b.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_55db09adbde689503d045bd0ba50116b.jpg saved to cache
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 68f83d7a-9e20-5a0f-ade1-0a60276be417
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_c4d3ff314c7fedbb6ac857fc226f821b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_c4d3ff314c7fedbb6ac857fc226f821b.jpg not downloaded yet
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_5a64692b9e486d0b5c3944cfac4305cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_5a64692b9e486d0b5c3944cfac4305cf.jpg not downloaded yet
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_7f91a717db00fb0931dc847bdba12842.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_7f91a717db00fb0931dc847bdba12842.jpg not downloaded yet
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_fe2f6a0cff9a54707c3ed8e5a5bc8abb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_fe2f6a0cff9a54707c3ed8e5a5bc8abb.jpg not downloaded yet
2026-03-27 10:34:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3d4b10>
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_552ea78dc1fc6763d2cb1a24755d0aed.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_552ea78dc1fc6763d2cb1a24755d0aed.jpg saved to cache
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 612708e7-8aa9-5dc5-a611-84b01b85751b
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_ebd5d71adbcb028a3cf16324acb8d727.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_ebd5d71adbcb028a3cf16324acb8d727.jpg not downloaded yet
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_8bf121332afe54f435338df0642872ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_8bf121332afe54f435338df0642872ac.jpg not downloaded yet
2026-03-27 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_40d23f693c381b73dd0aad805f13be42.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_657dc4667ba85323850823e1b68494b8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_91cbe6b26438bbea94f93e57ccb79a83.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_91cbe6b26438bbea94f93e57ccb79a83.jpg not downloaded yet
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_0afad34ce62fe93f9decbfb0e19dd718.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_0afad34ce62fe93f9decbfb0e19dd718.jpg not downloaded yet
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_b12ced83f2202689542183890c029e1f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_b12ced83f2202689542183890c029e1f.jpg not downloaded yet
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e7190>
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_85ecde1aba9872ef39388794c58302a4.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_85ecde1aba9872ef39388794c58302a4.jpg saved to cache
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68f83d7a-9e20-5a0f-ade1-0a60276be417
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf46fed0>
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_f039f4c8d4477e0ef6bbadc09dc915cf.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_f039f4c8d4477e0ef6bbadc09dc915cf.jpg saved to cache
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 68f83d7a-9e20-5a0f-ade1-0a60276be417
2026-03-27 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_86aa108f35d7b757318384e402b1ad75.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_6044b4de72498ad1e60e556f73a44219.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_6044b4de72498ad1e60e556f73a44219.jpg not downloaded yet
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_61124689a76022bff5efa41f9ff920b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_61124689a76022bff5efa41f9ff920b6.jpg not downloaded yet
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_be858d200b26a6970c8656a0a287249c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_be858d200b26a6970c8656a0a287249c.jpg not downloaded yet
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_868b547775993837233798713c8ed021.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_868b547775993837233798713c8ed021.jpg not downloaded yet
2026-03-27 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MW22662/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1b96d0>
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_40d23f693c381b73dd0aad805f13be42.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_40d23f693c381b73dd0aad805f13be42.jpg saved to cache
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 68f83d7a-9e20-5a0f-ade1-0a60276be417
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3de850>
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_657dc4667ba85323850823e1b68494b8.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_657dc4667ba85323850823e1b68494b8.jpg saved to cache
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ec27e1a-c227-5dad-b824-0d399b539a74
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_e4b538b3755c2539369d0c5d28b6422d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_e4b538b3755c2539369d0c5d28b6422d.jpg not downloaded yet
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_c3a686dc33336802bab62c2e8b73068a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_c3a686dc33336802bab62c2e8b73068a.jpg not downloaded yet
2026-03-27 10:34:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MV22283/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_998cd591e72e0fdadd3a5723badf4ac7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_998cd591e72e0fdadd3a5723badf4ac7.jpg not downloaded yet
2026-03-27 10:34:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_8bf121332afe54f435338df0642872ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_faece45f0859e48ee9055f8da9cdef10.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_faece45f0859e48ee9055f8da9cdef10.jpg not downloaded yet
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_c3b12b54bd89c59f4de134a709fa3002.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_c3b12b54bd89c59f4de134a709fa3002.jpg not downloaded yet
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_38635aa530f5ca2c802d8f8c8adeae34.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_38635aa530f5ca2c802d8f8c8adeae34.jpg not downloaded yet
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf389590>
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_86aa108f35d7b757318384e402b1ad75.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_86aa108f35d7b757318384e402b1ad75.jpg saved to cache
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d42e471d-29d6-5e33-9d9d-5152535fa1a9
2026-03-27 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_91cbe6b26438bbea94f93e57ccb79a83.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_6778154dc86d08a8bee293ea23a0a679.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_6778154dc86d08a8bee293ea23a0a679.jpg not downloaded yet
2026-03-27 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_be858d200b26a6970c8656a0a287249c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT76935/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WT41205/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be24f450>
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_8bf121332afe54f435338df0642872ac.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_8bf121332afe54f435338df0642872ac.jpg saved to cache
2026-03-27 10:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2ec27e1a-c227-5dad-b824-0d399b539a74
2026-03-27 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_f03c4685bb07cba3d5516676a99a91be.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PV56207> (referer: https://www.auto1.com/v1/car-details-view/PV56207/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_41a5de322ad4cbeb1297bfcb9a161682.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_ebd5d71adbcb028a3cf16324acb8d727.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e4190>
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_91cbe6b26438bbea94f93e57ccb79a83.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_91cbe6b26438bbea94f93e57ccb79a83.jpg saved to cache
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02a6a7a4-25da-57f9-8a5f-b8f397006911
2026-03-27 10:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_868b547775993837233798713c8ed021.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_c3b12b54bd89c59f4de134a709fa3002.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf39c510>
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_be858d200b26a6970c8656a0a287249c.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_be858d200b26a6970c8656a0a287249c.jpg saved to cache
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2ec27e1a-c227-5dad-b824-0d399b539a74
2026-03-27 10:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BK59777/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1bcad0>
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_f03c4685bb07cba3d5516676a99a91be.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_f03c4685bb07cba3d5516676a99a91be.jpg saved to cache
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 612708e7-8aa9-5dc5-a611-84b01b85751b
2026-03-27 10:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb22af45-881f-5892-a577-6abd03dacda0 with identifier: PV56207
2026-03-27 10:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb22af45-881f-5892-a577-6abd03dacda0 with scrape type 1
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb22af45-881f-5892-a577-6abd03dacda0
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_f9be5ec48a5384c0dfee70a03415e412.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_f9be5ec48a5384c0dfee70a03415e412.jpg not downloaded yet
2026-03-27 10:34:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1155d0>
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_41a5de322ad4cbeb1297bfcb9a161682.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_41a5de322ad4cbeb1297bfcb9a161682.jpg saved to cache
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02a6a7a4-25da-57f9-8a5f-b8f397006911
2026-03-27 10:34:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf477910>
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_ebd5d71adbcb028a3cf16324acb8d727.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_ebd5d71adbcb028a3cf16324acb8d727.jpg saved to cache
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d42e471d-29d6-5e33-9d9d-5152535fa1a9
2026-03-27 10:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_c3a686dc33336802bab62c2e8b73068a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_001949d0224db96b45338fa8a3039e66.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_001949d0224db96b45338fa8a3039e66.jpg not downloaded yet
2026-03-27 10:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_6778154dc86d08a8bee293ea23a0a679.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_cb3d47092c343dc77f58d00c5f8a57f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_cb3d47092c343dc77f58d00c5f8a57f6.jpg not downloaded yet
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3df9d0>
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_868b547775993837233798713c8ed021.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_868b547775993837233798713c8ed021.jpg saved to cache
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02a6a7a4-25da-57f9-8a5f-b8f397006911
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be257f90>
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_c3b12b54bd89c59f4de134a709fa3002.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_c3b12b54bd89c59f4de134a709fa3002.jpg saved to cache
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2ec27e1a-c227-5dad-b824-0d399b539a74
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_8bc1094f64f5708741b14d990b684301.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_8bc1094f64f5708741b14d990b684301.jpg not downloaded yet
2026-03-27 10:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB69443/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_ba5c30672bc372e9f81324b6d6f09a84.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_ba5c30672bc372e9f81324b6d6f09a84.jpg not downloaded yet
2026-03-27 10:34:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf325e90>
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_c3a686dc33336802bab62c2e8b73068a.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_c3a686dc33336802bab62c2e8b73068a.jpg saved to cache
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2ec27e1a-c227-5dad-b824-0d399b539a74
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f4b90>
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_6778154dc86d08a8bee293ea23a0a679.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_6778154dc86d08a8bee293ea23a0a679.jpg saved to cache
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 02a6a7a4-25da-57f9-8a5f-b8f397006911
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_9d4854eedbb5d013b2b682719f1fcb80.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_9d4854eedbb5d013b2b682719f1fcb80.jpg not downloaded yet
2026-03-27 10:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_f9be5ec48a5384c0dfee70a03415e412.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_2625dc28e58972924cc9c2bc5907f7aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_2625dc28e58972924cc9c2bc5907f7aa.jpg not downloaded yet
2026-03-27 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL50541/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_ff88dab57a664d41d8556ab548154c78.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_ff88dab57a664d41d8556ab548154c78.jpg not downloaded yet
2026-03-27 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_6044b4de72498ad1e60e556f73a44219.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_e4b538b3755c2539369d0c5d28b6422d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4f7890>
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_f9be5ec48a5384c0dfee70a03415e412.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_f9be5ec48a5384c0dfee70a03415e412.jpg saved to cache
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb22af45-881f-5892-a577-6abd03dacda0
2026-03-27 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_8bc1094f64f5708741b14d990b684301.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_934e5ea320bde1bb56b6d17671dd9971.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_934e5ea320bde1bb56b6d17671dd9971.jpg not downloaded yet
2026-03-27 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_9d4854eedbb5d013b2b682719f1fcb80.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_187e6f46e1be6d86816d08f73bc73994.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_187e6f46e1be6d86816d08f73bc73994.jpg not downloaded yet
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf540490>
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_6044b4de72498ad1e60e556f73a44219.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_6044b4de72498ad1e60e556f73a44219.jpg saved to cache
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02a6a7a4-25da-57f9-8a5f-b8f397006911
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf474390>
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_e4b538b3755c2539369d0c5d28b6422d.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_e4b538b3755c2539369d0c5d28b6422d.jpg saved to cache
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d42e471d-29d6-5e33-9d9d-5152535fa1a9
2026-03-27 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_934e5ea320bde1bb56b6d17671dd9971.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf37f250>
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_8bc1094f64f5708741b14d990b684301.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_8bc1094f64f5708741b14d990b684301.jpg saved to cache
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb22af45-881f-5892-a577-6abd03dacda0
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be097050>
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_9d4854eedbb5d013b2b682719f1fcb80.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_9d4854eedbb5d013b2b682719f1fcb80.jpg saved to cache
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb22af45-881f-5892-a577-6abd03dacda0
2026-03-27 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_ba5c30672bc372e9f81324b6d6f09a84.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_2625dc28e58972924cc9c2bc5907f7aa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_ff88dab57a664d41d8556ab548154c78.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c55123d0>
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_934e5ea320bde1bb56b6d17671dd9971.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_934e5ea320bde1bb56b6d17671dd9971.jpg saved to cache
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb22af45-881f-5892-a577-6abd03dacda0
2026-03-27 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_38635aa530f5ca2c802d8f8c8adeae34.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_187e6f46e1be6d86816d08f73bc73994.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_faece45f0859e48ee9055f8da9cdef10.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_998cd591e72e0fdadd3a5723badf4ac7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_61124689a76022bff5efa41f9ff920b6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MW22662> (referer: https://www.auto1.com/v1/car-details-view/MW22662/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be254ad0>
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_ba5c30672bc372e9f81324b6d6f09a84.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_ba5c30672bc372e9f81324b6d6f09a84.jpg saved to cache
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb22af45-881f-5892-a577-6abd03dacda0
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf43d490>
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_2625dc28e58972924cc9c2bc5907f7aa.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_2625dc28e58972924cc9c2bc5907f7aa.jpg saved to cache
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb22af45-881f-5892-a577-6abd03dacda0
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3ac090>
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_ff88dab57a664d41d8556ab548154c78.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_ff88dab57a664d41d8556ab548154c78.jpg saved to cache
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb22af45-881f-5892-a577-6abd03dacda0
2026-03-27 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_cb3d47092c343dc77f58d00c5f8a57f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MV22283> (referer: https://www.auto1.com/v1/car-details-view/MV22283/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf385dd0>
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_38635aa530f5ca2c802d8f8c8adeae34.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_38635aa530f5ca2c802d8f8c8adeae34.jpg saved to cache
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 02a6a7a4-25da-57f9-8a5f-b8f397006911
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be039790>
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_187e6f46e1be6d86816d08f73bc73994.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_187e6f46e1be6d86816d08f73bc73994.jpg saved to cache
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb22af45-881f-5892-a577-6abd03dacda0
2026-03-27 10:34:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2fbd90>
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_faece45f0859e48ee9055f8da9cdef10.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_faece45f0859e48ee9055f8da9cdef10.jpg saved to cache
2026-03-27 10:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d42e471d-29d6-5e33-9d9d-5152535fa1a9
2026-03-27 10:34:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be02edd0>
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_998cd591e72e0fdadd3a5723badf4ac7.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_998cd591e72e0fdadd3a5723badf4ac7.jpg saved to cache
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02a6a7a4-25da-57f9-8a5f-b8f397006911
2026-03-27 10:34:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be02f4d0>
2026-03-27 10:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_61124689a76022bff5efa41f9ff920b6.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_61124689a76022bff5efa41f9ff920b6.jpg saved to cache
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d42e471d-29d6-5e33-9d9d-5152535fa1a9
2026-03-27 10:34:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc6cb348-dd04-59cc-8e81-195f4ed65c45 with identifier: MW22662
2026-03-27 10:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc6cb348-dd04-59cc-8e81-195f4ed65c45 with scrape type 1
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc6cb348-dd04-59cc-8e81-195f4ed65c45
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_a4428129224779a0333cac9bb148f292.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_a4428129224779a0333cac9bb148f292.jpg not downloaded yet
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_9ae34ec063c2ad5faa0e347d7e604e4c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_9ae34ec063c2ad5faa0e347d7e604e4c.jpg not downloaded yet
2026-03-27 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_001949d0224db96b45338fa8a3039e66.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_b12ced83f2202689542183890c029e1f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WT41205> (referer: https://www.auto1.com/v1/car-details-view/WT41205/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT76935> (referer: https://www.auto1.com/v1/car-details-view/VT76935/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_3e93bc43589d0044567df66d45e9dea1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_3e93bc43589d0044567df66d45e9dea1.jpg not downloaded yet
2026-03-27 10:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be12bd90>
2026-03-27 10:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_cb3d47092c343dc77f58d00c5f8a57f6.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_cb3d47092c343dc77f58d00c5f8a57f6.jpg saved to cache
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb22af45-881f-5892-a577-6abd03dacda0
2026-03-27 10:34:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9e68008-6e09-585a-8a23-6e61472fd2d7 with identifier: MV22283
2026-03-27 10:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9e68008-6e09-585a-8a23-6e61472fd2d7 with scrape type 1
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9e68008-6e09-585a-8a23-6e61472fd2d7
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_cb5e43830d9a3be75ad53d40f6da22fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_cb5e43830d9a3be75ad53d40f6da22fc.jpg not downloaded yet
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_d5850a7c77d14adbf37ef86ea8564e5f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_d5850a7c77d14adbf37ef86ea8564e5f.jpg not downloaded yet
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_7ae2fbc849e9a533d76a63093b729f87.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_7ae2fbc849e9a533d76a63093b729f87.jpg not downloaded yet
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_dce16b7125e5b96e20720c7733b26e7e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_dce16b7125e5b96e20720c7733b26e7e.jpg not downloaded yet
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_178f340b5bddca51679c202b62ff80a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_178f340b5bddca51679c202b62ff80a1.jpg not downloaded yet
2026-03-27 10:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_7f91a717db00fb0931dc847bdba12842.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_4cc16c3b2171c3058420d31df5443e67.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_4cc16c3b2171c3058420d31df5443e67.jpg not downloaded yet
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_0587d27345133bfdf1e956871d18abd4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_0587d27345133bfdf1e956871d18abd4.jpg not downloaded yet
2026-03-27 10:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be13afd0>
2026-03-27 10:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F09%252F0a09d3ee57d4faaf2e3ca371096bd43b%252Fpa%252FPV56207_001949d0224db96b45338fa8a3039e66.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_001949d0224db96b45338fa8a3039e66.jpg saved to cache
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb22af45-881f-5892-a577-6abd03dacda0
2026-03-27 10:34:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb22af45-881f-5892-a577-6abd03dacda0, skipping ID generation
2026-03-27 10:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb22af45-881f-5892-a577-6abd03dacda0 with scrape type 1
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb22af45-881f-5892-a577-6abd03dacda0 sending to next pipeline
2026-03-27 10:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb22af45-881f-5892-a577-6abd03dacda0, identifier: PV56207
2026-03-27 10:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0393d0>
2026-03-27 10:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_b12ced83f2202689542183890c029e1f.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_b12ced83f2202689542183890c029e1f.jpg saved to cache
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2ec27e1a-c227-5dad-b824-0d399b539a74
2026-03-27 10:34:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7aca7eb-4622-58f1-bd6f-135a79fab690 with identifier: WT41205
2026-03-27 10:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7aca7eb-4622-58f1-bd6f-135a79fab690 with scrape type 1
2026-03-27 10:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7aca7eb-4622-58f1-bd6f-135a79fab690
2026-03-27 10:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_1e8a8523d84586dea63d9903357f5410.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_1e8a8523d84586dea63d9903357f5410.jpg not downloaded yet
2026-03-27 10:34:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e37bf0ce-5ada-5e23-93e6-46c5e633e60d with identifier: VT76935
2026-03-27 10:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37bf0ce-5ada-5e23-93e6-46c5e633e60d with scrape type 1
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e37bf0ce-5ada-5e23-93e6-46c5e633e60d
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_7263d6912574db6b7b27a35904e8c1fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_7263d6912574db6b7b27a35904e8c1fe.jpg not downloaded yet
2026-03-27 10:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb22af45-881f-5892-a577-6abd03dacda0 with identifier: PV56207
2026-03-27 10:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb22af45-881f-5892-a577-6abd03dacda0 with identifier: PV56207
2026-03-27 10:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb22af45-881f-5892-a577-6abd03dacda0 with identifier: PV56207 to the API
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_001949d0224db96b45338fa8a3039e66.jpg>
{'auction_title': '',
'c_o_2_emission_value': 253,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 3',
'engine': '3.0L',
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:07:12Z',
'fuel_type': 'diesel',
'id': 'cb22af45-881f-5892-a577-6abd03dacda0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV56207',
'listing': 'auction',
'location': 'DE, Kandel',
'make': 'Toyota',
'model': 'Land Cruiser',
'odometer': 361677,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_f9be5ec48a5384c0dfee70a03415e412.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_001949d0224db96b45338fa8a3039e66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84338,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_cb3d47092c343dc77f58d00c5f8a57f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_8bc1094f64f5708741b14d990b684301.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81161,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_ba5c30672bc372e9f81324b6d6f09a84.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_9d4854eedbb5d013b2b682719f1fcb80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74572,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_2625dc28e58972924cc9c2bc5907f7aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87117,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_ff88dab57a664d41d8556ab548154c78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_934e5ea320bde1bb56b6d17671dd9971.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb22af45-881f-5892-a577-6abd03dacda0/cb22af45-881f-5892-a577-6abd03dacda0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78926,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/09/0a09d3ee57d4faaf2e3ca371096bd43b/pa/PV56207_187e6f46e1be6d86816d08f73bc73994.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2001-04-08',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Land Cruiser 3.0 Turbodiesel Spezial',
'transmission': 'manual',
'trim': 'Spezial',
'year': 2001}
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV56207%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [auto1.de] INFO: Saving data for PV56207: {'created_time': 1774607664.433637, 'last_price_update_time': 1774607664.43365, 'auction_closing_time': 1774714032.0}
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV56207') HTTP/1.1" 204 0
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_4a6e70f55bcc4c164f1daca851d33dd8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_4a6e70f55bcc4c164f1daca851d33dd8.jpg not downloaded yet
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_8d5a922afb1bd362bdbd0f1da158be8e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_8d5a922afb1bd362bdbd0f1da158be8e.jpg not downloaded yet
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_61952697ac5d138476bbb34bd16f6bd5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_61952697ac5d138476bbb34bd16f6bd5.jpg not downloaded yet
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_f7b6b79f9f9f586c5036b8cc1f9312f9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_f7b6b79f9f9f586c5036b8cc1f9312f9.jpg not downloaded yet
2026-03-27 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_c4d3ff314c7fedbb6ac857fc226f821b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_be1c4e91fe1fa30bf82a636f2a39316c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_6fb6c5eecaaec64a2c377015ea2928c1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB69443> (referer: https://www.auto1.com/v1/car-details-view/HB69443/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_4ecbb13c74fd4ba0c634889c97e905a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_4ecbb13c74fd4ba0c634889c97e905a4.jpg not downloaded yet
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_3b5aae4e141876c46e64b72ed08890bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_3b5aae4e141876c46e64b72ed08890bd.jpg not downloaded yet
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_d4ed0fedec14203b3bf3ff44d241e3a8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_d4ed0fedec14203b3bf3ff44d241e3a8.jpg not downloaded yet
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_7e1d49c2f30ab14733e807964763f5df.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_7e1d49c2f30ab14733e807964763f5df.jpg not downloaded yet
2026-03-27 10:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL50541> (referer: https://www.auto1.com/v1/car-details-view/NL50541/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be274050>
2026-03-27 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_7f91a717db00fb0931dc847bdba12842.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_7f91a717db00fb0931dc847bdba12842.jpg saved to cache
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ec27e1a-c227-5dad-b824-0d399b539a74
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_e575b03299bde13d3119baab0e2403df.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_e575b03299bde13d3119baab0e2403df.jpg not downloaded yet
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_ebdcbb3e236b130b990d7803c6bbf161.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_ebdcbb3e236b130b990d7803c6bbf161.jpg not downloaded yet
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_0e719442597c329aae3ae4bb3383c178.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_0e719442597c329aae3ae4bb3383c178.jpg not downloaded yet
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_1187103cf1c0465fc38ba20927c0b516.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_1187103cf1c0465fc38ba20927c0b516.jpg not downloaded yet
2026-03-27 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2cecd0>
2026-03-27 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_c4d3ff314c7fedbb6ac857fc226f821b.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_c4d3ff314c7fedbb6ac857fc226f821b.jpg saved to cache
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02a6a7a4-25da-57f9-8a5f-b8f397006911
2026-03-27 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4de7d0>
2026-03-27 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_be1c4e91fe1fa30bf82a636f2a39316c.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_be1c4e91fe1fa30bf82a636f2a39316c.jpg saved to cache
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d42e471d-29d6-5e33-9d9d-5152535fa1a9
2026-03-27 10:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf555050>
2026-03-27 10:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_6fb6c5eecaaec64a2c377015ea2928c1.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_6fb6c5eecaaec64a2c377015ea2928c1.jpg saved to cache
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ec27e1a-c227-5dad-b824-0d399b539a74
2026-03-27 10:34:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b25a198-d146-57be-a887-728299e787cb with identifier: HB69443
2026-03-27 10:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b25a198-d146-57be-a887-728299e787cb with scrape type 1
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b25a198-d146-57be-a887-728299e787cb
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F6f%252F206fad43f40d18dd7a141c8454f24289%252Fpa%252FHB69443_50f5a0b3f72af4f848936dfe842c9839.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_50f5a0b3f72af4f848936dfe842c9839.jpg already downloaded
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F6f%252F206fad43f40d18dd7a141c8454f24289%252Fpa%252FHB69443_78e0e332e054947bbed293aa8c656546.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_78e0e332e054947bbed293aa8c656546.jpg already downloaded
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F6f%252F206fad43f40d18dd7a141c8454f24289%252Fpa%252FHB69443_0fe4c49d763f17beab2d259ca84d5379.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_0fe4c49d763f17beab2d259ca84d5379.jpg already downloaded
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F6f%252F206fad43f40d18dd7a141c8454f24289%252Fpa%252FHB69443_bd025698a334cab4833f81afa1ec18a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_bd025698a334cab4833f81afa1ec18a5.jpg already downloaded
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F6f%252F206fad43f40d18dd7a141c8454f24289%252Fpa%252FHB69443_a07a753394ad1178f12ec6c707c64dd5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_a07a753394ad1178f12ec6c707c64dd5.jpg already downloaded
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F6f%252F206fad43f40d18dd7a141c8454f24289%252Fpa%252FHB69443_389772ca41ee2344701684c0651fe5ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_389772ca41ee2344701684c0651fe5ae.jpg already downloaded
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F6f%252F206fad43f40d18dd7a141c8454f24289%252Fpa%252FHB69443_86dea806ab5534cd0c25727a8f6e74e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_86dea806ab5534cd0c25727a8f6e74e3.jpg already downloaded
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F6f%252F206fad43f40d18dd7a141c8454f24289%252Fpa%252FHB69443_383e9fdd826a93d55854611031d4fc85.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_383e9fdd826a93d55854611031d4fc85.jpg already downloaded
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F6f%252F206fad43f40d18dd7a141c8454f24289%252Fpa%252FHB69443_cc95068928042c29aae7f26797d7ed15.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_cc95068928042c29aae7f26797d7ed15.jpg already downloaded
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F6f%252F206fad43f40d18dd7a141c8454f24289%252Fpa%252FHB69443_96d24d0b7bd704740df627c2189ad1bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_96d24d0b7bd704740df627c2189ad1bc.jpg already downloaded
2026-03-27 10:34:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b25a198-d146-57be-a887-728299e787cb, identifier: HB69443
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_da4bac6b9197b588c0c46f6db693ad76.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_da4bac6b9197b588c0c46f6db693ad76.jpg not downloaded yet
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_e57cd4471732082216444fd95b7b95f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_e57cd4471732082216444fd95b7b95f3.jpg not downloaded yet
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_83c6e85dc3114ad2107379797427c186.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_83c6e85dc3114ad2107379797427c186.jpg not downloaded yet
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_4c2601709813841efe43a2464805e8c9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_4c2601709813841efe43a2464805e8c9.jpg not downloaded yet
2026-03-27 10:34:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b25a198-d146-57be-a887-728299e787cb with identifier: HB69443
2026-03-27 10:34:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b25a198-d146-57be-a887-728299e787cb with identifier: HB69443
2026-03-27 10:34:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b25a198-d146-57be-a887-728299e787cb with identifier: HB69443 to the API
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HB69443>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine': '3.0L',
'engine_horse_power': 354,
'expiration_date': '2026-03-28T16:17:56Z',
'fuel_type': 'petrol',
'id': '9b25a198-d146-57be-a887-728299e787cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB69443',
'listing': 'auction',
'location': 'DE, Lüdersfeld',
'make': 'Porsche',
'model': 'Macan',
'odometer': 124319,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 14,
'photo_urls': ['https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_50f5a0b3f72af4f848936dfe842c9839.jpg',
'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_78e0e332e054947bbed293aa8c656546.jpg',
'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_0fe4c49d763f17beab2d259ca84d5379.jpg',
'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_bd025698a334cab4833f81afa1ec18a5.jpg',
'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_a07a753394ad1178f12ec6c707c64dd5.jpg',
'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_389772ca41ee2344701684c0651fe5ae.jpg',
'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_86dea806ab5534cd0c25727a8f6e74e3.jpg',
'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_383e9fdd826a93d55854611031d4fc85.jpg',
'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_cc95068928042c29aae7f26797d7ed15.jpg',
'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_96d24d0b7bd704740df627c2189ad1bc.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b25a198-d146-57be-a887-728299e787cb/9b25a198-d146-57be-a887-728299e787cb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2380047,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_50f5a0b3f72af4f848936dfe842c9839.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b25a198-d146-57be-a887-728299e787cb/9b25a198-d146-57be-a887-728299e787cb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2457067,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_78e0e332e054947bbed293aa8c656546.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b25a198-d146-57be-a887-728299e787cb/9b25a198-d146-57be-a887-728299e787cb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_0fe4c49d763f17beab2d259ca84d5379.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b25a198-d146-57be-a887-728299e787cb/9b25a198-d146-57be-a887-728299e787cb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66736,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_bd025698a334cab4833f81afa1ec18a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b25a198-d146-57be-a887-728299e787cb/9b25a198-d146-57be-a887-728299e787cb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_a07a753394ad1178f12ec6c707c64dd5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b25a198-d146-57be-a887-728299e787cb/9b25a198-d146-57be-a887-728299e787cb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3015806,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_389772ca41ee2344701684c0651fe5ae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b25a198-d146-57be-a887-728299e787cb/9b25a198-d146-57be-a887-728299e787cb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2526959,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_86dea806ab5534cd0c25727a8f6e74e3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b25a198-d146-57be-a887-728299e787cb/9b25a198-d146-57be-a887-728299e787cb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91111,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_383e9fdd826a93d55854611031d4fc85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b25a198-d146-57be-a887-728299e787cb/9b25a198-d146-57be-a887-728299e787cb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86827,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_cc95068928042c29aae7f26797d7ed15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b25a198-d146-57be-a887-728299e787cb/9b25a198-d146-57be-a887-728299e787cb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2507370,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img20/6f/206fad43f40d18dd7a141c8454f24289/pa/HB69443_96d24d0b7bd704740df627c2189ad1bc.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-26',
'seats_number': 5,
'seller_name': None,
'title': 'Porsche Macan S',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69443%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [auto1.de] INFO: Saving data for HB69443: {'created_time': 1774607665.52394, 'last_price_update_time': 1774607665.523952, 'auction_closing_time': 1774714676.0}
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB69443') HTTP/1.1" 204 0
2026-03-27 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_7263d6912574db6b7b27a35904e8c1fe.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_178f340b5bddca51679c202b62ff80a1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_12c1547a1d1af0da9cc3bb1fde5dabe6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_83261755370f3dce68f0bfc7ac79c175.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_83261755370f3dce68f0bfc7ac79c175.jpg not downloaded yet
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_a54c832f91663895be4ea55454d21c7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_a54c832f91663895be4ea55454d21c7a.jpg not downloaded yet
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_f83b33c8cadd1f09ef06e7473a424605.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_f83b33c8cadd1f09ef06e7473a424605.jpg not downloaded yet
2026-03-27 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BK59777> (referer: https://www.auto1.com/v1/car-details-view/BK59777/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b989f977-03f8-524b-b789-c6c3e12d3a40 with identifier: NL50541
2026-03-27 10:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b989f977-03f8-524b-b789-c6c3e12d3a40 with scrape type 1
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b989f977-03f8-524b-b789-c6c3e12d3a40
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_4426a293ef14d08de78c45fd4318c63b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_4426a293ef14d08de78c45fd4318c63b.jpg not downloaded yet
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_d3e0ff5f15427cc8b31c816d38be8856.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_d3e0ff5f15427cc8b31c816d38be8856.jpg not downloaded yet
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_284dec111ca7b93ddfb5e83bb7d37e33.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_284dec111ca7b93ddfb5e83bb7d37e33.jpg not downloaded yet
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_e41a828cf0867fc1fc5100589c6bfb7f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_e41a828cf0867fc1fc5100589c6bfb7f.jpg not downloaded yet
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_0655cbdb12efd7dc5db577dc8b4c550d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_0655cbdb12efd7dc5db577dc8b4c550d.jpg not downloaded yet
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_51624577f3a419eb73ae8ff1ee60012d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_51624577f3a419eb73ae8ff1ee60012d.jpg not downloaded yet
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_54ebf6e62ce34abe0814bbf0cc994df7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_54ebf6e62ce34abe0814bbf0cc994df7.jpg not downloaded yet
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_8e25cdbfaefb41636591ec29d937a6f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_8e25cdbfaefb41636591ec29d937a6f1.jpg not downloaded yet
2026-03-27 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_1e8a8523d84586dea63d9903357f5410.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c4248e50>
2026-03-27 10:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_7263d6912574db6b7b27a35904e8c1fe.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_7263d6912574db6b7b27a35904e8c1fe.jpg saved to cache
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e37bf0ce-5ada-5e23-93e6-46c5e633e60d
2026-03-27 10:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf378150>
2026-03-27 10:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_178f340b5bddca51679c202b62ff80a1.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_178f340b5bddca51679c202b62ff80a1.jpg saved to cache
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f9e68008-6e09-585a-8a23-6e61472fd2d7
2026-03-27 10:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f4410>
2026-03-27 10:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_12c1547a1d1af0da9cc3bb1fde5dabe6.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_12c1547a1d1af0da9cc3bb1fde5dabe6.jpg saved to cache
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02a6a7a4-25da-57f9-8a5f-b8f397006911
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_e81acdfe96612ca4aaf8e909aa483eed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_e81acdfe96612ca4aaf8e909aa483eed.jpg not downloaded yet
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_2221dae0d53d481d81acce54ccfdcd5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_2221dae0d53d481d81acce54ccfdcd5a.jpg not downloaded yet
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_2e526f432e0d46c32bb7bd7fcf76aa9c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_2e526f432e0d46c32bb7bd7fcf76aa9c.jpg not downloaded yet
2026-03-27 10:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_0587d27345133bfdf1e956871d18abd4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca8fe179-f946-56a3-b1cf-18343391a95d with identifier: BK59777
2026-03-27 10:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca8fe179-f946-56a3-b1cf-18343391a95d with scrape type 1
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ca8fe179-f946-56a3-b1cf-18343391a95d
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb4%252Fe5b450852844f143c30f770b9e8ffeba%252Fpa%252FBK59777_3dc2301a18cac906d84d89e0823803a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_3dc2301a18cac906d84d89e0823803a5.jpg already downloaded
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb4%252Fe5b450852844f143c30f770b9e8ffeba%252Fpa%252FBK59777_e7647f4e2edcc0ac615ddbed95159467.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_e7647f4e2edcc0ac615ddbed95159467.jpg already downloaded
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb4%252Fe5b450852844f143c30f770b9e8ffeba%252Fpa%252FBK59777_c15997dbf6b2866709fccc921e53fc48.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_c15997dbf6b2866709fccc921e53fc48.jpg already downloaded
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb4%252Fe5b450852844f143c30f770b9e8ffeba%252Fpa%252FBK59777_8801213d00bb5c386592fe43477f9208.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_8801213d00bb5c386592fe43477f9208.jpg already downloaded
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb4%252Fe5b450852844f143c30f770b9e8ffeba%252Fpa%252FBK59777_cd2177ab0a36b067061fe93c38f6f32a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_cd2177ab0a36b067061fe93c38f6f32a.jpg already downloaded
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb4%252Fe5b450852844f143c30f770b9e8ffeba%252Fpa%252FBK59777_7154cc0fe2bdd3b637d4b83e4d1de658.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_7154cc0fe2bdd3b637d4b83e4d1de658.jpg already downloaded
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb4%252Fe5b450852844f143c30f770b9e8ffeba%252Fpa%252FBK59777_43735878d2692035abbc84142662263c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_43735878d2692035abbc84142662263c.jpg already downloaded
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb4%252Fe5b450852844f143c30f770b9e8ffeba%252Fpa%252FBK59777_fd4ad38e0093d253759bcea2411e8d79.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_fd4ad38e0093d253759bcea2411e8d79.jpg already downloaded
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb4%252Fe5b450852844f143c30f770b9e8ffeba%252Fpa%252FBK59777_2023cca6bdc7b6a0a21cc19c53c71bed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_2023cca6bdc7b6a0a21cc19c53c71bed.jpg already downloaded
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb4%252Fe5b450852844f143c30f770b9e8ffeba%252Fpa%252FBK59777_598cad65222ec5e9f6ec3f4b95bb92cb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_598cad65222ec5e9f6ec3f4b95bb92cb.jpg already downloaded
2026-03-27 10:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca8fe179-f946-56a3-b1cf-18343391a95d, identifier: BK59777
2026-03-27 10:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_f7b6b79f9f9f586c5036b8cc1f9312f9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_af7654b4080481b49d0e5cb665d807ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_af7654b4080481b49d0e5cb665d807ac.jpg not downloaded yet
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_e5b3e48eac6d147d46b864fa6b64f0f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_e5b3e48eac6d147d46b864fa6b64f0f5.jpg not downloaded yet
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_16cf5fdc4fc02c81fb6f5e183f363cf3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_16cf5fdc4fc02c81fb6f5e183f363cf3.jpg not downloaded yet
2026-03-27 10:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca8fe179-f946-56a3-b1cf-18343391a95d with identifier: BK59777
2026-03-27 10:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca8fe179-f946-56a3-b1cf-18343391a95d with identifier: BK59777
2026-03-27 10:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca8fe179-f946-56a3-b1cf-18343391a95d with identifier: BK59777 to the API
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BK59777>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:35:21Z',
'fuel_type': 'diesel',
'id': 'ca8fe179-f946-56a3-b1cf-18343391a95d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK59777',
'listing': 'auction',
'location': 'DE, Buch',
'make': 'Skoda',
'model': 'Superb',
'odometer': 169653,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_3dc2301a18cac906d84d89e0823803a5.jpg',
'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_e7647f4e2edcc0ac615ddbed95159467.jpg',
'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_c15997dbf6b2866709fccc921e53fc48.jpg',
'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_8801213d00bb5c386592fe43477f9208.jpg',
'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_cd2177ab0a36b067061fe93c38f6f32a.jpg',
'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_7154cc0fe2bdd3b637d4b83e4d1de658.jpg',
'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_43735878d2692035abbc84142662263c.jpg',
'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_fd4ad38e0093d253759bcea2411e8d79.jpg',
'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_2023cca6bdc7b6a0a21cc19c53c71bed.jpg',
'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_598cad65222ec5e9f6ec3f4b95bb92cb.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8fe179-f946-56a3-b1cf-18343391a95d/ca8fe179-f946-56a3-b1cf-18343391a95d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_3dc2301a18cac906d84d89e0823803a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8fe179-f946-56a3-b1cf-18343391a95d/ca8fe179-f946-56a3-b1cf-18343391a95d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_e7647f4e2edcc0ac615ddbed95159467.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8fe179-f946-56a3-b1cf-18343391a95d/ca8fe179-f946-56a3-b1cf-18343391a95d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2568111,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_c15997dbf6b2866709fccc921e53fc48.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8fe179-f946-56a3-b1cf-18343391a95d/ca8fe179-f946-56a3-b1cf-18343391a95d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_8801213d00bb5c386592fe43477f9208.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8fe179-f946-56a3-b1cf-18343391a95d/ca8fe179-f946-56a3-b1cf-18343391a95d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74883,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_cd2177ab0a36b067061fe93c38f6f32a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8fe179-f946-56a3-b1cf-18343391a95d/ca8fe179-f946-56a3-b1cf-18343391a95d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_7154cc0fe2bdd3b637d4b83e4d1de658.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8fe179-f946-56a3-b1cf-18343391a95d/ca8fe179-f946-56a3-b1cf-18343391a95d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_43735878d2692035abbc84142662263c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8fe179-f946-56a3-b1cf-18343391a95d/ca8fe179-f946-56a3-b1cf-18343391a95d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82027,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_fd4ad38e0093d253759bcea2411e8d79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8fe179-f946-56a3-b1cf-18343391a95d/ca8fe179-f946-56a3-b1cf-18343391a95d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74680,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_2023cca6bdc7b6a0a21cc19c53c71bed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8fe179-f946-56a3-b1cf-18343391a95d/ca8fe179-f946-56a3-b1cf-18343391a95d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b4/e5b450852844f143c30f770b9e8ffeba/pa/BK59777_598cad65222ec5e9f6ec3f4b95bb92cb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-07-04',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2022}
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK59777%27 HTTP/1.1" 200 None
2026-03-27 10:34:26 [auto1.de] INFO: Saving data for BK59777: {'created_time': 1774607666.584721, 'last_price_update_time': 1774607666.584734, 'auction_closing_time': 1774715721.0}
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK59777') HTTP/1.1" 204 0
2026-03-27 10:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_61952697ac5d138476bbb34bd16f6bd5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_81907d5b4edf48945cfc17b14bc2230f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_81907d5b4edf48945cfc17b14bc2230f.jpg not downloaded yet
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf38f0d0>
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_1e8a8523d84586dea63d9903357f5410.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_1e8a8523d84586dea63d9903357f5410.jpg saved to cache
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7aca7eb-4622-58f1-bd6f-135a79fab690
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5bed90>
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_0587d27345133bfdf1e956871d18abd4.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_0587d27345133bfdf1e956871d18abd4.jpg saved to cache
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f9e68008-6e09-585a-8a23-6e61472fd2d7
2026-03-27 10:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_4c2601709813841efe43a2464805e8c9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_88decfff406387b8a6df0a7279c43545.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_88decfff406387b8a6df0a7279c43545.jpg not downloaded yet
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3c6210>
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_f7b6b79f9f9f586c5036b8cc1f9312f9.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_f7b6b79f9f9f586c5036b8cc1f9312f9.jpg saved to cache
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e37bf0ce-5ada-5e23-93e6-46c5e633e60d
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_e08c79f91a3777813b97d626b8cdea03.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_e08c79f91a3777813b97d626b8cdea03.jpg not downloaded yet
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5e0f50>
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_61952697ac5d138476bbb34bd16f6bd5.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_61952697ac5d138476bbb34bd16f6bd5.jpg saved to cache
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f7aca7eb-4622-58f1-bd6f-135a79fab690
2026-03-27 10:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_83c6e85dc3114ad2107379797427c186.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_02ce6ff96eb8e556617953c53275783d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_02ce6ff96eb8e556617953c53275783d.jpg not downloaded yet
2026-03-27 10:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_4426a293ef14d08de78c45fd4318c63b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_46c4df12763fca020e5789767ee82f04.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_46c4df12763fca020e5789767ee82f04.jpg not downloaded yet
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be260750>
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_4c2601709813841efe43a2464805e8c9.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_4c2601709813841efe43a2464805e8c9.jpg saved to cache
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e37bf0ce-5ada-5e23-93e6-46c5e633e60d
2026-03-27 10:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_fe2f6a0cff9a54707c3ed8e5a5bc8abb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_e57cd4471732082216444fd95b7b95f3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf51ce10>
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_83c6e85dc3114ad2107379797427c186.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_83c6e85dc3114ad2107379797427c186.jpg saved to cache
2026-03-27 10:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f7aca7eb-4622-58f1-bd6f-135a79fab690
2026-03-27 10:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_a4428129224779a0333cac9bb148f292.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1f7310>
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_4426a293ef14d08de78c45fd4318c63b.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_4426a293ef14d08de78c45fd4318c63b.jpg saved to cache
2026-03-27 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b989f977-03f8-524b-b789-c6c3e12d3a40
2026-03-27 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_9ae34ec063c2ad5faa0e347d7e604e4c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_0afad34ce62fe93f9decbfb0e19dd718.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_5a64692b9e486d0b5c3944cfac4305cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be266c90>
2026-03-27 10:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F9e%252F059e617e802aeb4da19637713427d540%252Fpa%252FNC61336_fe2f6a0cff9a54707c3ed8e5a5bc8abb.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_fe2f6a0cff9a54707c3ed8e5a5bc8abb.jpg saved to cache
2026-03-27 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02a6a7a4-25da-57f9-8a5f-b8f397006911
2026-03-27 10:34:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02a6a7a4-25da-57f9-8a5f-b8f397006911, skipping ID generation
2026-03-27 10:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02a6a7a4-25da-57f9-8a5f-b8f397006911 with scrape type 1
2026-03-27 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02a6a7a4-25da-57f9-8a5f-b8f397006911 sending to next pipeline
2026-03-27 10:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02a6a7a4-25da-57f9-8a5f-b8f397006911, identifier: NC61336
2026-03-27 10:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3c7e90>
2026-03-27 10:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_e57cd4471732082216444fd95b7b95f3.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_e57cd4471732082216444fd95b7b95f3.jpg saved to cache
2026-03-27 10:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f9e68008-6e09-585a-8a23-6e61472fd2d7
2026-03-27 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_0655cbdb12efd7dc5db577dc8b4c550d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_2e526f432e0d46c32bb7bd7fcf76aa9c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02a6a7a4-25da-57f9-8a5f-b8f397006911 with identifier: NC61336
2026-03-27 10:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02a6a7a4-25da-57f9-8a5f-b8f397006911 with identifier: NC61336
2026-03-27 10:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02a6a7a4-25da-57f9-8a5f-b8f397006911 with identifier: NC61336 to the API
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_fe2f6a0cff9a54707c3ed8e5a5bc8abb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 219,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 5',
'engine': '4.7L',
'engine_horse_power': 435,
'expiration_date': '2026-03-28T16:24:12Z',
'fuel_type': 'petrol',
'id': '02a6a7a4-25da-57f9-8a5f-b8f397006911',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC61336',
'listing': 'auction',
'location': 'DE, Greifswald',
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 111812,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2444984,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_41a5de322ad4cbeb1297bfcb9a161682.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93058,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_12c1547a1d1af0da9cc3bb1fde5dabe6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89857,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_c4d3ff314c7fedbb6ac857fc226f821b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2163201,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_fe2f6a0cff9a54707c3ed8e5a5bc8abb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_91cbe6b26438bbea94f93e57ccb79a83.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85098,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_6044b4de72498ad1e60e556f73a44219.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_868b547775993837233798713c8ed021.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2479787,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_998cd591e72e0fdadd3a5723badf4ac7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2375408,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_38635aa530f5ca2c802d8f8c8adeae34.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02a6a7a4-25da-57f9-8a5f-b8f397006911/02a6a7a4-25da-57f9-8a5f-b8f397006911_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/9e/059e617e802aeb4da19637713427d540/pa/NC61336_6778154dc86d08a8bee293ea23a0a679.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-03-20',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 500 CGI BlueEfficiency',
'transmission': 'automatic',
'trim': 'BlueEfficiency',
'year': 2012}
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC61336%27 HTTP/1.1" 200 None
2026-03-27 10:34:27 [auto1.de] INFO: Saving data for NC61336: {'created_time': 1774607667.747568, 'last_price_update_time': 1774607667.74758, 'auction_closing_time': 1774715052.0}
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC61336') HTTP/1.1" 204 0
2026-03-27 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_16cf5fdc4fc02c81fb6f5e183f363cf3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_8e25cdbfaefb41636591ec29d937a6f1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_02ce6ff96eb8e556617953c53275783d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_81907d5b4edf48945cfc17b14bc2230f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_e08c79f91a3777813b97d626b8cdea03.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be09add0>
2026-03-27 10:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_a4428129224779a0333cac9bb148f292.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_a4428129224779a0333cac9bb148f292.jpg saved to cache
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc6cb348-dd04-59cc-8e81-195f4ed65c45
2026-03-27 10:34:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be02c510>
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_9ae34ec063c2ad5faa0e347d7e604e4c.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_9ae34ec063c2ad5faa0e347d7e604e4c.jpg saved to cache
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc6cb348-dd04-59cc-8e81-195f4ed65c45
2026-03-27 10:34:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be014390>
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_0afad34ce62fe93f9decbfb0e19dd718.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_0afad34ce62fe93f9decbfb0e19dd718.jpg saved to cache
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d42e471d-29d6-5e33-9d9d-5152535fa1a9
2026-03-27 10:34:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be257750>
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_5a64692b9e486d0b5c3944cfac4305cf.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_5a64692b9e486d0b5c3944cfac4305cf.jpg saved to cache
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d42e471d-29d6-5e33-9d9d-5152535fa1a9
2026-03-27 10:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_88decfff406387b8a6df0a7279c43545.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be255650>
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_0655cbdb12efd7dc5db577dc8b4c550d.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_0655cbdb12efd7dc5db577dc8b4c550d.jpg saved to cache
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b989f977-03f8-524b-b789-c6c3e12d3a40
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5ed410>
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_2e526f432e0d46c32bb7bd7fcf76aa9c.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_2e526f432e0d46c32bb7bd7fcf76aa9c.jpg saved to cache
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b989f977-03f8-524b-b789-c6c3e12d3a40
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be24abd0>
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_16cf5fdc4fc02c81fb6f5e183f363cf3.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_16cf5fdc4fc02c81fb6f5e183f363cf3.jpg saved to cache
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b989f977-03f8-524b-b789-c6c3e12d3a40
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf542710>
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_8e25cdbfaefb41636591ec29d937a6f1.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_8e25cdbfaefb41636591ec29d937a6f1.jpg saved to cache
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b989f977-03f8-524b-b789-c6c3e12d3a40
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c572a990>
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_02ce6ff96eb8e556617953c53275783d.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_02ce6ff96eb8e556617953c53275783d.jpg saved to cache
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b989f977-03f8-524b-b789-c6c3e12d3a40
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf39ddd0>
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_81907d5b4edf48945cfc17b14bc2230f.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_81907d5b4edf48945cfc17b14bc2230f.jpg saved to cache
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b989f977-03f8-524b-b789-c6c3e12d3a40
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3ef290>
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_e08c79f91a3777813b97d626b8cdea03.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_e08c79f91a3777813b97d626b8cdea03.jpg saved to cache
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b989f977-03f8-524b-b789-c6c3e12d3a40
2026-03-27 10:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_51624577f3a419eb73ae8ff1ee60012d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_e81acdfe96612ca4aaf8e909aa483eed.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_2221dae0d53d481d81acce54ccfdcd5a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_af7654b4080481b49d0e5cb665d807ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1285d0>
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_88decfff406387b8a6df0a7279c43545.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_88decfff406387b8a6df0a7279c43545.jpg saved to cache
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b989f977-03f8-524b-b789-c6c3e12d3a40
2026-03-27 10:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_e41a828cf0867fc1fc5100589c6bfb7f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_e5b3e48eac6d147d46b864fa6b64f0f5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_46c4df12763fca020e5789767ee82f04.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_54ebf6e62ce34abe0814bbf0cc994df7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_284dec111ca7b93ddfb5e83bb7d37e33.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1fb290>
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_51624577f3a419eb73ae8ff1ee60012d.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_51624577f3a419eb73ae8ff1ee60012d.jpg saved to cache
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f7aca7eb-4622-58f1-bd6f-135a79fab690
2026-03-27 10:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_0e719442597c329aae3ae4bb3383c178.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0117d0>
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_e81acdfe96612ca4aaf8e909aa483eed.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_e81acdfe96612ca4aaf8e909aa483eed.jpg saved to cache
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f7aca7eb-4622-58f1-bd6f-135a79fab690
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be129690>
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_2221dae0d53d481d81acce54ccfdcd5a.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_2221dae0d53d481d81acce54ccfdcd5a.jpg saved to cache
2026-03-27 10:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e37bf0ce-5ada-5e23-93e6-46c5e633e60d
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3de610>
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_af7654b4080481b49d0e5cb665d807ac.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_af7654b4080481b49d0e5cb665d807ac.jpg saved to cache
2026-03-27 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f7aca7eb-4622-58f1-bd6f-135a79fab690
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be030890>
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_e41a828cf0867fc1fc5100589c6bfb7f.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_e41a828cf0867fc1fc5100589c6bfb7f.jpg saved to cache
2026-03-27 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e37bf0ce-5ada-5e23-93e6-46c5e633e60d
2026-03-27 10:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_f83b33c8cadd1f09ef06e7473a424605.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_83261755370f3dce68f0bfc7ac79c175.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_a54c832f91663895be4ea55454d21c7a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be12dd50>
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_e5b3e48eac6d147d46b864fa6b64f0f5.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_e5b3e48eac6d147d46b864fa6b64f0f5.jpg saved to cache
2026-03-27 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e37bf0ce-5ada-5e23-93e6-46c5e633e60d
2026-03-27 10:34:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c53b2810>
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F20%252F8e200d8954396204037a758c6dd5c724%252Fpa%252FNL50541_46c4df12763fca020e5789767ee82f04.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_46c4df12763fca020e5789767ee82f04.jpg saved to cache
2026-03-27 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b989f977-03f8-524b-b789-c6c3e12d3a40
2026-03-27 10:34:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b989f977-03f8-524b-b789-c6c3e12d3a40, skipping ID generation
2026-03-27 10:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b989f977-03f8-524b-b789-c6c3e12d3a40 with scrape type 1
2026-03-27 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b989f977-03f8-524b-b789-c6c3e12d3a40 sending to next pipeline
2026-03-27 10:34:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b989f977-03f8-524b-b789-c6c3e12d3a40, identifier: NL50541
2026-03-27 10:34:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be09add0>
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_54ebf6e62ce34abe0814bbf0cc994df7.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_54ebf6e62ce34abe0814bbf0cc994df7.jpg saved to cache
2026-03-27 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e37bf0ce-5ada-5e23-93e6-46c5e633e60d
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be217fd0>
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_284dec111ca7b93ddfb5e83bb7d37e33.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_284dec111ca7b93ddfb5e83bb7d37e33.jpg saved to cache
2026-03-27 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f7aca7eb-4622-58f1-bd6f-135a79fab690
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf383310>
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_0e719442597c329aae3ae4bb3383c178.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_0e719442597c329aae3ae4bb3383c178.jpg saved to cache
2026-03-27 10:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f7aca7eb-4622-58f1-bd6f-135a79fab690
2026-03-27 10:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b989f977-03f8-524b-b789-c6c3e12d3a40 with identifier: NL50541
2026-03-27 10:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b989f977-03f8-524b-b789-c6c3e12d3a40 with identifier: NL50541
2026-03-27 10:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b989f977-03f8-524b-b789-c6c3e12d3a40 with identifier: NL50541 to the API
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_46c4df12763fca020e5789767ee82f04.jpg>
{'auction_title': '',
'c_o_2_emission_value': 146,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:37:39Z',
'fuel_type': 'petrol',
'id': 'b989f977-03f8-524b-b789-c6c3e12d3a40',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL50541',
'listing': 'auction',
'location': 'DE, Tostedt',
'make': 'Ford',
'model': 'Focus',
'odometer': 82885,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91975,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_4426a293ef14d08de78c45fd4318c63b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_0655cbdb12efd7dc5db577dc8b4c550d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110257,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_8e25cdbfaefb41636591ec29d937a6f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_2e526f432e0d46c32bb7bd7fcf76aa9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_16cf5fdc4fc02c81fb6f5e183f363cf3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_81907d5b4edf48945cfc17b14bc2230f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59700,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_88decfff406387b8a6df0a7279c43545.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_e08c79f91a3777813b97d626b8cdea03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_02ce6ff96eb8e556617953c53275783d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b989f977-03f8-524b-b789-c6c3e12d3a40/b989f977-03f8-524b-b789-c6c3e12d3a40_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3440934,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8e/20/8e200d8954396204037a758c6dd5c724/pa/NL50541_46c4df12763fca020e5789767ee82f04.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.6 Ti-VCT Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2013}
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL50541%27 HTTP/1.1" 200 None
2026-03-27 10:34:30 [auto1.de] INFO: Saving data for NL50541: {'created_time': 1774607670.340112, 'last_price_update_time': 1774607670.34013, 'auction_closing_time': 1774715859.0}
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL50541') HTTP/1.1" 204 0
2026-03-27 10:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_7e1d49c2f30ab14733e807964763f5df.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be13a710>
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_f83b33c8cadd1f09ef06e7473a424605.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_f83b33c8cadd1f09ef06e7473a424605.jpg saved to cache
2026-03-27 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e37bf0ce-5ada-5e23-93e6-46c5e633e60d
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be204dd0>
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_83261755370f3dce68f0bfc7ac79c175.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_83261755370f3dce68f0bfc7ac79c175.jpg saved to cache
2026-03-27 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f9e68008-6e09-585a-8a23-6e61472fd2d7
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be220750>
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_a54c832f91663895be4ea55454d21c7a.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_a54c832f91663895be4ea55454d21c7a.jpg saved to cache
2026-03-27 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f7aca7eb-4622-58f1-bd6f-135a79fab690
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be107e50>
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_7e1d49c2f30ab14733e807964763f5df.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_7e1d49c2f30ab14733e807964763f5df.jpg saved to cache
2026-03-27 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e37bf0ce-5ada-5e23-93e6-46c5e633e60d
2026-03-27 10:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_da4bac6b9197b588c0c46f6db693ad76.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_1187103cf1c0465fc38ba20927c0b516.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_d3e0ff5f15427cc8b31c816d38be8856.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_ebdcbb3e236b130b990d7803c6bbf161.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_e575b03299bde13d3119baab0e2403df.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be138e90>
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_da4bac6b9197b588c0c46f6db693ad76.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_da4bac6b9197b588c0c46f6db693ad76.jpg saved to cache
2026-03-27 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dc6cb348-dd04-59cc-8e81-195f4ed65c45
2026-03-27 10:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_d4ed0fedec14203b3bf3ff44d241e3a8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_4ecbb13c74fd4ba0c634889c97e905a4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_3b5aae4e141876c46e64b72ed08890bd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be10e510>
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F02%252Fe5020e12a98bad329e2edd520dfa525c%252Fpa%252FVT76935_1187103cf1c0465fc38ba20927c0b516.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_1187103cf1c0465fc38ba20927c0b516.jpg saved to cache
2026-03-27 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e37bf0ce-5ada-5e23-93e6-46c5e633e60d
2026-03-27 10:34:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e37bf0ce-5ada-5e23-93e6-46c5e633e60d, skipping ID generation
2026-03-27 10:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37bf0ce-5ada-5e23-93e6-46c5e633e60d with scrape type 1
2026-03-27 10:34:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e37bf0ce-5ada-5e23-93e6-46c5e633e60d sending to next pipeline
2026-03-27 10:34:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e37bf0ce-5ada-5e23-93e6-46c5e633e60d, identifier: VT76935
2026-03-27 10:34:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf46c750>
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_d3e0ff5f15427cc8b31c816d38be8856.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_d3e0ff5f15427cc8b31c816d38be8856.jpg saved to cache
2026-03-27 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f9e68008-6e09-585a-8a23-6e61472fd2d7
2026-03-27 10:34:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3c4b50>
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_ebdcbb3e236b130b990d7803c6bbf161.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_ebdcbb3e236b130b990d7803c6bbf161.jpg saved to cache
2026-03-27 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f9e68008-6e09-585a-8a23-6e61472fd2d7
2026-03-27 10:34:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf51cc90>
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_e575b03299bde13d3119baab0e2403df.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_e575b03299bde13d3119baab0e2403df.jpg saved to cache
2026-03-27 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc6cb348-dd04-59cc-8e81-195f4ed65c45
2026-03-27 10:34:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e37bf0ce-5ada-5e23-93e6-46c5e633e60d with identifier: VT76935
2026-03-27 10:34:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e37bf0ce-5ada-5e23-93e6-46c5e633e60d with identifier: VT76935
2026-03-27 10:34:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e37bf0ce-5ada-5e23-93e6-46c5e633e60d with identifier: VT76935 to the API
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_1187103cf1c0465fc38ba20927c0b516.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-28T16:19:45Z',
'fuel_type': 'petrol',
'id': 'e37bf0ce-5ada-5e23-93e6-46c5e633e60d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT76935',
'listing': 'auction',
'location': 'DE, Reutlingen',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 129056,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_7263d6912574db6b7b27a35904e8c1fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_f7b6b79f9f9f586c5036b8cc1f9312f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75614,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_7e1d49c2f30ab14733e807964763f5df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2728492,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_1187103cf1c0465fc38ba20927c0b516.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64880,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_4c2601709813841efe43a2464805e8c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67809,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_f83b33c8cadd1f09ef06e7473a424605.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_e41a828cf0867fc1fc5100589c6bfb7f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2758706,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_54ebf6e62ce34abe0814bbf0cc994df7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66092,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_2221dae0d53d481d81acce54ccfdcd5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e37bf0ce-5ada-5e23-93e6-46c5e633e60d/e37bf0ce-5ada-5e23-93e6-46c5e633e60d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2614955,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/02/e5020e12a98bad329e2edd520dfa525c/pa/VT76935_e5b3e48eac6d147d46b864fa6b64f0f5.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-11',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.25 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2017}
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT76935%27 HTTP/1.1" 200 None
2026-03-27 10:34:31 [auto1.de] INFO: Saving data for VT76935: {'created_time': 1774607671.781345, 'last_price_update_time': 1774607671.781359, 'auction_closing_time': 1774714785.0}
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT76935') HTTP/1.1" 204 0
2026-03-27 10:34:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f7bd0>
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fb8%252Fb6b85b6a4855b2c23c9a8475a74503dd%252Fpa%252FWT41205_d4ed0fedec14203b3bf3ff44d241e3a8.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_d4ed0fedec14203b3bf3ff44d241e3a8.jpg saved to cache
2026-03-27 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f7aca7eb-4622-58f1-bd6f-135a79fab690
2026-03-27 10:34:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7aca7eb-4622-58f1-bd6f-135a79fab690, skipping ID generation
2026-03-27 10:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7aca7eb-4622-58f1-bd6f-135a79fab690 with scrape type 1
2026-03-27 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7aca7eb-4622-58f1-bd6f-135a79fab690 sending to next pipeline
2026-03-27 10:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7aca7eb-4622-58f1-bd6f-135a79fab690, identifier: WT41205
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf54a3d0>
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_4ecbb13c74fd4ba0c634889c97e905a4.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_4ecbb13c74fd4ba0c634889c97e905a4.jpg saved to cache
2026-03-27 10:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc6cb348-dd04-59cc-8e81-195f4ed65c45
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf54a350>
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_3b5aae4e141876c46e64b72ed08890bd.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_3b5aae4e141876c46e64b72ed08890bd.jpg saved to cache
2026-03-27 10:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f9e68008-6e09-585a-8a23-6e61472fd2d7
2026-03-27 10:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7aca7eb-4622-58f1-bd6f-135a79fab690 with identifier: WT41205
2026-03-27 10:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7aca7eb-4622-58f1-bd6f-135a79fab690 with identifier: WT41205
2026-03-27 10:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7aca7eb-4622-58f1-bd6f-135a79fab690 with identifier: WT41205 to the API
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_d4ed0fedec14203b3bf3ff44d241e3a8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '0.9L',
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:11:32Z',
'fuel_type': 'petrol',
'id': 'f7aca7eb-4622-58f1-bd6f-135a79fab690',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT41205',
'listing': 'auction',
'location': 'DE, Kerpen',
'make': 'Smart',
'model': 'forfour',
'odometer': 40096,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_1e8a8523d84586dea63d9903357f5410.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_61952697ac5d138476bbb34bd16f6bd5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_d4ed0fedec14203b3bf3ff44d241e3a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65454,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_0e719442597c329aae3ae4bb3383c178.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_83c6e85dc3114ad2107379797427c186.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_a54c832f91663895be4ea55454d21c7a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_284dec111ca7b93ddfb5e83bb7d37e33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_51624577f3a419eb73ae8ff1ee60012d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81400,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_e81acdfe96612ca4aaf8e909aa483eed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7aca7eb-4622-58f1-bd6f-135a79fab690/f7aca7eb-4622-58f1-bd6f-135a79fab690_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65917,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/b8/b6b85b6a4855b2c23c9a8475a74503dd/pa/WT41205_af7654b4080481b49d0e5cb665d807ac.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-06-03',
'seats_number': 4,
'seller_name': None,
'title': 'Smart forfour 0.9 Turbo Basis Prime',
'transmission': 'manual',
'trim': 'Basis Prime',
'year': 2018}
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT41205%27 HTTP/1.1" 200 None
2026-03-27 10:34:32 [auto1.de] INFO: Saving data for WT41205: {'created_time': 1774607672.417099, 'last_price_update_time': 1774607672.41711, 'auction_closing_time': 1774714292.0}
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT41205') HTTP/1.1" 204 0
2026-03-27 10:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_d5850a7c77d14adbf37ef86ea8564e5f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_cb5e43830d9a3be75ad53d40f6da22fc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_3e93bc43589d0044567df66d45e9dea1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_dce16b7125e5b96e20720c7733b26e7e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_4a6e70f55bcc4c164f1daca851d33dd8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_4cc16c3b2171c3058420d31df5443e67.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_8d5a922afb1bd362bdbd0f1da158be8e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_7ae2fbc849e9a533d76a63093b729f87.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_f44746e896b44a81daea118615552d31.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5ee810>
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_d5850a7c77d14adbf37ef86ea8564e5f.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_d5850a7c77d14adbf37ef86ea8564e5f.jpg saved to cache
2026-03-27 10:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc6cb348-dd04-59cc-8e81-195f4ed65c45
2026-03-27 10:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_f437c7308d152514924951a15484c5ec.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf303c10>
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_cb5e43830d9a3be75ad53d40f6da22fc.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_cb5e43830d9a3be75ad53d40f6da22fc.jpg saved to cache
2026-03-27 10:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9e68008-6e09-585a-8a23-6e61472fd2d7
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be128f50>
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_3e93bc43589d0044567df66d45e9dea1.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_3e93bc43589d0044567df66d45e9dea1.jpg saved to cache
2026-03-27 10:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc6cb348-dd04-59cc-8e81-195f4ed65c45
2026-03-27 10:34:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1b08d0>
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_dce16b7125e5b96e20720c7733b26e7e.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_dce16b7125e5b96e20720c7733b26e7e.jpg saved to cache
2026-03-27 10:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc6cb348-dd04-59cc-8e81-195f4ed65c45
2026-03-27 10:34:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5511e90>
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_4a6e70f55bcc4c164f1daca851d33dd8.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_4a6e70f55bcc4c164f1daca851d33dd8.jpg saved to cache
2026-03-27 10:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc6cb348-dd04-59cc-8e81-195f4ed65c45
2026-03-27 10:34:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be12ab50>
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Faa%252F68aac7a8cd830722901e7b427b894771%252Fpa%252FMW22662_4cc16c3b2171c3058420d31df5443e67.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_4cc16c3b2171c3058420d31df5443e67.jpg saved to cache
2026-03-27 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc6cb348-dd04-59cc-8e81-195f4ed65c45
2026-03-27 10:34:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc6cb348-dd04-59cc-8e81-195f4ed65c45, skipping ID generation
2026-03-27 10:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc6cb348-dd04-59cc-8e81-195f4ed65c45 with scrape type 1
2026-03-27 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc6cb348-dd04-59cc-8e81-195f4ed65c45 sending to next pipeline
2026-03-27 10:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc6cb348-dd04-59cc-8e81-195f4ed65c45, identifier: MW22662
2026-03-27 10:34:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2c6a50>
2026-03-27 10:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_8d5a922afb1bd362bdbd0f1da158be8e.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_8d5a922afb1bd362bdbd0f1da158be8e.jpg saved to cache
2026-03-27 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f9e68008-6e09-585a-8a23-6e61472fd2d7
2026-03-27 10:34:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5376010>
2026-03-27 10:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F7f%252Ff67f96808947215eba3f0b1b417b0c63%252Fpa%252FMV22283_7ae2fbc849e9a533d76a63093b729f87.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_7ae2fbc849e9a533d76a63093b729f87.jpg saved to cache
2026-03-27 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f9e68008-6e09-585a-8a23-6e61472fd2d7
2026-03-27 10:34:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9e68008-6e09-585a-8a23-6e61472fd2d7, skipping ID generation
2026-03-27 10:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9e68008-6e09-585a-8a23-6e61472fd2d7 with scrape type 1
2026-03-27 10:34:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9e68008-6e09-585a-8a23-6e61472fd2d7 sending to next pipeline
2026-03-27 10:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9e68008-6e09-585a-8a23-6e61472fd2d7, identifier: MV22283
2026-03-27 10:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc6cb348-dd04-59cc-8e81-195f4ed65c45 with identifier: MW22662
2026-03-27 10:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc6cb348-dd04-59cc-8e81-195f4ed65c45 with identifier: MW22662
2026-03-27 10:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc6cb348-dd04-59cc-8e81-195f4ed65c45 with identifier: MW22662 to the API
2026-03-27 10:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_4cc16c3b2171c3058420d31df5443e67.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:00:25Z',
'fuel_type': 'diesel',
'id': 'dc6cb348-dd04-59cc-8e81-195f4ed65c45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW22662',
'listing': 'auction',
'location': 'DE, Wilhelmshaven',
'make': 'Ford',
'model': 'Transit',
'odometer': 161813,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2467851,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_a4428129224779a0333cac9bb148f292.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2538074,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_9ae34ec063c2ad5faa0e347d7e604e4c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_3e93bc43589d0044567df66d45e9dea1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_d5850a7c77d14adbf37ef86ea8564e5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2188088,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_dce16b7125e5b96e20720c7733b26e7e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2551683,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_4cc16c3b2171c3058420d31df5443e67.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2370896,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_4a6e70f55bcc4c164f1daca851d33dd8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_4ecbb13c74fd4ba0c634889c97e905a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2422436,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_e575b03299bde13d3119baab0e2403df.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc6cb348-dd04-59cc-8e81-195f4ed65c45/dc6cb348-dd04-59cc-8e81-195f4ed65c45_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2692801,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img68/aa/68aac7a8cd830722901e7b427b894771/pa/MW22662_da4bac6b9197b588c0c46f6db693ad76.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-03-18',
'seats_number': 3,
'seller_name': None,
'title': 'Ford Transit 1.6 TDCi Kasten',
'transmission': 'manual',
'trim': 'Kasten',
'year': 2015}
2026-03-27 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW22662%27 HTTP/1.1" 200 None
2026-03-27 10:34:33 [auto1.de] INFO: Saving data for MW22662: {'created_time': 1774607673.95788, 'last_price_update_time': 1774607673.957895, 'auction_closing_time': 1774713625.0}
2026-03-27 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW22662') HTTP/1.1" 204 0
2026-03-27 10:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9e68008-6e09-585a-8a23-6e61472fd2d7 with identifier: MV22283
2026-03-27 10:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9e68008-6e09-585a-8a23-6e61472fd2d7 with identifier: MV22283
2026-03-27 10:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9e68008-6e09-585a-8a23-6e61472fd2d7 with identifier: MV22283 to the API
2026-03-27 10:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_7ae2fbc849e9a533d76a63093b729f87.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:37:50Z',
'fuel_type': 'petrol',
'id': 'f9e68008-6e09-585a-8a23-6e61472fd2d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV22283',
'listing': 'auction',
'location': 'DE, Norderstedt',
'make': 'Seat',
'model': 'Leon',
'odometer': 119709,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84392,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_cb5e43830d9a3be75ad53d40f6da22fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2704078,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_7ae2fbc849e9a533d76a63093b729f87.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73363,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_178f340b5bddca51679c202b62ff80a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62965,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_0587d27345133bfdf1e956871d18abd4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2619319,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_8d5a922afb1bd362bdbd0f1da158be8e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_3b5aae4e141876c46e64b72ed08890bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2711793,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_ebdcbb3e236b130b990d7803c6bbf161.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_e57cd4471732082216444fd95b7b95f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74342,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_83261755370f3dce68f0bfc7ac79c175.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e68008-6e09-585a-8a23-6e61472fd2d7/f9e68008-6e09-585a-8a23-6e61472fd2d7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2874472,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/7f/f67f96808947215eba3f0b1b417b0c63/pa/MV22283_d3e0ff5f15427cc8b31c816d38be8856.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Leon 1.4 TSI ACT FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2016}
2026-03-27 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV22283%27 HTTP/1.1" 200 None
2026-03-27 10:34:34 [auto1.de] INFO: Saving data for MV22283: {'created_time': 1774607674.404054, 'last_price_update_time': 1774607674.404066, 'auction_closing_time': 1774715870.0}
2026-03-27 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV22283') HTTP/1.1" 204 0
2026-03-27 10:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1f6d50>
2026-03-27 10:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_f44746e896b44a81daea118615552d31.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_f44746e896b44a81daea118615552d31.jpg saved to cache
2026-03-27 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ec27e1a-c227-5dad-b824-0d399b539a74
2026-03-27 10:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_b47bec5f0e6146f20192e5c0fca23cf4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_aa83f3e5c29a72db24e2b625bcfcb115.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_b97a646d1a2398a0c414e942db90e818.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WR99181> (referer: https://www.auto1.com/v1/car-details-view/WR99181/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA44092> (referer: https://www.auto1.com/v1/car-details-view/LA44092/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CK79873/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be099790>
2026-03-27 10:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F9c%252F5b9cb1ae605bfedb34758cb8c35c5641%252Fpa%252FEM63340_f437c7308d152514924951a15484c5ec.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_f437c7308d152514924951a15484c5ec.jpg saved to cache
2026-03-27 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 68f83d7a-9e20-5a0f-ade1-0a60276be417
2026-03-27 10:34:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68f83d7a-9e20-5a0f-ade1-0a60276be417, skipping ID generation
2026-03-27 10:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68f83d7a-9e20-5a0f-ade1-0a60276be417 with scrape type 1
2026-03-27 10:34:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68f83d7a-9e20-5a0f-ade1-0a60276be417 sending to next pipeline
2026-03-27 10:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68f83d7a-9e20-5a0f-ade1-0a60276be417, identifier: EM63340
2026-03-27 10:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68f83d7a-9e20-5a0f-ade1-0a60276be417 with identifier: EM63340
2026-03-27 10:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68f83d7a-9e20-5a0f-ade1-0a60276be417 with identifier: EM63340
2026-03-27 10:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68f83d7a-9e20-5a0f-ade1-0a60276be417 with identifier: EM63340 to the API
2026-03-27 10:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_f437c7308d152514924951a15484c5ec.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:38:32Z',
'fuel_type': 'petrol',
'id': '68f83d7a-9e20-5a0f-ade1-0a60276be417',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM63340',
'listing': 'auction',
'location': 'DE',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 185459,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114463,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_edbb89c99b38dc55bcb82a9f1d95556a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110810,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_1b5ea1e728b40a357be51be96c97e704.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_c9007eabc837b4dbcb1a159435938bd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_beee3676ebfcd99f1a6f7ce0bd0be648.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95534,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_06c276417b29415778338ea82ee47908.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102734,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_85ecde1aba9872ef39388794c58302a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107138,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_55db09adbde689503d045bd0ba50116b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_f039f4c8d4477e0ef6bbadc09dc915cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_f437c7308d152514924951a15484c5ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68f83d7a-9e20-5a0f-ade1-0a60276be417/68f83d7a-9e20-5a0f-ade1-0a60276be417_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/9c/5b9cb1ae605bfedb34758cb8c35c5641/pa/EM63340_40d23f693c381b73dd0aad805f13be42.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-07-12',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.2 TSI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2011}
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM63340%27 HTTP/1.1" 200 None
2026-03-27 10:34:35 [auto1.de] INFO: Saving data for EM63340: {'created_time': 1774607675.061764, 'last_price_update_time': 1774607675.061776, 'auction_closing_time': 1774715912.0}
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM63340') HTTP/1.1" 204 0
2026-03-27 10:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be166490>
2026-03-27 10:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F2a%252F612a9d51698f563a453112206ef4a75b%252Fpa%252FGH02109_b47bec5f0e6146f20192e5c0fca23cf4.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_b47bec5f0e6146f20192e5c0fca23cf4.jpg saved to cache
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ec27e1a-c227-5dad-b824-0d399b539a74
2026-03-27 10:34:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ec27e1a-c227-5dad-b824-0d399b539a74, skipping ID generation
2026-03-27 10:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ec27e1a-c227-5dad-b824-0d399b539a74 with scrape type 1
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ec27e1a-c227-5dad-b824-0d399b539a74 sending to next pipeline
2026-03-27 10:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ec27e1a-c227-5dad-b824-0d399b539a74, identifier: GH02109
2026-03-27 10:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f7d90>
2026-03-27 10:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_aa83f3e5c29a72db24e2b625bcfcb115.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_aa83f3e5c29a72db24e2b625bcfcb115.jpg saved to cache
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09229703-dce0-55c9-9182-c8b672313250
2026-03-27 10:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf544190>
2026-03-27 10:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_b97a646d1a2398a0c414e942db90e818.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_b97a646d1a2398a0c414e942db90e818.jpg saved to cache
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d42e471d-29d6-5e33-9d9d-5152535fa1a9
2026-03-27 10:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612a6b31-5044-57df-a10e-0a9b2401b357 with identifier: WR99181
2026-03-27 10:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612a6b31-5044-57df-a10e-0a9b2401b357 with scrape type 1
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 612a6b31-5044-57df-a10e-0a9b2401b357
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fdf%252F03df793191d45b28d5b50418aa11de23%252Fpa%252FWR99181_d7950cc4e93913227e42c1aa09301cee.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_d7950cc4e93913227e42c1aa09301cee.jpg not downloaded yet
2026-03-27 10:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7624d114-9828-5d79-866c-1581d325b944 with identifier: LA44092
2026-03-27 10:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7624d114-9828-5d79-866c-1581d325b944 with scrape type 1
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7624d114-9828-5d79-866c-1581d325b944
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fa0%252Fe3a0b3ba3e8212c36af784044f85b80b%252Fpa%252FLA44092_7f9646d83dc703f602f8a215ad221bac.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_7f9646d83dc703f602f8a215ad221bac.jpg not downloaded yet
2026-03-27 10:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ec27e1a-c227-5dad-b824-0d399b539a74 with identifier: GH02109
2026-03-27 10:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ec27e1a-c227-5dad-b824-0d399b539a74 with identifier: GH02109
2026-03-27 10:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ec27e1a-c227-5dad-b824-0d399b539a74 with identifier: GH02109 to the API
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_b47bec5f0e6146f20192e5c0fca23cf4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:50:34Z',
'fuel_type': 'diesel',
'id': '2ec27e1a-c227-5dad-b824-0d399b539a74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH02109',
'listing': 'auction',
'location': 'DE, Hof',
'make': 'BMW',
'model': '3er',
'odometer': 153373,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115400,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_f44746e896b44a81daea118615552d31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111943,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_b47bec5f0e6146f20192e5c0fca23cf4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109424,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_657dc4667ba85323850823e1b68494b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98965,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_6fb6c5eecaaec64a2c377015ea2928c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_7f91a717db00fb0931dc847bdba12842.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_8bf121332afe54f435338df0642872ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101678,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_b12ced83f2202689542183890c029e1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112626,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_be858d200b26a6970c8656a0a287249c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67409,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_c3a686dc33336802bab62c2e8b73068a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ec27e1a-c227-5dad-b824-0d399b539a74/2ec27e1a-c227-5dad-b824-0d399b539a74_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/2a/612a9d51698f563a453112206ef4a75b/pa/GH02109_c3b12b54bd89c59f4de134a709fa3002.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-06',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 320d Mild-Hybrid Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2022}
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH02109%27 HTTP/1.1" 200 None
2026-03-27 10:34:35 [auto1.de] INFO: Saving data for GH02109: {'created_time': 1774607675.742035, 'last_price_update_time': 1774607675.742051, 'auction_closing_time': 1774716634.0}
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH02109') HTTP/1.1" 204 0
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fdf%252F03df793191d45b28d5b50418aa11de23%252Fpa%252FWR99181_a305c4bfecbb385881a05bda8947cf4b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_a305c4bfecbb385881a05bda8947cf4b.jpg not downloaded yet
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fa0%252Fe3a0b3ba3e8212c36af784044f85b80b%252Fpa%252FLA44092_ac7750a0b75b0ac4c66f83c273b0d371.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_ac7750a0b75b0ac4c66f83c273b0d371.jpg not downloaded yet
2026-03-27 10:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_31128fa4287ccf2a5309685d9a467bcf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_27e17802010d2cf3830db27d9726c7b7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_2b6b4db7d29c1ff06ad8ba5c3c3ec7c8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_fed3abf6b3bdf8b3bb31abd7ad057c51.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX51342/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AE12757> (referer: https://www.auto1.com/v1/car-details-view/AE12757/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fdf%252F03df793191d45b28d5b50418aa11de23%252Fpa%252FWR99181_efefd14a5508eecf3fb65be5f09b3a39.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_efefd14a5508eecf3fb65be5f09b3a39.jpg not downloaded yet
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fa0%252Fe3a0b3ba3e8212c36af784044f85b80b%252Fpa%252FLA44092_8d7067ab0f2ff2e142e4884ae4c33702.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_8d7067ab0f2ff2e142e4884ae4c33702.jpg not downloaded yet
2026-03-27 10:34:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fdf%252F03df793191d45b28d5b50418aa11de23%252Fpa%252FWR99181_e4ddc56d9fecfa76eb9df38e491f70ee.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_e4ddc56d9fecfa76eb9df38e491f70ee.jpg not downloaded yet
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fa0%252Fe3a0b3ba3e8212c36af784044f85b80b%252Fpa%252FLA44092_9ddd03a8cd6a51426b3edcc49b15a37a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_9ddd03a8cd6a51426b3edcc49b15a37a.jpg not downloaded yet
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fdf%252F03df793191d45b28d5b50418aa11de23%252Fpa%252FWR99181_5b57144f752e71a2d580bce13dcaf9d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_5b57144f752e71a2d580bce13dcaf9d7.jpg not downloaded yet
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fa0%252Fe3a0b3ba3e8212c36af784044f85b80b%252Fpa%252FLA44092_513ed169b8a157dc7069c82d0fc80d7f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_513ed169b8a157dc7069c82d0fc80d7f.jpg not downloaded yet
2026-03-27 10:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_7f9646d83dc703f602f8a215ad221bac.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_a305c4bfecbb385881a05bda8947cf4b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_ac7750a0b75b0ac4c66f83c273b0d371.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5fbe50>
2026-03-27 10:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_31128fa4287ccf2a5309685d9a467bcf.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_31128fa4287ccf2a5309685d9a467bcf.jpg saved to cache
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09229703-dce0-55c9-9182-c8b672313250
2026-03-27 10:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2f33d0>
2026-03-27 10:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_27e17802010d2cf3830db27d9726c7b7.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_27e17802010d2cf3830db27d9726c7b7.jpg saved to cache
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09229703-dce0-55c9-9182-c8b672313250
2026-03-27 10:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3d44d0>
2026-03-27 10:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_2b6b4db7d29c1ff06ad8ba5c3c3ec7c8.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_2b6b4db7d29c1ff06ad8ba5c3c3ec7c8.jpg saved to cache
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 612708e7-8aa9-5dc5-a611-84b01b85751b
2026-03-27 10:34:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1f5e90>
2026-03-27 10:34:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe4%252F87e4075accbafc0cf72c9c379b560bbe%252Fpa%252FDW23670_fed3abf6b3bdf8b3bb31abd7ad057c51.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_fed3abf6b3bdf8b3bb31abd7ad057c51.jpg saved to cache
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09229703-dce0-55c9-9182-c8b672313250
2026-03-27 10:34:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09229703-dce0-55c9-9182-c8b672313250, skipping ID generation
2026-03-27 10:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09229703-dce0-55c9-9182-c8b672313250 with scrape type 1
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09229703-dce0-55c9-9182-c8b672313250 sending to next pipeline
2026-03-27 10:34:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09229703-dce0-55c9-9182-c8b672313250, identifier: DW23670
2026-03-27 10:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a5afcd7-84b7-5df2-b91b-d574dc56f074 with identifier: AE12757
2026-03-27 10:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a5afcd7-84b7-5df2-b91b-d574dc56f074 with scrape type 1
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a5afcd7-84b7-5df2-b91b-d574dc56f074
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F71%252Ffe71c71e52864036b6d88015becd8280%252Fpa%252FAE12757_bddcb74d1ff92bec46dae8b1abb87b36.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_bddcb74d1ff92bec46dae8b1abb87b36.jpg already downloaded
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F71%252Ffe71c71e52864036b6d88015becd8280%252Fpa%252FAE12757_f761989233112fca085b3b6c13f41778.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_f761989233112fca085b3b6c13f41778.jpg already downloaded
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F71%252Ffe71c71e52864036b6d88015becd8280%252Fpa%252FAE12757_2bb749dfcf45a6deacde80acc4d07109.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_2bb749dfcf45a6deacde80acc4d07109.jpg already downloaded
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F71%252Ffe71c71e52864036b6d88015becd8280%252Fpa%252FAE12757_7c17297e2bdf533a3907cd2d94a5ed27.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_7c17297e2bdf533a3907cd2d94a5ed27.jpg already downloaded
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F71%252Ffe71c71e52864036b6d88015becd8280%252Fpa%252FAE12757_5368e2fc53d27f45c39b26ebf2835205.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_5368e2fc53d27f45c39b26ebf2835205.jpg already downloaded
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F71%252Ffe71c71e52864036b6d88015becd8280%252Fpa%252FAE12757_92fc03eca0e9f7e09494ffcd72cf3806.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_92fc03eca0e9f7e09494ffcd72cf3806.jpg already downloaded
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F71%252Ffe71c71e52864036b6d88015becd8280%252Fpa%252FAE12757_8a4497a1c2cc52138ab5cd49af022dcf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_8a4497a1c2cc52138ab5cd49af022dcf.jpg already downloaded
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F71%252Ffe71c71e52864036b6d88015becd8280%252Fpa%252FAE12757_b10d949d78dadc9bc48563c782dcca33.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_b10d949d78dadc9bc48563c782dcca33.jpg already downloaded
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F71%252Ffe71c71e52864036b6d88015becd8280%252Fpa%252FAE12757_cc2f702b73629cb4e6153cf6ed93dcf0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_cc2f702b73629cb4e6153cf6ed93dcf0.jpg already downloaded
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F71%252Ffe71c71e52864036b6d88015becd8280%252Fpa%252FAE12757_a839b0088bd454306c320e85ba2aea04.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_a839b0088bd454306c320e85ba2aea04.jpg already downloaded
2026-03-27 10:34:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a5afcd7-84b7-5df2-b91b-d574dc56f074, identifier: AE12757
2026-03-27 10:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_d7950cc4e93913227e42c1aa09301cee.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09229703-dce0-55c9-9182-c8b672313250 with identifier: DW23670
2026-03-27 10:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09229703-dce0-55c9-9182-c8b672313250 with identifier: DW23670
2026-03-27 10:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09229703-dce0-55c9-9182-c8b672313250 with identifier: DW23670 to the API
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_fed3abf6b3bdf8b3bb31abd7ad057c51.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:21:59Z',
'fuel_type': 'diesel',
'id': '09229703-dce0-55c9-9182-c8b672313250',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW23670',
'listing': 'auction',
'location': 'DE, Bad Hersfeld',
'make': 'Ford',
'model': 'Transit',
'odometer': 50519,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92552,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_31128fa4287ccf2a5309685d9a467bcf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_c4425ac685e85584ac13ae71c26afa6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68129,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_27e17802010d2cf3830db27d9726c7b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65377,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_fed3abf6b3bdf8b3bb31abd7ad057c51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_8d3551973abaceeac87a0cef17309453.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100091,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_9c1bf622162537882e7a101ac7070372.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78675,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_6a705df4f54d62fa5fcd4591b8a651f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_00c824f8d13b5d37d359856a87cbe96e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66241,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_aa83f3e5c29a72db24e2b625bcfcb115.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09229703-dce0-55c9-9182-c8b672313250/09229703-dce0-55c9-9182-c8b672313250_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62137,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/e4/87e4075accbafc0cf72c9c379b560bbe/pa/DW23670_872d195b0e5cf6d23d8cecc05247708b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-02-05',
'seats_number': 3,
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
'transmission': 'manual',
'trim': '350 L3 Trend',
'year': 2023}
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW23670%27 HTTP/1.1" 200 None
2026-03-27 10:34:36 [auto1.de] INFO: Saving data for DW23670: {'created_time': 1774607676.978056, 'last_price_update_time': 1774607676.97807, 'auction_closing_time': 1774714919.0}
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW23670') HTTP/1.1" 204 0
2026-03-27 10:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a5afcd7-84b7-5df2-b91b-d574dc56f074 with identifier: AE12757
2026-03-27 10:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a5afcd7-84b7-5df2-b91b-d574dc56f074 with identifier: AE12757
2026-03-27 10:34:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a5afcd7-84b7-5df2-b91b-d574dc56f074 with identifier: AE12757 to the API
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AE12757>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:05:04Z',
'fuel_type': 'diesel',
'id': '4a5afcd7-84b7-5df2-b91b-d574dc56f074',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE12757',
'listing': 'auction',
'location': 'DE, Lüdersfeld',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 228944,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_bddcb74d1ff92bec46dae8b1abb87b36.jpg',
'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_f761989233112fca085b3b6c13f41778.jpg',
'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_2bb749dfcf45a6deacde80acc4d07109.jpg',
'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_7c17297e2bdf533a3907cd2d94a5ed27.jpg',
'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_5368e2fc53d27f45c39b26ebf2835205.jpg',
'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_92fc03eca0e9f7e09494ffcd72cf3806.jpg',
'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_8a4497a1c2cc52138ab5cd49af022dcf.jpg',
'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_b10d949d78dadc9bc48563c782dcca33.jpg',
'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_cc2f702b73629cb4e6153cf6ed93dcf0.jpg',
'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_a839b0088bd454306c320e85ba2aea04.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5afcd7-84b7-5df2-b91b-d574dc56f074/4a5afcd7-84b7-5df2-b91b-d574dc56f074_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2784407,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_bddcb74d1ff92bec46dae8b1abb87b36.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5afcd7-84b7-5df2-b91b-d574dc56f074/4a5afcd7-84b7-5df2-b91b-d574dc56f074_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2839549,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_f761989233112fca085b3b6c13f41778.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5afcd7-84b7-5df2-b91b-d574dc56f074/4a5afcd7-84b7-5df2-b91b-d574dc56f074_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2960766,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_2bb749dfcf45a6deacde80acc4d07109.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5afcd7-84b7-5df2-b91b-d574dc56f074/4a5afcd7-84b7-5df2-b91b-d574dc56f074_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2913567,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_7c17297e2bdf533a3907cd2d94a5ed27.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5afcd7-84b7-5df2-b91b-d574dc56f074/4a5afcd7-84b7-5df2-b91b-d574dc56f074_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2901118,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_5368e2fc53d27f45c39b26ebf2835205.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5afcd7-84b7-5df2-b91b-d574dc56f074/4a5afcd7-84b7-5df2-b91b-d574dc56f074_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2810459,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_92fc03eca0e9f7e09494ffcd72cf3806.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5afcd7-84b7-5df2-b91b-d574dc56f074/4a5afcd7-84b7-5df2-b91b-d574dc56f074_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2983928,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_8a4497a1c2cc52138ab5cd49af022dcf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5afcd7-84b7-5df2-b91b-d574dc56f074/4a5afcd7-84b7-5df2-b91b-d574dc56f074_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2854789,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_b10d949d78dadc9bc48563c782dcca33.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5afcd7-84b7-5df2-b91b-d574dc56f074/4a5afcd7-84b7-5df2-b91b-d574dc56f074_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2725340,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_cc2f702b73629cb4e6153cf6ed93dcf0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5afcd7-84b7-5df2-b91b-d574dc56f074/4a5afcd7-84b7-5df2-b91b-d574dc56f074_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2960568,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/71/fe71c71e52864036b6d88015becd8280/pa/AE12757_a839b0088bd454306c320e85ba2aea04.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-10-09',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Highline BlueMotion Tech',
'year': 2014}
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE12757%27 HTTP/1.1" 200 None
2026-03-27 10:34:37 [auto1.de] INFO: Saving data for AE12757: {'created_time': 1774607677.331957, 'last_price_update_time': 1774607677.331968, 'auction_closing_time': 1774713904.0}
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE12757') HTTP/1.1" 204 0
2026-03-27 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_4bde3a83539d3c79a26c49667dd5dd7e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT94626/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA10285/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK99060/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf47b550>
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7624d114-9828-5d79-866c-1581d325b944/7624d114-9828-5d79-866c-1581d325b944_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fa0%252Fe3a0b3ba3e8212c36af784044f85b80b%252Fpa%252FLA44092_7f9646d83dc703f602f8a215ad221bac.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_7f9646d83dc703f602f8a215ad221bac.jpg saved to cache
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7624d114-9828-5d79-866c-1581d325b944
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be207e50>
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_612a6b31-5044-57df-a10e-0a9b2401b357/612a6b31-5044-57df-a10e-0a9b2401b357_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fdf%252F03df793191d45b28d5b50418aa11de23%252Fpa%252FWR99181_a305c4bfecbb385881a05bda8947cf4b.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_a305c4bfecbb385881a05bda8947cf4b.jpg saved to cache
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 612a6b31-5044-57df-a10e-0a9b2401b357
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2ab010>
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7624d114-9828-5d79-866c-1581d325b944/7624d114-9828-5d79-866c-1581d325b944_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fa0%252Fe3a0b3ba3e8212c36af784044f85b80b%252Fpa%252FLA44092_ac7750a0b75b0ac4c66f83c273b0d371.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_ac7750a0b75b0ac4c66f83c273b0d371.jpg saved to cache
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7624d114-9828-5d79-866c-1581d325b944
2026-03-27 10:34:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JL12737/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_9ddd03a8cd6a51426b3edcc49b15a37a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_e4ddc56d9fecfa76eb9df38e491f70ee.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf369750>
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_612a6b31-5044-57df-a10e-0a9b2401b357/612a6b31-5044-57df-a10e-0a9b2401b357_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fdf%252F03df793191d45b28d5b50418aa11de23%252Fpa%252FWR99181_d7950cc4e93913227e42c1aa09301cee.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_d7950cc4e93913227e42c1aa09301cee.jpg saved to cache
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 612a6b31-5044-57df-a10e-0a9b2401b357
2026-03-27 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_5b57144f752e71a2d580bce13dcaf9d7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_513ed169b8a157dc7069c82d0fc80d7f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b1790>
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_4bde3a83539d3c79a26c49667dd5dd7e.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_4bde3a83539d3c79a26c49667dd5dd7e.jpg saved to cache
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 612708e7-8aa9-5dc5-a611-84b01b85751b
2026-03-27 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_7265448cee89d26f28be5f9751a52346.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c564ba10>
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7624d114-9828-5d79-866c-1581d325b944/7624d114-9828-5d79-866c-1581d325b944_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fa0%252Fe3a0b3ba3e8212c36af784044f85b80b%252Fpa%252FLA44092_9ddd03a8cd6a51426b3edcc49b15a37a.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_9ddd03a8cd6a51426b3edcc49b15a37a.jpg saved to cache
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7624d114-9828-5d79-866c-1581d325b944
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c53c7050>
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_612a6b31-5044-57df-a10e-0a9b2401b357/612a6b31-5044-57df-a10e-0a9b2401b357_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fdf%252F03df793191d45b28d5b50418aa11de23%252Fpa%252FWR99181_e4ddc56d9fecfa76eb9df38e491f70ee.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_e4ddc56d9fecfa76eb9df38e491f70ee.jpg saved to cache
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 612a6b31-5044-57df-a10e-0a9b2401b357
2026-03-27 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_8d7067ab0f2ff2e142e4884ae4c33702.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_efefd14a5508eecf3fb65be5f09b3a39.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be24ec50>
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_612a6b31-5044-57df-a10e-0a9b2401b357/612a6b31-5044-57df-a10e-0a9b2401b357_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fdf%252F03df793191d45b28d5b50418aa11de23%252Fpa%252FWR99181_5b57144f752e71a2d580bce13dcaf9d7.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_5b57144f752e71a2d580bce13dcaf9d7.jpg saved to cache
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 612a6b31-5044-57df-a10e-0a9b2401b357
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be197710>
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7624d114-9828-5d79-866c-1581d325b944/7624d114-9828-5d79-866c-1581d325b944_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fa0%252Fe3a0b3ba3e8212c36af784044f85b80b%252Fpa%252FLA44092_513ed169b8a157dc7069c82d0fc80d7f.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_513ed169b8a157dc7069c82d0fc80d7f.jpg saved to cache
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7624d114-9828-5d79-866c-1581d325b944
2026-03-27 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_e90b0db832b8586c2eeaaa15bf8b93aa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be281ad0>
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_7265448cee89d26f28be5f9751a52346.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_7265448cee89d26f28be5f9751a52346.jpg saved to cache
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 612708e7-8aa9-5dc5-a611-84b01b85751b
2026-03-27 10:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_378dd001439d0dd3fb9f48e3bc9a4372.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2d9c10>
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7624d114-9828-5d79-866c-1581d325b944/7624d114-9828-5d79-866c-1581d325b944_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fa0%252Fe3a0b3ba3e8212c36af784044f85b80b%252Fpa%252FLA44092_8d7067ab0f2ff2e142e4884ae4c33702.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_8d7067ab0f2ff2e142e4884ae4c33702.jpg saved to cache
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7624d114-9828-5d79-866c-1581d325b944
2026-03-27 10:34:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7624d114-9828-5d79-866c-1581d325b944, skipping ID generation
2026-03-27 10:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7624d114-9828-5d79-866c-1581d325b944 with scrape type 1
2026-03-27 10:34:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7624d114-9828-5d79-866c-1581d325b944 sending to next pipeline
2026-03-27 10:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7624d114-9828-5d79-866c-1581d325b944, identifier: LA44092
2026-03-27 10:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf544850>
2026-03-27 10:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_612a6b31-5044-57df-a10e-0a9b2401b357/612a6b31-5044-57df-a10e-0a9b2401b357_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fdf%252F03df793191d45b28d5b50418aa11de23%252Fpa%252FWR99181_efefd14a5508eecf3fb65be5f09b3a39.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_efefd14a5508eecf3fb65be5f09b3a39.jpg saved to cache
2026-03-27 10:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 612a6b31-5044-57df-a10e-0a9b2401b357
2026-03-27 10:34:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 612a6b31-5044-57df-a10e-0a9b2401b357, skipping ID generation
2026-03-27 10:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612a6b31-5044-57df-a10e-0a9b2401b357 with scrape type 1
2026-03-27 10:34:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 612a6b31-5044-57df-a10e-0a9b2401b357 sending to next pipeline
2026-03-27 10:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 612a6b31-5044-57df-a10e-0a9b2401b357, identifier: WR99181
2026-03-27 10:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7624d114-9828-5d79-866c-1581d325b944 with identifier: LA44092
2026-03-27 10:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:34:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-27 10:34:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7624d114-9828-5d79-866c-1581d325b944 with identifier: LA44092
2026-03-27 10:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7624d114-9828-5d79-866c-1581d325b944 with identifier: LA44092 to the API
2026-03-27 10:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_8d7067ab0f2ff2e142e4884ae4c33702.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 4,
'engine': '1.9L',
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:53:01Z',
'fuel_type': 'diesel',
'id': '7624d114-9828-5d79-866c-1581d325b944',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA44092',
'listing': 'auction',
'location': 'DE, Cottbus',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 156956,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7624d114-9828-5d79-866c-1581d325b944/7624d114-9828-5d79-866c-1581d325b944_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73292,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_7f9646d83dc703f602f8a215ad221bac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7624d114-9828-5d79-866c-1581d325b944/7624d114-9828-5d79-866c-1581d325b944_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_ac7750a0b75b0ac4c66f83c273b0d371.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7624d114-9828-5d79-866c-1581d325b944/7624d114-9828-5d79-866c-1581d325b944_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75619,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_8d7067ab0f2ff2e142e4884ae4c33702.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7624d114-9828-5d79-866c-1581d325b944/7624d114-9828-5d79-866c-1581d325b944_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60137,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_9ddd03a8cd6a51426b3edcc49b15a37a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7624d114-9828-5d79-866c-1581d325b944/7624d114-9828-5d79-866c-1581d325b944_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113869,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/a0/e3a0b3ba3e8212c36af784044f85b80b/pa/LA44092_513ed169b8a157dc7069c82d0fc80d7f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2003-06-23',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Passat 1.9 TDI Comfortline Family',
'transmission': 'automatic',
'trim': 'Comfortline Family',
'year': 2003}
2026-03-27 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA44092%27 HTTP/1.1" 200 None
2026-03-27 10:34:38 [auto1.de] INFO: Saving data for LA44092: {'created_time': 1774607678.694246, 'last_price_update_time': 1774607678.694258, 'auction_closing_time': 1774716781.0}
2026-03-27 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA44092') HTTP/1.1" 204 0
2026-03-27 10:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 612a6b31-5044-57df-a10e-0a9b2401b357 with identifier: WR99181
2026-03-27 10:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 612a6b31-5044-57df-a10e-0a9b2401b357 with identifier: WR99181
2026-03-27 10:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 612a6b31-5044-57df-a10e-0a9b2401b357 with identifier: WR99181 to the API
2026-03-27 10:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_efefd14a5508eecf3fb65be5f09b3a39.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 4',
'engine': '0.7L',
'engine_horse_power': 60,
'expiration_date': '2026-03-28T16:32:49Z',
'fuel_type': 'petrol',
'id': '612a6b31-5044-57df-a10e-0a9b2401b357',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR99181',
'listing': 'auction',
'location': 'DE, Hamburg-Billstedt',
'make': 'Smart',
'model': 'fortwo',
'odometer': 109774,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_612a6b31-5044-57df-a10e-0a9b2401b357/612a6b31-5044-57df-a10e-0a9b2401b357_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96760,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_d7950cc4e93913227e42c1aa09301cee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_612a6b31-5044-57df-a10e-0a9b2401b357/612a6b31-5044-57df-a10e-0a9b2401b357_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_a305c4bfecbb385881a05bda8947cf4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_612a6b31-5044-57df-a10e-0a9b2401b357/612a6b31-5044-57df-a10e-0a9b2401b357_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94720,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_efefd14a5508eecf3fb65be5f09b3a39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_612a6b31-5044-57df-a10e-0a9b2401b357/612a6b31-5044-57df-a10e-0a9b2401b357_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62220,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_e4ddc56d9fecfa76eb9df38e491f70ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_612a6b31-5044-57df-a10e-0a9b2401b357/612a6b31-5044-57df-a10e-0a9b2401b357_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90993,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/df/03df793191d45b28d5b50418aa11de23/pa/WR99181_5b57144f752e71a2d580bce13dcaf9d7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2005-10-31',
'seats_number': 2,
'seller_name': None,
'title': 'Smart fortwo 0.7 Turbo Basis pure',
'transmission': 'automatic',
'trim': 'Basis pure',
'year': 2005}
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR99181%27 HTTP/1.1" 200 None
2026-03-27 10:34:39 [auto1.de] INFO: Saving data for WR99181: {'created_time': 1774607679.08843, 'last_price_update_time': 1774607679.088442, 'auction_closing_time': 1774715569.0}
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR99181') HTTP/1.1" 204 0
2026-03-27 10:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CK79873> (referer: https://www.auto1.com/v1/car-details-view/CK79873/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV97613/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX51342> (referer: https://www.auto1.com/v1/car-details-view/AX51342/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c4271f90>
2026-03-27 10:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_e90b0db832b8586c2eeaaa15bf8b93aa.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_e90b0db832b8586c2eeaaa15bf8b93aa.jpg saved to cache
2026-03-27 10:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d
2026-03-27 10:34:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be25e690>
2026-03-27 10:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F0b%252Fa20b01c933ad37061e489b496273c1ca%252Fpa%252FJS13151_378dd001439d0dd3fb9f48e3bc9a4372.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_378dd001439d0dd3fb9f48e3bc9a4372.jpg saved to cache
2026-03-27 10:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d42e471d-29d6-5e33-9d9d-5152535fa1a9
2026-03-27 10:34:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d42e471d-29d6-5e33-9d9d-5152535fa1a9, skipping ID generation
2026-03-27 10:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d42e471d-29d6-5e33-9d9d-5152535fa1a9 with scrape type 1
2026-03-27 10:34:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d42e471d-29d6-5e33-9d9d-5152535fa1a9 sending to next pipeline
2026-03-27 10:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d42e471d-29d6-5e33-9d9d-5152535fa1a9, identifier: JS13151
2026-03-27 10:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_0db31468e32344435587f1de1860db7c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT90816/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JY33610/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d42e471d-29d6-5e33-9d9d-5152535fa1a9 with identifier: JS13151
2026-03-27 10:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d42e471d-29d6-5e33-9d9d-5152535fa1a9 with identifier: JS13151
2026-03-27 10:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d42e471d-29d6-5e33-9d9d-5152535fa1a9 with identifier: JS13151 to the API
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_378dd001439d0dd3fb9f48e3bc9a4372.jpg>
{'auction_title': '',
'c_o_2_emission_value': 166,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 204,
'expiration_date': '2026-03-28T16:43:04Z',
'fuel_type': 'petrol',
'id': 'd42e471d-29d6-5e33-9d9d-5152535fa1a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS13151',
'listing': 'auction',
'location': 'DE, Recklinghausen',
'make': 'Audi',
'model': 'A4',
'odometer': 38452,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2960475,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_378dd001439d0dd3fb9f48e3bc9a4372.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77416,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_b97a646d1a2398a0c414e942db90e818.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90199,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_86aa108f35d7b757318384e402b1ad75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_be1c4e91fe1fa30bf82a636f2a39316c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3198601,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_5a64692b9e486d0b5c3944cfac4305cf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3153303,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_ebd5d71adbcb028a3cf16324acb8d727.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3144671,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_0afad34ce62fe93f9decbfb0e19dd718.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3127573,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_61124689a76022bff5efa41f9ff920b6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_e4b538b3755c2539369d0c5d28b6422d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d42e471d-29d6-5e33-9d9d-5152535fa1a9/d42e471d-29d6-5e33-9d9d-5152535fa1a9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3207896,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga2/0b/a20b01c933ad37061e489b496273c1ca/pa/JS13151_faece45f0859e48ee9055f8da9cdef10.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-11-12',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 40 TFSI Mild-Hybrid quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2023}
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS13151%27 HTTP/1.1" 200 None
2026-03-27 10:34:39 [auto1.de] INFO: Saving data for JS13151: {'created_time': 1774607679.821267, 'last_price_update_time': 1774607679.821282, 'auction_closing_time': 1774716184.0}
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS13151') HTTP/1.1" 204 0
2026-03-27 10:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_ca59ce054988815aadd0176ece655771.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:39 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 10488 | hits on page: 40
2026-03-27 10:34:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe047b51-72f5-552c-84ed-2f45b2927b3c with identifier: CK79873
2026-03-27 10:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe047b51-72f5-552c-84ed-2f45b2927b3c with scrape type 1
2026-03-27 10:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fe047b51-72f5-552c-84ed-2f45b2927b3c
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_1e31e5a9ee188205741a8ba5964c0074.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_1e31e5a9ee188205741a8ba5964c0074.jpg not downloaded yet
2026-03-27 10:34:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05173537-eda3-5b76-9666-74ea991d2f44 with identifier: AX51342
2026-03-27 10:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05173537-eda3-5b76-9666-74ea991d2f44 with scrape type 1
2026-03-27 10:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 05173537-eda3-5b76-9666-74ea991d2f44
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2b%252Fa82b3d9c1d3d83c3526f681a8e73d745%252Fpa%252FAX51342_05d12ce53d07131f1fb154be0b9dde18.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_05d12ce53d07131f1fb154be0b9dde18.jpg not downloaded yet
2026-03-27 10:34:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2c5110>
2026-03-27 10:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F44%252Ffc44407e9352549a257b1b3d776dbd3c%252Fpa%252FKP27245_0db31468e32344435587f1de1860db7c.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_0db31468e32344435587f1de1860db7c.jpg saved to cache
2026-03-27 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 612708e7-8aa9-5dc5-a611-84b01b85751b
2026-03-27 10:34:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 612708e7-8aa9-5dc5-a611-84b01b85751b, skipping ID generation
2026-03-27 10:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612708e7-8aa9-5dc5-a611-84b01b85751b with scrape type 1
2026-03-27 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 612708e7-8aa9-5dc5-a611-84b01b85751b sending to next pipeline
2026-03-27 10:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 612708e7-8aa9-5dc5-a611-84b01b85751b, identifier: KP27245
2026-03-27 10:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 612708e7-8aa9-5dc5-a611-84b01b85751b with identifier: KP27245
2026-03-27 10:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 612708e7-8aa9-5dc5-a611-84b01b85751b with identifier: KP27245
2026-03-27 10:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 612708e7-8aa9-5dc5-a611-84b01b85751b with identifier: KP27245 to the API
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_0db31468e32344435587f1de1860db7c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 164,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:37:32Z',
'fuel_type': 'diesel',
'id': '612708e7-8aa9-5dc5-a611-84b01b85751b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP27245',
'listing': 'auction',
'location': 'DE, Aurich',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 105065,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76982,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_7265448cee89d26f28be5f9751a52346.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_4bde3a83539d3c79a26c49667dd5dd7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2576624,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_552ea78dc1fc6763d2cb1a24755d0aed.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_ab9a847cc4677535256a47d1832f3232.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2420709,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_0db31468e32344435587f1de1860db7c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_2b6b4db7d29c1ff06ad8ba5c3c3ec7c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_b70d8abdb9567a218d0d343594aeda6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2663416,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_f03c4685bb07cba3d5516676a99a91be.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_a3b7767869b76e01bd2b3b4bb5c3c6d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_612708e7-8aa9-5dc5-a611-84b01b85751b/612708e7-8aa9-5dc5-a611-84b01b85751b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/44/fc44407e9352549a257b1b3d776dbd3c/pa/KP27245_a4df40570268975a93ee414928185b68.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-07-16',
'seats_number': 7,
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline',
'transmission': 'automatic',
'trim': 'Comfortline',
'year': 2017}
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP27245%27 HTTP/1.1" 200 None
2026-03-27 10:34:40 [auto1.de] INFO: Saving data for KP27245: {'created_time': 1774607680.520626, 'last_price_update_time': 1774607680.520639, 'auction_closing_time': 1774715852.0}
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP27245') HTTP/1.1" 204 0
2026-03-27 10:34:40 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-27 10:34:40 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT97344%27 HTTP/1.1" 200 None
2026-03-27 10:34:40 [auto1.de] INFO: Scrape type for JT97344: 1
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_dafb67bea31846d42e37f907837975c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_dafb67bea31846d42e37f907837975c2.jpg not downloaded yet
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2b%252Fa82b3d9c1d3d83c3526f681a8e73d745%252Fpa%252FAX51342_46850de216a4ec15a6125b70311111dc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_46850de216a4ec15a6125b70311111dc.jpg not downloaded yet
2026-03-27 10:34:40 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-27 10:34:40 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-27 10:34:40 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-27 10:34:40 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-27 10:34:40 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE37655%27 HTTP/1.1" 200 None
2026-03-27 10:34:40 [auto1.de] INFO: Scrape type for GE37655: 1
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_57a7ba4217e0fad314d24872527885c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_57a7ba4217e0fad314d24872527885c8.jpg not downloaded yet
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2b%252Fa82b3d9c1d3d83c3526f681a8e73d745%252Fpa%252FAX51342_8842d2e68bc749c446e7edcd56849d08.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_8842d2e68bc749c446e7edcd56849d08.jpg not downloaded yet
2026-03-27 10:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4781d0>
2026-03-27 10:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_ca59ce054988815aadd0176ece655771.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_ca59ce054988815aadd0176ece655771.jpg saved to cache
2026-03-27 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0e5d654-c934-59e0-8631-c7e648c17b03
2026-03-27 10:34:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_58782b179469e9e3cfff707ace041a87.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:40 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-27 10:34:40 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF90181%27 HTTP/1.1" 200 None
2026-03-27 10:34:40 [auto1.de] INFO: Scrape type for FF90181: 2
2026-03-27 10:34:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca34f071-0187-52ec-8a15-c95d1d1c51b1 with identifier: FF90181
2026-03-27 10:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca34f071-0187-52ec-8a15-c95d1d1c51b1 with scrape type 2
2026-03-27 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca34f071-0187-52ec-8a15-c95d1d1c51b1 with scrape type 2
2026-03-27 10:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca34f071-0187-52ec-8a15-c95d1d1c51b1, identifier: FF90181
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_6150495c9fe816480178be3b3a0f282a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_6150495c9fe816480178be3b3a0f282a.jpg not downloaded yet
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2b%252Fa82b3d9c1d3d83c3526f681a8e73d745%252Fpa%252FAX51342_f8bf3749661004f02ddb7e58cd4e286c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_f8bf3749661004f02ddb7e58cd4e286c.jpg not downloaded yet
2026-03-27 10:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca34f071-0187-52ec-8a15-c95d1d1c51b1 with identifier: FF90181
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-27 10:34:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca34f071-0187-52ec-8a15-c95d1d1c51b1 with identifier: FF90181
2026-03-27 10:34:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca34f071-0187-52ec-8a15-c95d1d1c51b1 with identifier: FF90181 to the API
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-28T16:15:28Z',
'fuel_type': 'hybrid',
'id': 'ca34f071-0187-52ec-8a15-c95d1d1c51b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF90181',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 33611,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-21',
'seller_name': None,
'title': 'BMW X1 xDrive 25e Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2021}
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF90181%27 HTTP/1.1" 200 None
2026-03-27 10:34:41 [auto1.de] INFO: Saving data for FF90181: {'auction_closing_time': 1774714528.0, 'created_time': 1773344622.488958, 'last_price_update_time': 1774607681.350535}
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF90181') HTTP/1.1" 204 0
2026-03-27 10:34:41 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-27 10:34:41 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-27 10:34:41 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-27 10:34:41 [auto1.de] INFO: Found listing with ID: VX15127
2026-03-27 10:34:41 [auto1.de] INFO: Found listing with ID: RS38976
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS38976%27 HTTP/1.1" 200 None
2026-03-27 10:34:41 [auto1.de] INFO: Scrape type for RS38976: 1
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_fd3bc00d76936df421fb2b20eb5bf5ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_fd3bc00d76936df421fb2b20eb5bf5ef.jpg not downloaded yet
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2b%252Fa82b3d9c1d3d83c3526f681a8e73d745%252Fpa%252FAX51342_e2afdbe9f23bc8db0bd2af2aaf4deb3f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_e2afdbe9f23bc8db0bd2af2aaf4deb3f.jpg not downloaded yet
2026-03-27 10:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_1653935775a896116793745054ba0824.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_da0b913709705d0843d80004e0cd6b7d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_ac311aacdeb153d79bc215c478313513.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:41 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-27 10:34:41 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-27 10:34:41 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-27 10:34:41 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU85888%27 HTTP/1.1" 200 None
2026-03-27 10:34:41 [auto1.de] INFO: Scrape type for ZU85888: 1
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_c393454800e5fe3a61e2e964a2000c58.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_c393454800e5fe3a61e2e964a2000c58.jpg not downloaded yet
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2b%252Fa82b3d9c1d3d83c3526f681a8e73d745%252Fpa%252FAX51342_61e7f51b79c64a50716bad0e74d53e03.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_61e7f51b79c64a50716bad0e74d53e03.jpg not downloaded yet
2026-03-27 10:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA13561> (referer: https://www.auto1.com/v1/car-details-view/EA13561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK99060> (referer: https://www.auto1.com/v1/car-details-view/XK99060/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB59587> (referer: https://www.auto1.com/v1/car-details-view/GB59587/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf39e7d0>
2026-03-27 10:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_58782b179469e9e3cfff707ace041a87.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_58782b179469e9e3cfff707ace041a87.jpg saved to cache
2026-03-27 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d
2026-03-27 10:34:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:41 [auto1.de] INFO: Found listing with ID: VW35628
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW35628%27 HTTP/1.1" 200 None
2026-03-27 10:34:41 [auto1.de] INFO: Scrape type for VW35628: 1
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_fa867c16e582e51dbe739bf96f80ee8b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_fa867c16e582e51dbe739bf96f80ee8b.jpg not downloaded yet
2026-03-27 10:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JL12737> (referer: https://www.auto1.com/v1/car-details-view/JL12737/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf540690>
2026-03-27 10:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_1653935775a896116793745054ba0824.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_1653935775a896116793745054ba0824.jpg saved to cache
2026-03-27 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2636e10-6ba9-578c-ada5-3013d96fdaad
2026-03-27 10:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2f37d0>
2026-03-27 10:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_da0b913709705d0843d80004e0cd6b7d.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_da0b913709705d0843d80004e0cd6b7d.jpg saved to cache
2026-03-27 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d
2026-03-27 10:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf469890>
2026-03-27 10:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_ac311aacdeb153d79bc215c478313513.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_ac311aacdeb153d79bc215c478313513.jpg saved to cache
2026-03-27 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d
2026-03-27 10:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_8842d2e68bc749c446e7edcd56849d08.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:41 [auto1.de] INFO: Found listing with ID: DE80885
2026-03-27 10:34:41 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-27 10:34:41 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN48826%27 HTTP/1.1" 200 None
2026-03-27 10:34:41 [auto1.de] INFO: Scrape type for BN48826: 1
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_c7debf8a6a5600c51bcd61bd8fa3bae1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_c7debf8a6a5600c51bcd61bd8fa3bae1.jpg not downloaded yet
2026-03-27 10:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_fd3bc00d76936df421fb2b20eb5bf5ef.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:41 [auto1.de] INFO: Found listing with ID: LR18629
2026-03-27 10:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR18629%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [auto1.de] INFO: Scrape type for LR18629: 1
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_5cc93f7b8864fb3366ebc469bec3c59c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_5cc93f7b8864fb3366ebc469bec3c59c.jpg not downloaded yet
2026-03-27 10:34:42 [auto1.de] INFO: Found listing with ID: XS57001
2026-03-27 10:34:42 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB33034%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [auto1.de] INFO: Scrape type for BB33034: 1
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_245a5906f4ee24fe4b1a86970a5122ad.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_245a5906f4ee24fe4b1a86970a5122ad.jpg not downloaded yet
2026-03-27 10:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0e39d28-937d-54ff-a131-ab56b06a77ab with identifier: EA13561
2026-03-27 10:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0e39d28-937d-54ff-a131-ab56b06a77ab with scrape type 1
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0e39d28-937d-54ff-a131-ab56b06a77ab
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_9e2a7cc69f327d2d68227dfdbd132db8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_9e2a7cc69f327d2d68227dfdbd132db8.jpg not downloaded yet
2026-03-27 10:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5853aa09-134f-535f-a047-c4db9b75a0b9 with identifier: XK99060
2026-03-27 10:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5853aa09-134f-535f-a047-c4db9b75a0b9 with scrape type 1
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5853aa09-134f-535f-a047-c4db9b75a0b9
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_d20913ecbc274256b4a486004bb0660a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_d20913ecbc274256b4a486004bb0660a.jpg not downloaded yet
2026-03-27 10:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12903823-e98d-5fff-a95d-ef898ad9f779 with identifier: GB59587
2026-03-27 10:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12903823-e98d-5fff-a95d-ef898ad9f779 with scrape type 1
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 12903823-e98d-5fff-a95d-ef898ad9f779
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_d8a95b186786bbad83876dce6279c7b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_d8a95b186786bbad83876dce6279c7b9.jpg not downloaded yet
2026-03-27 10:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8cee521-5ad3-55fb-8975-6c4b63651cf6 with identifier: JL12737
2026-03-27 10:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8cee521-5ad3-55fb-8975-6c4b63651cf6 with scrape type 1
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8cee521-5ad3-55fb-8975-6c4b63651cf6
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_f5191c9d2f87b19c16a03c61c89e5721.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_f5191c9d2f87b19c16a03c61c89e5721.jpg not downloaded yet
2026-03-27 10:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_e2afdbe9f23bc8db0bd2af2aaf4deb3f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_57a7ba4217e0fad314d24872527885c8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_f8bf3749661004f02ddb7e58cd4e286c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:42 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW26780%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [auto1.de] INFO: Scrape type for ZW26780: 1
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_d17128113bd4e01ac4da164149d8532d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_d17128113bd4e01ac4da164149d8532d.jpg not downloaded yet
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_e3f5800e85fcb3879dce851d2cd8bba6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_e3f5800e85fcb3879dce851d2cd8bba6.jpg not downloaded yet
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_534952895a432cd888e68648ed0ae5f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_534952895a432cd888e68648ed0ae5f8.jpg not downloaded yet
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_a250cc3589dee3bf726d86071b7eb124.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_a250cc3589dee3bf726d86071b7eb124.jpg not downloaded yet
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c4248710>
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05173537-eda3-5b76-9666-74ea991d2f44/05173537-eda3-5b76-9666-74ea991d2f44_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2b%252Fa82b3d9c1d3d83c3526f681a8e73d745%252Fpa%252FAX51342_8842d2e68bc749c446e7edcd56849d08.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_8842d2e68bc749c446e7edcd56849d08.jpg saved to cache
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05173537-eda3-5b76-9666-74ea991d2f44
2026-03-27 10:34:42 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-27 10:34:42 [auto1.de] INFO: Found listing with ID: PA36365
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA36365%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [auto1.de] INFO: Scrape type for PA36365: 1
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_756baddb81d75c345f2b1bc1a545c72b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_756baddb81d75c345f2b1bc1a545c72b.jpg not downloaded yet
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_d5f1867f3ac531049cbda53fc46ac959.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_d5f1867f3ac531049cbda53fc46ac959.jpg not downloaded yet
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_8417ef84b0a2a1bb7b3e381e968b7064.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_8417ef84b0a2a1bb7b3e381e968b7064.jpg not downloaded yet
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_82be8c5d8b5ba815957a7a4272cd9b0b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_82be8c5d8b5ba815957a7a4272cd9b0b.jpg not downloaded yet
2026-03-27 10:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA10285> (referer: https://www.auto1.com/v1/car-details-view/SA10285/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be254610>
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_fd3bc00d76936df421fb2b20eb5bf5ef.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_fd3bc00d76936df421fb2b20eb5bf5ef.jpg saved to cache
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe047b51-72f5-552c-84ed-2f45b2927b3c
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1f5450>
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05173537-eda3-5b76-9666-74ea991d2f44/05173537-eda3-5b76-9666-74ea991d2f44_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2b%252Fa82b3d9c1d3d83c3526f681a8e73d745%252Fpa%252FAX51342_e2afdbe9f23bc8db0bd2af2aaf4deb3f.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_e2afdbe9f23bc8db0bd2af2aaf4deb3f.jpg saved to cache
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05173537-eda3-5b76-9666-74ea991d2f44
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2c7590>
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_57a7ba4217e0fad314d24872527885c8.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_57a7ba4217e0fad314d24872527885c8.jpg saved to cache
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe047b51-72f5-552c-84ed-2f45b2927b3c
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2601d0>
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05173537-eda3-5b76-9666-74ea991d2f44/05173537-eda3-5b76-9666-74ea991d2f44_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2b%252Fa82b3d9c1d3d83c3526f681a8e73d745%252Fpa%252FAX51342_f8bf3749661004f02ddb7e58cd4e286c.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_f8bf3749661004f02ddb7e58cd4e286c.jpg saved to cache
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05173537-eda3-5b76-9666-74ea991d2f44
2026-03-27 10:34:42 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-27 10:34:42 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC35382%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [auto1.de] INFO: Scrape type for KC35382: 1
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_886a16b828aa0ae626a55ff541de158a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_886a16b828aa0ae626a55ff541de158a.jpg not downloaded yet
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_8cbf4a86f692939672da2ea07a3e3de8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_8cbf4a86f692939672da2ea07a3e3de8.jpg not downloaded yet
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_b925209634539f32357a41edd397ddba.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_b925209634539f32357a41edd397ddba.jpg not downloaded yet
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_39c28da6f24577d393df155f752d2068.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_39c28da6f24577d393df155f752d2068.jpg not downloaded yet
2026-03-27 10:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_fa867c16e582e51dbe739bf96f80ee8b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_f5191c9d2f87b19c16a03c61c89e5721.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_61e7f51b79c64a50716bad0e74d53e03.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:42 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72807%27 HTTP/1.1" 200 None
2026-03-27 10:34:43 [auto1.de] INFO: Scrape type for EX72807: 2
2026-03-27 10:34:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43318222-ef16-5cd0-a232-fd188c04160c with identifier: EX72807
2026-03-27 10:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43318222-ef16-5cd0-a232-fd188c04160c with scrape type 2
2026-03-27 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43318222-ef16-5cd0-a232-fd188c04160c with scrape type 2
2026-03-27 10:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43318222-ef16-5cd0-a232-fd188c04160c, identifier: EX72807
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_82e1fbb30a074dda1e283c23cfeeded0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_82e1fbb30a074dda1e283c23cfeeded0.jpg not downloaded yet
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_b136eb8a84ebd98fb014326054d69f17.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_b136eb8a84ebd98fb014326054d69f17.jpg not downloaded yet
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_7fb9cab3e69108311d72d000fa38c041.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_7fb9cab3e69108311d72d000fa38c041.jpg not downloaded yet
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_40027bc0eb8a03df2e50ab43c7d96a01.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_40027bc0eb8a03df2e50ab43c7d96a01.jpg not downloaded yet
2026-03-27 10:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT94626> (referer: https://www.auto1.com/v1/car-details-view/JT94626/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 with identifier: SA10285
2026-03-27 10:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 with scrape type 1
2026-03-27 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f5075c7-b95d-56f6-a9c9-1e5a345a4627
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_063132a0c68935b23c86ae84ab5ec9c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_063132a0c68935b23c86ae84ab5ec9c0.jpg not downloaded yet
2026-03-27 10:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43318222-ef16-5cd0-a232-fd188c04160c with identifier: EX72807
2026-03-27 10:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43318222-ef16-5cd0-a232-fd188c04160c with identifier: EX72807
2026-03-27 10:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43318222-ef16-5cd0-a232-fd188c04160c with identifier: EX72807 to the API
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:40:41Z',
'fuel_type': 'diesel',
'id': '43318222-ef16-5cd0-a232-fd188c04160c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX72807',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 130569,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-07',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2015}
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72807%27 HTTP/1.1" 200 None
2026-03-27 10:34:43 [auto1.de] INFO: Saving data for EX72807: {'auction_closing_time': 1774716041.0, 'created_time': 1773469046.034686, 'last_price_update_time': 1774607683.85084}
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX72807') HTTP/1.1" 204 0
2026-03-27 10:34:43 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-27 10:34:43 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG01443%27 HTTP/1.1" 200 None
2026-03-27 10:34:43 [auto1.de] INFO: Scrape type for EG01443: 2
2026-03-27 10:34:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b19c138f-460c-535d-869f-4eec7e1c6d68 with identifier: EG01443
2026-03-27 10:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b19c138f-460c-535d-869f-4eec7e1c6d68 with scrape type 2
2026-03-27 10:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b19c138f-460c-535d-869f-4eec7e1c6d68 with scrape type 2
2026-03-27 10:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b19c138f-460c-535d-869f-4eec7e1c6d68, identifier: EG01443
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_9ea7d81567212fed6fb7fe6ee5459005.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_9ea7d81567212fed6fb7fe6ee5459005.jpg not downloaded yet
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_022109b659a56d9201db6d8c2492d4ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_022109b659a56d9201db6d8c2492d4ba.jpg not downloaded yet
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_e9cd47413909e149eab91205253de24d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_e9cd47413909e149eab91205253de24d.jpg not downloaded yet
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_8228ec0b39cd01089fe352e4abcd48f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_8228ec0b39cd01089fe352e4abcd48f2.jpg not downloaded yet
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_3b46d3d1effe5ca348f7d2f102811f4d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_3b46d3d1effe5ca348f7d2f102811f4d.jpg not downloaded yet
2026-03-27 10:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b19c138f-460c-535d-869f-4eec7e1c6d68 with identifier: EG01443
2026-03-27 10:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b19c138f-460c-535d-869f-4eec7e1c6d68 with identifier: EG01443
2026-03-27 10:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b19c138f-460c-535d-869f-4eec7e1c6d68 with identifier: EG01443 to the API
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:18:39Z',
'fuel_type': 'diesel',
'id': 'b19c138f-460c-535d-869f-4eec7e1c6d68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG01443',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 216114,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-08',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 HDi Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2010}
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG01443%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [auto1.de] INFO: Saving data for EG01443: {'auction_closing_time': 1774714719.0, 'created_time': 1774349808.324643, 'last_price_update_time': 1774607684.553952}
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG01443') HTTP/1.1" 204 0
2026-03-27 10:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VW35628/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RS38976/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_d20913ecbc274256b4a486004bb0660a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_d8a95b186786bbad83876dce6279c7b9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_82be8c5d8b5ba815957a7a4272cd9b0b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:44 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-27 10:34:44 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV29308%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [auto1.de] INFO: Scrape type for ZV29308: 1
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_24bd6b02d85619b88138abf1b7688af0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_24bd6b02d85619b88138abf1b7688af0.jpg not downloaded yet
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_160df2c3ac8d5acaa7f6aee0cfb0a80f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_160df2c3ac8d5acaa7f6aee0cfb0a80f.jpg not downloaded yet
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_50aaac9d1063c5f55c539a991b662d96.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_50aaac9d1063c5f55c539a991b662d96.jpg not downloaded yet
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_11086a01745d26a8f1e3a93651ce602e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_11086a01745d26a8f1e3a93651ce602e.jpg not downloaded yet
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_14049da361c04adc3ba43f24ad4ff03c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_14049da361c04adc3ba43f24ad4ff03c.jpg not downloaded yet
2026-03-27 10:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be223050>
2026-03-27 10:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_fa867c16e582e51dbe739bf96f80ee8b.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_fa867c16e582e51dbe739bf96f80ee8b.jpg saved to cache
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe047b51-72f5-552c-84ed-2f45b2927b3c
2026-03-27 10:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be249c10>
2026-03-27 10:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_f5191c9d2f87b19c16a03c61c89e5721.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_f5191c9d2f87b19c16a03c61c89e5721.jpg saved to cache
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8cee521-5ad3-55fb-8975-6c4b63651cf6
2026-03-27 10:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0f8750>
2026-03-27 10:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05173537-eda3-5b76-9666-74ea991d2f44/05173537-eda3-5b76-9666-74ea991d2f44_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2b%252Fa82b3d9c1d3d83c3526f681a8e73d745%252Fpa%252FAX51342_61e7f51b79c64a50716bad0e74d53e03.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_61e7f51b79c64a50716bad0e74d53e03.jpg saved to cache
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05173537-eda3-5b76-9666-74ea991d2f44
2026-03-27 10:34:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aac696a5-0f5d-5b48-a71b-7b7370cea606 with identifier: JT94626
2026-03-27 10:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac696a5-0f5d-5b48-a71b-7b7370cea606 with scrape type 1
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aac696a5-0f5d-5b48-a71b-7b7370cea606
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb8%252F35b83904d8e90aadac8e76aecfd6af81%252Fpa%252FJT94626_0b59ae17b79558d840eecbd2e4602164.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_0b59ae17b79558d840eecbd2e4602164.jpg already downloaded
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb8%252F35b83904d8e90aadac8e76aecfd6af81%252Fpa%252FJT94626_faf1e656e203fac86034ec3be796d3e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_faf1e656e203fac86034ec3be796d3e3.jpg already downloaded
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb8%252F35b83904d8e90aadac8e76aecfd6af81%252Fpa%252FJT94626_990b23cb13590f55ded44ba9d54863db.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_990b23cb13590f55ded44ba9d54863db.jpg already downloaded
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb8%252F35b83904d8e90aadac8e76aecfd6af81%252Fpa%252FJT94626_47bf4c728986b929ae33bbbaba229d26.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_47bf4c728986b929ae33bbbaba229d26.jpg already downloaded
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb8%252F35b83904d8e90aadac8e76aecfd6af81%252Fpa%252FJT94626_0ec9aba83b858e2ddc0e429b39f7bf2a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_0ec9aba83b858e2ddc0e429b39f7bf2a.jpg already downloaded
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb8%252F35b83904d8e90aadac8e76aecfd6af81%252Fpa%252FJT94626_9f5b7736ced5ecf571ed5169c818a8c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_9f5b7736ced5ecf571ed5169c818a8c0.jpg already downloaded
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb8%252F35b83904d8e90aadac8e76aecfd6af81%252Fpa%252FJT94626_ec3bc082a7741b339b3c03f54ad571e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_ec3bc082a7741b339b3c03f54ad571e1.jpg already downloaded
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb8%252F35b83904d8e90aadac8e76aecfd6af81%252Fpa%252FJT94626_1fa30ecbdc0c9d31a24949299d6c33f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_1fa30ecbdc0c9d31a24949299d6c33f5.jpg already downloaded
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb8%252F35b83904d8e90aadac8e76aecfd6af81%252Fpa%252FJT94626_842093214eef50df25d19690f20fa039.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_842093214eef50df25d19690f20fa039.jpg already downloaded
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb8%252F35b83904d8e90aadac8e76aecfd6af81%252Fpa%252FJT94626_528e1821255556b3f045728d574a3174.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_528e1821255556b3f045728d574a3174.jpg already downloaded
2026-03-27 10:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aac696a5-0f5d-5b48-a71b-7b7370cea606, identifier: JT94626
2026-03-27 10:34:45 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-27 10:34:45 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL31894%27 HTTP/1.1" 200 None
2026-03-27 10:34:45 [auto1.de] INFO: Scrape type for KL31894: 2
2026-03-27 10:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7 with identifier: KL31894
2026-03-27 10:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7 with scrape type 2
2026-03-27 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7 with scrape type 2
2026-03-27 10:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7, identifier: KL31894
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_bf848376665e207187ca3a7b819dfb0a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_bf848376665e207187ca3a7b819dfb0a.jpg not downloaded yet
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_891725942ffb90f3b2c2baf19230a2f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_891725942ffb90f3b2c2baf19230a2f6.jpg not downloaded yet
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_09fc3c3e2a0df0c6bff7d9a969e3e63a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_09fc3c3e2a0df0c6bff7d9a969e3e63a.jpg not downloaded yet
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_ebe6f7df857801c2d6e9afcb74c734ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_ebe6f7df857801c2d6e9afcb74c734ed.jpg not downloaded yet
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_6c623fb95c0142189fa960bf2444411f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_6c623fb95c0142189fa960bf2444411f.jpg not downloaded yet
2026-03-27 10:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aac696a5-0f5d-5b48-a71b-7b7370cea606 with identifier: JT94626
2026-03-27 10:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aac696a5-0f5d-5b48-a71b-7b7370cea606 with identifier: JT94626
2026-03-27 10:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aac696a5-0f5d-5b48-a71b-7b7370cea606 with identifier: JT94626 to the API
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JT94626>
{'auction_title': '',
'c_o_2_emission_value': 252,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '3.0L',
'engine_horse_power': 230,
'expiration_date': '2026-03-28T16:38:41Z',
'fuel_type': 'petrol',
'id': 'aac696a5-0f5d-5b48-a71b-7b7370cea606',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT94626',
'listing': 'auction',
'location': 'DE, Hattingen',
'make': 'Mercedes-Benz',
'model': 'GLK-Klasse',
'odometer': 129958,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_0b59ae17b79558d840eecbd2e4602164.jpg',
'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_faf1e656e203fac86034ec3be796d3e3.jpg',
'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_990b23cb13590f55ded44ba9d54863db.jpg',
'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_47bf4c728986b929ae33bbbaba229d26.jpg',
'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_0ec9aba83b858e2ddc0e429b39f7bf2a.jpg',
'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_9f5b7736ced5ecf571ed5169c818a8c0.jpg',
'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_ec3bc082a7741b339b3c03f54ad571e1.jpg',
'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_1fa30ecbdc0c9d31a24949299d6c33f5.jpg',
'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_842093214eef50df25d19690f20fa039.jpg',
'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_528e1821255556b3f045728d574a3174.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac696a5-0f5d-5b48-a71b-7b7370cea606/aac696a5-0f5d-5b48-a71b-7b7370cea606_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_0b59ae17b79558d840eecbd2e4602164.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac696a5-0f5d-5b48-a71b-7b7370cea606/aac696a5-0f5d-5b48-a71b-7b7370cea606_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2754088,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_faf1e656e203fac86034ec3be796d3e3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac696a5-0f5d-5b48-a71b-7b7370cea606/aac696a5-0f5d-5b48-a71b-7b7370cea606_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76534,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_990b23cb13590f55ded44ba9d54863db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac696a5-0f5d-5b48-a71b-7b7370cea606/aac696a5-0f5d-5b48-a71b-7b7370cea606_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2682441,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_47bf4c728986b929ae33bbbaba229d26.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac696a5-0f5d-5b48-a71b-7b7370cea606/aac696a5-0f5d-5b48-a71b-7b7370cea606_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66779,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_0ec9aba83b858e2ddc0e429b39f7bf2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac696a5-0f5d-5b48-a71b-7b7370cea606/aac696a5-0f5d-5b48-a71b-7b7370cea606_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70295,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_9f5b7736ced5ecf571ed5169c818a8c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac696a5-0f5d-5b48-a71b-7b7370cea606/aac696a5-0f5d-5b48-a71b-7b7370cea606_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2766368,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_ec3bc082a7741b339b3c03f54ad571e1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac696a5-0f5d-5b48-a71b-7b7370cea606/aac696a5-0f5d-5b48-a71b-7b7370cea606_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71992,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_1fa30ecbdc0c9d31a24949299d6c33f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac696a5-0f5d-5b48-a71b-7b7370cea606/aac696a5-0f5d-5b48-a71b-7b7370cea606_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2920294,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_842093214eef50df25d19690f20fa039.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac696a5-0f5d-5b48-a71b-7b7370cea606/aac696a5-0f5d-5b48-a71b-7b7370cea606_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/b8/35b83904d8e90aadac8e76aecfd6af81/pa/JT94626_528e1821255556b3f045728d574a3174.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-06-23',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLK-Klasse GLK 280 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2012}
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT94626%27 HTTP/1.1" 200 None
2026-03-27 10:34:45 [auto1.de] INFO: Saving data for JT94626: {'created_time': 1774607685.605237, 'last_price_update_time': 1774607685.60525, 'auction_closing_time': 1774715921.0}
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT94626') HTTP/1.1" 204 0
2026-03-27 10:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7 with identifier: KL31894
2026-03-27 10:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7 with identifier: KL31894
2026-03-27 10:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7 with identifier: KL31894 to the API
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:17:40Z',
'fuel_type': 'diesel',
'id': '17b0805e-ede7-5c6c-acf0-dd79c2c7e8e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL31894',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 208008,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-17',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200 CDI Urban',
'transmission': 'manual',
'trim': 'Urban',
'year': 2016}
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL31894%27 HTTP/1.1" 200 None
2026-03-27 10:34:45 [auto1.de] INFO: Saving data for KL31894: {'auction_closing_time': 1774714660.0, 'created_time': 1773945787.355259, 'last_price_update_time': 1774607685.962917}
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL31894') HTTP/1.1" 204 0
2026-03-27 10:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_8cbf4a86f692939672da2ea07a3e3de8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_b925209634539f32357a41edd397ddba.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:46 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-27 10:34:46 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-27 10:34:46 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_c3830e5e18e4c128735225cc0c020a95.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_c3830e5e18e4c128735225cc0c020a95.jpg not downloaded yet
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_cd9aa882476a54a3e2e1a0470f6dce30.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_cd9aa882476a54a3e2e1a0470f6dce30.jpg not downloaded yet
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_216d8a5783988139c04ccd47d87a02fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_216d8a5783988139c04ccd47d87a02fc.jpg not downloaded yet
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_164f2ba54260b876252d7fca5dd49c52.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_164f2ba54260b876252d7fca5dd49c52.jpg not downloaded yet
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_2b078014635ffc36324c46cb8531eeab.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_2b078014635ffc36324c46cb8531eeab.jpg not downloaded yet
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf0cd50>
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_d20913ecbc274256b4a486004bb0660a.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_d20913ecbc274256b4a486004bb0660a.jpg saved to cache
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5853aa09-134f-535f-a047-c4db9b75a0b9
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf554910>
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_d8a95b186786bbad83876dce6279c7b9.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_d8a95b186786bbad83876dce6279c7b9.jpg saved to cache
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12903823-e98d-5fff-a95d-ef898ad9f779
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2eac10>
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_82be8c5d8b5ba815957a7a4272cd9b0b.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_82be8c5d8b5ba815957a7a4272cd9b0b.jpg saved to cache
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8cee521-5ad3-55fb-8975-6c4b63651cf6
2026-03-27 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_39c28da6f24577d393df155f752d2068.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_54e613f32908ba9564d77f07f2c06264.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_54e613f32908ba9564d77f07f2c06264.jpg not downloaded yet
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_607a062c129e876846555ccb7b255b0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_607a062c129e876846555ccb7b255b0f.jpg not downloaded yet
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_f7d56090455e6f083bf1c6849ed722a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_f7d56090455e6f083bf1c6849ed722a2.jpg not downloaded yet
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_9de9a6b322c252c7f41f8b558cc4f2e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_9de9a6b322c252c7f41f8b558cc4f2e3.jpg not downloaded yet
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_2156d8cc2146bc22c0594d89720839e7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_2156d8cc2146bc22c0594d89720839e7.jpg not downloaded yet
2026-03-27 10:34:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_ccc4ba841d258f4379fd287ebd46bbeb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_ccc4ba841d258f4379fd287ebd46bbeb.jpg not downloaded yet
2026-03-27 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_da45aa6c0a53ce7a649b45237fabbae0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_063132a0c68935b23c86ae84ab5ec9c0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1eeb90>
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_8cbf4a86f692939672da2ea07a3e3de8.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_8cbf4a86f692939672da2ea07a3e3de8.jpg saved to cache
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5853aa09-134f-535f-a047-c4db9b75a0b9
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf43b150>
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_b925209634539f32357a41edd397ddba.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_b925209634539f32357a41edd397ddba.jpg saved to cache
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12903823-e98d-5fff-a95d-ef898ad9f779
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_96dacb6c6789247cb42b712fa31237a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_96dacb6c6789247cb42b712fa31237a9.jpg not downloaded yet
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf44f990>
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_39c28da6f24577d393df155f752d2068.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_39c28da6f24577d393df155f752d2068.jpg saved to cache
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8cee521-5ad3-55fb-8975-6c4b63651cf6
2026-03-27 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_1cc49ad3c744ab686ff962ad84a8a124.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_3b46d3d1effe5ca348f7d2f102811f4d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_5e4c7a3785e7a3cd2263858977c6e0ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_5e4c7a3785e7a3cd2263858977c6e0ac.jpg not downloaded yet
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_1309692993492a4d02c8a30516bf5565.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_1309692993492a4d02c8a30516bf5565.jpg not downloaded yet
2026-03-27 10:34:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf44c390>
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_da45aa6c0a53ce7a649b45237fabbae0.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_da45aa6c0a53ce7a649b45237fabbae0.jpg saved to cache
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0e5d654-c934-59e0-8631-c7e648c17b03
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be038190>
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_063132a0c68935b23c86ae84ab5ec9c0.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_063132a0c68935b23c86ae84ab5ec9c0.jpg saved to cache
2026-03-27 10:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f5075c7-b95d-56f6-a9c9-1e5a345a4627
2026-03-27 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_6150495c9fe816480178be3b3a0f282a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_9ea7d81567212fed6fb7fe6ee5459005.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_6c623fb95c0142189fa960bf2444411f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_422e72e217ac01ff8861c13a343162f0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_8228ec0b39cd01089fe352e4abcd48f2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_022109b659a56d9201db6d8c2492d4ba.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_0a984d17813f0479eb41edb6b1f7a755.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c564b450>
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_1cc49ad3c744ab686ff962ad84a8a124.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_1cc49ad3c744ab686ff962ad84a8a124.jpg saved to cache
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0e5d654-c934-59e0-8631-c7e648c17b03
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c535bd50>
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_3b46d3d1effe5ca348f7d2f102811f4d.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_3b46d3d1effe5ca348f7d2f102811f4d.jpg saved to cache
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f5075c7-b95d-56f6-a9c9-1e5a345a4627
2026-03-27 10:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_ebe6f7df857801c2d6e9afcb74c734ed.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4f6c10>
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_6150495c9fe816480178be3b3a0f282a.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_6150495c9fe816480178be3b3a0f282a.jpg saved to cache
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe047b51-72f5-552c-84ed-2f45b2927b3c
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf0e010>
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_9ea7d81567212fed6fb7fe6ee5459005.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_9ea7d81567212fed6fb7fe6ee5459005.jpg saved to cache
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0e39d28-937d-54ff-a131-ab56b06a77ab
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf03e50>
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_6c623fb95c0142189fa960bf2444411f.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_6c623fb95c0142189fa960bf2444411f.jpg saved to cache
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f5075c7-b95d-56f6-a9c9-1e5a345a4627
2026-03-27 10:34:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf43a2d0>
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_422e72e217ac01ff8861c13a343162f0.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_422e72e217ac01ff8861c13a343162f0.jpg saved to cache
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2636e10-6ba9-578c-ada5-3013d96fdaad
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf46d590>
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_8228ec0b39cd01089fe352e4abcd48f2.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_8228ec0b39cd01089fe352e4abcd48f2.jpg saved to cache
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8cee521-5ad3-55fb-8975-6c4b63651cf6
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf58b610>
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_022109b659a56d9201db6d8c2492d4ba.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_022109b659a56d9201db6d8c2492d4ba.jpg saved to cache
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5853aa09-134f-535f-a047-c4db9b75a0b9
2026-03-27 10:34:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf42f190>
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_0a984d17813f0479eb41edb6b1f7a755.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_0a984d17813f0479eb41edb6b1f7a755.jpg saved to cache
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2636e10-6ba9-578c-ada5-3013d96fdaad
2026-03-27 10:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_9de9a6b322c252c7f41f8b558cc4f2e3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_ccc4ba841d258f4379fd287ebd46bbeb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3ac750>
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_ebe6f7df857801c2d6e9afcb74c734ed.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_ebe6f7df857801c2d6e9afcb74c734ed.jpg saved to cache
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8cee521-5ad3-55fb-8975-6c4b63651cf6
2026-03-27 10:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_e9cd47413909e149eab91205253de24d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_2156d8cc2146bc22c0594d89720839e7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_96dacb6c6789247cb42b712fa31237a9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf392d0>
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_9de9a6b322c252c7f41f8b558cc4f2e3.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_9de9a6b322c252c7f41f8b558cc4f2e3.jpg saved to cache
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8cee521-5ad3-55fb-8975-6c4b63651cf6
2026-03-27 10:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_5e4c7a3785e7a3cd2263858977c6e0ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_2b078014635ffc36324c46cb8531eeab.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_164f2ba54260b876252d7fca5dd49c52.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e74d0>
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_ccc4ba841d258f4379fd287ebd46bbeb.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_ccc4ba841d258f4379fd287ebd46bbeb.jpg saved to cache
2026-03-27 10:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f5075c7-b95d-56f6-a9c9-1e5a345a4627
2026-03-27 10:34:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0adfd0>
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_e9cd47413909e149eab91205253de24d.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_e9cd47413909e149eab91205253de24d.jpg saved to cache
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12903823-e98d-5fff-a95d-ef898ad9f779
2026-03-27 10:34:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf35c890>
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_2156d8cc2146bc22c0594d89720839e7.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_2156d8cc2146bc22c0594d89720839e7.jpg saved to cache
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f5075c7-b95d-56f6-a9c9-1e5a345a4627
2026-03-27 10:34:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3c6c50>
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_96dacb6c6789247cb42b712fa31237a9.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_96dacb6c6789247cb42b712fa31237a9.jpg saved to cache
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f5075c7-b95d-56f6-a9c9-1e5a345a4627
2026-03-27 10:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_1309692993492a4d02c8a30516bf5565.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_54e613f32908ba9564d77f07f2c06264.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_607a062c129e876846555ccb7b255b0f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_c3830e5e18e4c128735225cc0c020a95.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RS38976> (referer: https://www.auto1.com/v1/car-details-view/RS38976/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c571b810>
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_5e4c7a3785e7a3cd2263858977c6e0ac.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_5e4c7a3785e7a3cd2263858977c6e0ac.jpg saved to cache
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f5075c7-b95d-56f6-a9c9-1e5a345a4627
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf478ad0>
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_2b078014635ffc36324c46cb8531eeab.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_2b078014635ffc36324c46cb8531eeab.jpg saved to cache
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f5075c7-b95d-56f6-a9c9-1e5a345a4627
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5effd0>
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_164f2ba54260b876252d7fca5dd49c52.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_164f2ba54260b876252d7fca5dd49c52.jpg saved to cache
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8cee521-5ad3-55fb-8975-6c4b63651cf6
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf479ad0>
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_1309692993492a4d02c8a30516bf5565.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_1309692993492a4d02c8a30516bf5565.jpg saved to cache
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f5075c7-b95d-56f6-a9c9-1e5a345a4627
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0f4b90>
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_54e613f32908ba9564d77f07f2c06264.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_54e613f32908ba9564d77f07f2c06264.jpg saved to cache
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d0e39d28-937d-54ff-a131-ab56b06a77ab
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf44ed50>
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_607a062c129e876846555ccb7b255b0f.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_607a062c129e876846555ccb7b255b0f.jpg saved to cache
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5853aa09-134f-535f-a047-c4db9b75a0b9
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be288f50>
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_c3830e5e18e4c128735225cc0c020a95.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_c3830e5e18e4c128735225cc0c020a95.jpg saved to cache
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d0e39d28-937d-54ff-a131-ab56b06a77ab
2026-03-27 10:34:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e1b26a6-bed1-5b57-8c06-508028f76179 with identifier: RS38976
2026-03-27 10:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e1b26a6-bed1-5b57-8c06-508028f76179 with scrape type 1
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7e1b26a6-bed1-5b57-8c06-508028f76179
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F78%252Fc578c57ee050b2f07e36d8c28b09f1d7%252Fpa%252FRS38976_6646ea28aaf4f2854e9012a5a3514e0d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_6646ea28aaf4f2854e9012a5a3514e0d.jpg not downloaded yet
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F78%252Fc578c57ee050b2f07e36d8c28b09f1d7%252Fpa%252FRS38976_2701003f557983d6b1cc8bcff6e3856b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_2701003f557983d6b1cc8bcff6e3856b.jpg not downloaded yet
2026-03-27 10:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_11086a01745d26a8f1e3a93651ce602e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_14049da361c04adc3ba43f24ad4ff03c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_891725942ffb90f3b2c2baf19230a2f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F78%252Fc578c57ee050b2f07e36d8c28b09f1d7%252Fpa%252FRS38976_4c850bfe6833409b8bc454dbd89c9e24.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_4c850bfe6833409b8bc454dbd89c9e24.jpg not downloaded yet
2026-03-27 10:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_bf848376665e207187ca3a7b819dfb0a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F78%252Fc578c57ee050b2f07e36d8c28b09f1d7%252Fpa%252FRS38976_5178eb21f7585ab3189e3e9e427c569c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_5178eb21f7585ab3189e3e9e427c569c.jpg not downloaded yet
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F78%252Fc578c57ee050b2f07e36d8c28b09f1d7%252Fpa%252FRS38976_751c47764a4eb036c84dda5f7e5fc2cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_751c47764a4eb036c84dda5f7e5fc2cc.jpg not downloaded yet
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F78%252Fc578c57ee050b2f07e36d8c28b09f1d7%252Fpa%252FRS38976_0f2ba281c02702a7099a074f95a6c673.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_0f2ba281c02702a7099a074f95a6c673.jpg not downloaded yet
2026-03-27 10:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_216d8a5783988139c04ccd47d87a02fc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_f7d56090455e6f083bf1c6849ed722a2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_cd9aa882476a54a3e2e1a0470f6dce30.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c564a150>
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_11086a01745d26a8f1e3a93651ce602e.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_11086a01745d26a8f1e3a93651ce602e.jpg saved to cache
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8cee521-5ad3-55fb-8975-6c4b63651cf6
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2640d0>
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fa6%252F88a6dd58336360274d4d0788f01aa520%252Fpa%252FSA10285_14049da361c04adc3ba43f24ad4ff03c.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_14049da361c04adc3ba43f24ad4ff03c.jpg saved to cache
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f5075c7-b95d-56f6-a9c9-1e5a345a4627
2026-03-27 10:34:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f5075c7-b95d-56f6-a9c9-1e5a345a4627, skipping ID generation
2026-03-27 10:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 with scrape type 1
2026-03-27 10:34:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 sending to next pipeline
2026-03-27 10:34:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f5075c7-b95d-56f6-a9c9-1e5a345a4627, identifier: SA10285
2026-03-27 10:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 with identifier: SA10285
2026-03-27 10:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 with identifier: SA10285
2026-03-27 10:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f5075c7-b95d-56f6-a9c9-1e5a345a4627 with identifier: SA10285 to the API
2026-03-27 10:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_14049da361c04adc3ba43f24ad4ff03c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 220,
'expiration_date': '2026-03-28T16:52:16Z',
'fuel_type': 'diesel',
'id': '9f5075c7-b95d-56f6-a9c9-1e5a345a4627',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA10285',
'listing': 'auction',
'location': 'DE, Eichenzell',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 51703,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83770,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_063132a0c68935b23c86ae84ab5ec9c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_3b46d3d1effe5ca348f7d2f102811f4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76327,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_14049da361c04adc3ba43f24ad4ff03c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_6c623fb95c0142189fa960bf2444411f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79111,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_2b078014635ffc36324c46cb8531eeab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2661335,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_2156d8cc2146bc22c0594d89720839e7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_ccc4ba841d258f4379fd287ebd46bbeb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2750719,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_96dacb6c6789247cb42b712fa31237a9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76805,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_5e4c7a3785e7a3cd2263858977c6e0ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f5075c7-b95d-56f6-a9c9-1e5a345a4627/9f5075c7-b95d-56f6-a9c9-1e5a345a4627_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81986,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/a6/88a6dd58336360274d4d0788f01aa520/pa/SA10285_1309692993492a4d02c8a30516bf5565.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-07-23',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d Mild-Hybrid 4Matic Avantgarde',
'transmission': 'automatic',
'trim': '4Matic Avantgarde',
'year': 2024}
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA10285%27 HTTP/1.1" 200 None
2026-03-27 10:34:50 [auto1.de] INFO: Saving data for SA10285: {'created_time': 1774607690.565374, 'last_price_update_time': 1774607690.565385, 'auction_closing_time': 1774716736.0}
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA10285') HTTP/1.1" 204 0
2026-03-27 10:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_160df2c3ac8d5acaa7f6aee0cfb0a80f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_24bd6b02d85619b88138abf1b7688af0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_6646ea28aaf4f2854e9012a5a3514e0d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_2701003f557983d6b1cc8bcff6e3856b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_40027bc0eb8a03df2e50ab43c7d96a01.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VW35628> (referer: https://www.auto1.com/v1/car-details-view/VW35628/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV29308/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf300850>
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_891725942ffb90f3b2c2baf19230a2f6.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_891725942ffb90f3b2c2baf19230a2f6.jpg saved to cache
2026-03-27 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5853aa09-134f-535f-a047-c4db9b75a0b9
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be162ad0>
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_bf848376665e207187ca3a7b819dfb0a.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_bf848376665e207187ca3a7b819dfb0a.jpg saved to cache
2026-03-27 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0e39d28-937d-54ff-a131-ab56b06a77ab
2026-03-27 10:34:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf3a6d0>
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_216d8a5783988139c04ccd47d87a02fc.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_216d8a5783988139c04ccd47d87a02fc.jpg saved to cache
2026-03-27 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 12903823-e98d-5fff-a95d-ef898ad9f779
2026-03-27 10:34:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3277d0>
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_f7d56090455e6f083bf1c6849ed722a2.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_f7d56090455e6f083bf1c6849ed722a2.jpg saved to cache
2026-03-27 10:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 12903823-e98d-5fff-a95d-ef898ad9f779
2026-03-27 10:34:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf39910>
2026-03-27 10:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_cd9aa882476a54a3e2e1a0470f6dce30.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_cd9aa882476a54a3e2e1a0470f6dce30.jpg saved to cache
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5853aa09-134f-535f-a047-c4db9b75a0b9
2026-03-27 10:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_09fc3c3e2a0df0c6bff7d9a969e3e63a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_4c850bfe6833409b8bc454dbd89c9e24.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_0f2ba281c02702a7099a074f95a6c673.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR96754> (referer: https://www.auto1.com/v1/car-details-view/TR96754/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be20ab10>
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_160df2c3ac8d5acaa7f6aee0cfb0a80f.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_160df2c3ac8d5acaa7f6aee0cfb0a80f.jpg saved to cache
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5853aa09-134f-535f-a047-c4db9b75a0b9
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5513c10>
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_24bd6b02d85619b88138abf1b7688af0.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_24bd6b02d85619b88138abf1b7688af0.jpg saved to cache
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0e39d28-937d-54ff-a131-ab56b06a77ab
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf1b790>
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e1b26a6-bed1-5b57-8c06-508028f76179/7e1b26a6-bed1-5b57-8c06-508028f76179_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F78%252Fc578c57ee050b2f07e36d8c28b09f1d7%252Fpa%252FRS38976_6646ea28aaf4f2854e9012a5a3514e0d.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_6646ea28aaf4f2854e9012a5a3514e0d.jpg saved to cache
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e1b26a6-bed1-5b57-8c06-508028f76179
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1b1050>
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e1b26a6-bed1-5b57-8c06-508028f76179/7e1b26a6-bed1-5b57-8c06-508028f76179_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F78%252Fc578c57ee050b2f07e36d8c28b09f1d7%252Fpa%252FRS38976_2701003f557983d6b1cc8bcff6e3856b.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_2701003f557983d6b1cc8bcff6e3856b.jpg saved to cache
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e1b26a6-bed1-5b57-8c06-508028f76179
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be16a510>
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_40027bc0eb8a03df2e50ab43c7d96a01.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_40027bc0eb8a03df2e50ab43c7d96a01.jpg saved to cache
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8cee521-5ad3-55fb-8975-6c4b63651cf6
2026-03-27 10:34:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0abe673c-8b77-541a-9295-cefbdf803274 with identifier: VW35628
2026-03-27 10:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0abe673c-8b77-541a-9295-cefbdf803274 with scrape type 1
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0abe673c-8b77-541a-9295-cefbdf803274
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F07%252F2f07fbea3e7a90bc66a907a3c5200256%252Fpa%252FVW35628_e6c7983e0bc4389c305664ffb83e9556.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_e6c7983e0bc4389c305664ffb83e9556.jpg not downloaded yet
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F07%252F2f07fbea3e7a90bc66a907a3c5200256%252Fpa%252FVW35628_846e7a799f990270e947e027abcddce5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_846e7a799f990270e947e027abcddce5.jpg not downloaded yet
2026-03-27 10:34:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be106910>
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_09fc3c3e2a0df0c6bff7d9a969e3e63a.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_09fc3c3e2a0df0c6bff7d9a969e3e63a.jpg saved to cache
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 12903823-e98d-5fff-a95d-ef898ad9f779
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e92d0>
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e1b26a6-bed1-5b57-8c06-508028f76179/7e1b26a6-bed1-5b57-8c06-508028f76179_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F78%252Fc578c57ee050b2f07e36d8c28b09f1d7%252Fpa%252FRS38976_4c850bfe6833409b8bc454dbd89c9e24.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_4c850bfe6833409b8bc454dbd89c9e24.jpg saved to cache
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e1b26a6-bed1-5b57-8c06-508028f76179
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf556b10>
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e1b26a6-bed1-5b57-8c06-508028f76179/7e1b26a6-bed1-5b57-8c06-508028f76179_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F78%252Fc578c57ee050b2f07e36d8c28b09f1d7%252Fpa%252FRS38976_0f2ba281c02702a7099a074f95a6c673.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_0f2ba281c02702a7099a074f95a6c673.jpg saved to cache
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e1b26a6-bed1-5b57-8c06-508028f76179
2026-03-27 10:34:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39892cdc-c5a9-5146-8e08-9c537b08567e with identifier: TR96754
2026-03-27 10:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39892cdc-c5a9-5146-8e08-9c537b08567e with scrape type 1
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39892cdc-c5a9-5146-8e08-9c537b08567e
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_9c04c23442a406b8fbb7f92de8f28302.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_9c04c23442a406b8fbb7f92de8f28302.jpg not downloaded yet
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F07%252F2f07fbea3e7a90bc66a907a3c5200256%252Fpa%252FVW35628_73877291f7f9817a5c22da6329852b93.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_73877291f7f9817a5c22da6329852b93.jpg not downloaded yet
2026-03-27 10:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_751c47764a4eb036c84dda5f7e5fc2cc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_886a16b828aa0ae626a55ff541de158a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_eab96b34423321b6960aa212b97491a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_eab96b34423321b6960aa212b97491a6.jpg not downloaded yet
2026-03-27 10:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_5178eb21f7585ab3189e3e9e427c569c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_82e1fbb30a074dda1e283c23cfeeded0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_b136eb8a84ebd98fb014326054d69f17.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_8417ef84b0a2a1bb7b3e381e968b7064.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F07%252F2f07fbea3e7a90bc66a907a3c5200256%252Fpa%252FVW35628_0b61aa7f06819414ba27daccf94c52a8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_0b61aa7f06819414ba27daccf94c52a8.jpg not downloaded yet
2026-03-27 10:34:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_d99c620b10a945ccc5fdfb7290e1c571.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_d99c620b10a945ccc5fdfb7290e1c571.jpg not downloaded yet
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F07%252F2f07fbea3e7a90bc66a907a3c5200256%252Fpa%252FVW35628_75dc76d28fe035443c690291461d8932.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_75dc76d28fe035443c690291461d8932.jpg not downloaded yet
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_e584e42e288de7126ec14b2e0c6d89fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_e584e42e288de7126ec14b2e0c6d89fd.jpg not downloaded yet
2026-03-27 10:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_9c04c23442a406b8fbb7f92de8f28302.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_9e926d2a2403d7fe4e476a873c68b84f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_9e926d2a2403d7fe4e476a873c68b84f.jpg not downloaded yet
2026-03-27 10:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_a250cc3589dee3bf726d86071b7eb124.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_7c3d38304fb13b72cf4d8172b33894b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_7c3d38304fb13b72cf4d8172b33894b3.jpg not downloaded yet
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_4a5a2665ab6117b07d969eea8b8b6872.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_4a5a2665ab6117b07d969eea8b8b6872.jpg not downloaded yet
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be260410>
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e1b26a6-bed1-5b57-8c06-508028f76179/7e1b26a6-bed1-5b57-8c06-508028f76179_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F78%252Fc578c57ee050b2f07e36d8c28b09f1d7%252Fpa%252FRS38976_751c47764a4eb036c84dda5f7e5fc2cc.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_751c47764a4eb036c84dda5f7e5fc2cc.jpg saved to cache
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e1b26a6-bed1-5b57-8c06-508028f76179
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be205250>
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_886a16b828aa0ae626a55ff541de158a.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_886a16b828aa0ae626a55ff541de158a.jpg saved to cache
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0e39d28-937d-54ff-a131-ab56b06a77ab
2026-03-27 10:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_756baddb81d75c345f2b1bc1a545c72b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_4b8bd369c1c6f7c25a185e6e719b5b04.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_4b8bd369c1c6f7c25a185e6e719b5b04.jpg not downloaded yet
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be214310>
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e1b26a6-bed1-5b57-8c06-508028f76179/7e1b26a6-bed1-5b57-8c06-508028f76179_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F78%252Fc578c57ee050b2f07e36d8c28b09f1d7%252Fpa%252FRS38976_5178eb21f7585ab3189e3e9e427c569c.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_5178eb21f7585ab3189e3e9e427c569c.jpg saved to cache
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e1b26a6-bed1-5b57-8c06-508028f76179
2026-03-27 10:34:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e1b26a6-bed1-5b57-8c06-508028f76179, skipping ID generation
2026-03-27 10:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e1b26a6-bed1-5b57-8c06-508028f76179 with scrape type 1
2026-03-27 10:34:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e1b26a6-bed1-5b57-8c06-508028f76179 sending to next pipeline
2026-03-27 10:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e1b26a6-bed1-5b57-8c06-508028f76179, identifier: RS38976
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be113c90>
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_82e1fbb30a074dda1e283c23cfeeded0.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_82e1fbb30a074dda1e283c23cfeeded0.jpg saved to cache
2026-03-27 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0e39d28-937d-54ff-a131-ab56b06a77ab
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf554e50>
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_b136eb8a84ebd98fb014326054d69f17.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_b136eb8a84ebd98fb014326054d69f17.jpg saved to cache
2026-03-27 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5853aa09-134f-535f-a047-c4db9b75a0b9
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf387350>
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_8417ef84b0a2a1bb7b3e381e968b7064.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_8417ef84b0a2a1bb7b3e381e968b7064.jpg saved to cache
2026-03-27 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12903823-e98d-5fff-a95d-ef898ad9f779
2026-03-27 10:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_50aaac9d1063c5f55c539a991b662d96.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_73877291f7f9817a5c22da6329852b93.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e1b26a6-bed1-5b57-8c06-508028f76179 with identifier: RS38976
2026-03-27 10:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e1b26a6-bed1-5b57-8c06-508028f76179 with identifier: RS38976
2026-03-27 10:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e1b26a6-bed1-5b57-8c06-508028f76179 with identifier: RS38976 to the API
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_5178eb21f7585ab3189e3e9e427c569c.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:06:59Z',
'fuel_type': 'petrol',
'id': '7e1b26a6-bed1-5b57-8c06-508028f76179',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS38976',
'listing': 'auction',
'location': 'DE, Magdeburg',
'make': 'Opel',
'model': 'Astra GTC',
'odometer': 128592,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e1b26a6-bed1-5b57-8c06-508028f76179/7e1b26a6-bed1-5b57-8c06-508028f76179_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_6646ea28aaf4f2854e9012a5a3514e0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e1b26a6-bed1-5b57-8c06-508028f76179/7e1b26a6-bed1-5b57-8c06-508028f76179_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_2701003f557983d6b1cc8bcff6e3856b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e1b26a6-bed1-5b57-8c06-508028f76179/7e1b26a6-bed1-5b57-8c06-508028f76179_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75589,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_4c850bfe6833409b8bc454dbd89c9e24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e1b26a6-bed1-5b57-8c06-508028f76179/7e1b26a6-bed1-5b57-8c06-508028f76179_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76419,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_5178eb21f7585ab3189e3e9e427c569c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e1b26a6-bed1-5b57-8c06-508028f76179/7e1b26a6-bed1-5b57-8c06-508028f76179_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_751c47764a4eb036c84dda5f7e5fc2cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e1b26a6-bed1-5b57-8c06-508028f76179/7e1b26a6-bed1-5b57-8c06-508028f76179_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95324,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/78/c578c57ee050b2f07e36d8c28b09f1d7/pa/RS38976_0f2ba281c02702a7099a074f95a6c673.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2005-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Astra GTC 1.6 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2005}
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS38976%27 HTTP/1.1" 200 None
2026-03-27 10:34:52 [auto1.de] INFO: Saving data for RS38976: {'created_time': 1774607692.720533, 'last_price_update_time': 1774607692.720545, 'auction_closing_time': 1774714019.0}
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS38976') HTTP/1.1" 204 0
2026-03-27 10:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_e3f5800e85fcb3879dce851d2cd8bba6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_378d1bbd599aecaf052a34467bf60cf8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_378d1bbd599aecaf052a34467bf60cf8.jpg not downloaded yet
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5657b50>
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_9c04c23442a406b8fbb7f92de8f28302.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_9c04c23442a406b8fbb7f92de8f28302.jpg saved to cache
2026-03-27 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39892cdc-c5a9-5146-8e08-9c537b08567e
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf0f7d0>
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1e%252F6b1ed44bc82e27624ad989ab970f4528%252Fpa%252FJL12737_a250cc3589dee3bf726d86071b7eb124.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_a250cc3589dee3bf726d86071b7eb124.jpg saved to cache
2026-03-27 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8cee521-5ad3-55fb-8975-6c4b63651cf6
2026-03-27 10:34:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8cee521-5ad3-55fb-8975-6c4b63651cf6, skipping ID generation
2026-03-27 10:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8cee521-5ad3-55fb-8975-6c4b63651cf6 with scrape type 1
2026-03-27 10:34:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8cee521-5ad3-55fb-8975-6c4b63651cf6 sending to next pipeline
2026-03-27 10:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8cee521-5ad3-55fb-8975-6c4b63651cf6, identifier: JL12737
2026-03-27 10:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_846e7a799f990270e947e027abcddce5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA36365/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8cee521-5ad3-55fb-8975-6c4b63651cf6 with identifier: JL12737
2026-03-27 10:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8cee521-5ad3-55fb-8975-6c4b63651cf6 with identifier: JL12737
2026-03-27 10:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8cee521-5ad3-55fb-8975-6c4b63651cf6 with identifier: JL12737 to the API
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_a250cc3589dee3bf726d86071b7eb124.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 218,
'expiration_date': '2026-03-28T16:58:38Z',
'fuel_type': 'hybrid',
'id': 'c8cee521-5ad3-55fb-8975-6c4b63651cf6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL12737',
'listing': 'auction',
'location': 'DE',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 68914,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82404,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_f5191c9d2f87b19c16a03c61c89e5721.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79786,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_a250cc3589dee3bf726d86071b7eb124.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73285,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_82be8c5d8b5ba815957a7a4272cd9b0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_39c28da6f24577d393df155f752d2068.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_40027bc0eb8a03df2e50ab43c7d96a01.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78713,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_8228ec0b39cd01089fe352e4abcd48f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71455,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_11086a01745d26a8f1e3a93651ce602e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_ebe6f7df857801c2d6e9afcb74c734ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82821,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_164f2ba54260b876252d7fca5dd49c52.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cee521-5ad3-55fb-8975-6c4b63651cf6/c8cee521-5ad3-55fb-8975-6c4b63651cf6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71983,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/1e/6b1ed44bc82e27624ad989ab970f4528/pa/JL12737_9de9a6b322c252c7f41f8b558cc4f2e3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-09',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 250e Shooting Brake Edition 2020 AMG '
'Line',
'transmission': 'automatic',
'trim': 'Edition 2020 AMG Line',
'year': 2021}
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL12737%27 HTTP/1.1" 200 None
2026-03-27 10:34:53 [auto1.de] INFO: Saving data for JL12737: {'created_time': 1774607693.391996, 'last_price_update_time': 1774607693.39201, 'auction_closing_time': 1774717118.0}
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL12737') HTTP/1.1" 204 0
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c564de50>
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_756baddb81d75c345f2b1bc1a545c72b.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_756baddb81d75c345f2b1bc1a545c72b.jpg saved to cache
2026-03-27 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0e39d28-937d-54ff-a131-ab56b06a77ab
2026-03-27 10:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_d17128113bd4e01ac4da164149d8532d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_e6c7983e0bc4389c305664ffb83e9556.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_2a5d1f282a3ba5dc4af58041a265fc8b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_2a5d1f282a3ba5dc4af58041a265fc8b.jpg not downloaded yet
2026-03-27 10:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC35382/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_e584e42e288de7126ec14b2e0c6d89fd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf82390>
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_50aaac9d1063c5f55c539a991b662d96.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_50aaac9d1063c5f55c539a991b662d96.jpg saved to cache
2026-03-27 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12903823-e98d-5fff-a95d-ef898ad9f779
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2d8210>
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0abe673c-8b77-541a-9295-cefbdf803274/0abe673c-8b77-541a-9295-cefbdf803274_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F07%252F2f07fbea3e7a90bc66a907a3c5200256%252Fpa%252FVW35628_73877291f7f9817a5c22da6329852b93.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_73877291f7f9817a5c22da6329852b93.jpg saved to cache
2026-03-27 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0abe673c-8b77-541a-9295-cefbdf803274
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0b0910>
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_e3f5800e85fcb3879dce851d2cd8bba6.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_e3f5800e85fcb3879dce851d2cd8bba6.jpg saved to cache
2026-03-27 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5853aa09-134f-535f-a047-c4db9b75a0b9
2026-03-27 10:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_9e926d2a2403d7fe4e476a873c68b84f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf384990>
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0abe673c-8b77-541a-9295-cefbdf803274/0abe673c-8b77-541a-9295-cefbdf803274_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F07%252F2f07fbea3e7a90bc66a907a3c5200256%252Fpa%252FVW35628_846e7a799f990270e947e027abcddce5.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_846e7a799f990270e947e027abcddce5.jpg saved to cache
2026-03-27 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0abe673c-8b77-541a-9295-cefbdf803274
2026-03-27 10:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_4a5a2665ab6117b07d969eea8b8b6872.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5c1dd0>
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_d17128113bd4e01ac4da164149d8532d.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_d17128113bd4e01ac4da164149d8532d.jpg saved to cache
2026-03-27 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0e39d28-937d-54ff-a131-ab56b06a77ab
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf31b910>
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0abe673c-8b77-541a-9295-cefbdf803274/0abe673c-8b77-541a-9295-cefbdf803274_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F07%252F2f07fbea3e7a90bc66a907a3c5200256%252Fpa%252FVW35628_e6c7983e0bc4389c305664ffb83e9556.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_e6c7983e0bc4389c305664ffb83e9556.jpg saved to cache
2026-03-27 10:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0abe673c-8b77-541a-9295-cefbdf803274
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2054d0>
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_e584e42e288de7126ec14b2e0c6d89fd.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_e584e42e288de7126ec14b2e0c6d89fd.jpg saved to cache
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39892cdc-c5a9-5146-8e08-9c537b08567e
2026-03-27 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_4b8bd369c1c6f7c25a185e6e719b5b04.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_7c3d38304fb13b72cf4d8172b33894b3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_d99c620b10a945ccc5fdfb7290e1c571.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2636d0>
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_9e926d2a2403d7fe4e476a873c68b84f.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_9e926d2a2403d7fe4e476a873c68b84f.jpg saved to cache
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39892cdc-c5a9-5146-8e08-9c537b08567e
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be28b890>
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_4a5a2665ab6117b07d969eea8b8b6872.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_4a5a2665ab6117b07d969eea8b8b6872.jpg saved to cache
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39892cdc-c5a9-5146-8e08-9c537b08567e
2026-03-27 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_75dc76d28fe035443c690291461d8932.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_0b61aa7f06819414ba27daccf94c52a8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_eab96b34423321b6960aa212b97491a6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_7fb9cab3e69108311d72d000fa38c041.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_378d1bbd599aecaf052a34467bf60cf8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c53c5510>
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_4b8bd369c1c6f7c25a185e6e719b5b04.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_4b8bd369c1c6f7c25a185e6e719b5b04.jpg saved to cache
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39892cdc-c5a9-5146-8e08-9c537b08567e
2026-03-27 10:34:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be262b90>
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_7c3d38304fb13b72cf4d8172b33894b3.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_7c3d38304fb13b72cf4d8172b33894b3.jpg saved to cache
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39892cdc-c5a9-5146-8e08-9c537b08567e
2026-03-27 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV29308> (referer: https://www.auto1.com/v1/car-details-view/ZV29308/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_9e2a7cc69f327d2d68227dfdbd132db8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be10cc10>
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_d99c620b10a945ccc5fdfb7290e1c571.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_d99c620b10a945ccc5fdfb7290e1c571.jpg saved to cache
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39892cdc-c5a9-5146-8e08-9c537b08567e
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf485110>
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0abe673c-8b77-541a-9295-cefbdf803274/0abe673c-8b77-541a-9295-cefbdf803274_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F07%252F2f07fbea3e7a90bc66a907a3c5200256%252Fpa%252FVW35628_75dc76d28fe035443c690291461d8932.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_75dc76d28fe035443c690291461d8932.jpg saved to cache
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0abe673c-8b77-541a-9295-cefbdf803274
2026-03-27 10:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_2a5d1f282a3ba5dc4af58041a265fc8b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be10d250>
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0abe673c-8b77-541a-9295-cefbdf803274/0abe673c-8b77-541a-9295-cefbdf803274_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F07%252F2f07fbea3e7a90bc66a907a3c5200256%252Fpa%252FVW35628_0b61aa7f06819414ba27daccf94c52a8.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_0b61aa7f06819414ba27daccf94c52a8.jpg saved to cache
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0abe673c-8b77-541a-9295-cefbdf803274
2026-03-27 10:34:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0abe673c-8b77-541a-9295-cefbdf803274, skipping ID generation
2026-03-27 10:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0abe673c-8b77-541a-9295-cefbdf803274 with scrape type 1
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0abe673c-8b77-541a-9295-cefbdf803274 sending to next pipeline
2026-03-27 10:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0abe673c-8b77-541a-9295-cefbdf803274, identifier: VW35628
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2d84d0>
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_eab96b34423321b6960aa212b97491a6.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_eab96b34423321b6960aa212b97491a6.jpg saved to cache
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39892cdc-c5a9-5146-8e08-9c537b08567e
2026-03-27 10:34:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be08d6d0>
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_7fb9cab3e69108311d72d000fa38c041.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_7fb9cab3e69108311d72d000fa38c041.jpg saved to cache
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12903823-e98d-5fff-a95d-ef898ad9f779
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be20c290>
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_378d1bbd599aecaf052a34467bf60cf8.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_378d1bbd599aecaf052a34467bf60cf8.jpg saved to cache
2026-03-27 10:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 39892cdc-c5a9-5146-8e08-9c537b08567e
2026-03-27 10:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0abe673c-8b77-541a-9295-cefbdf803274 with identifier: VW35628
2026-03-27 10:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0abe673c-8b77-541a-9295-cefbdf803274 with identifier: VW35628
2026-03-27 10:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0abe673c-8b77-541a-9295-cefbdf803274 with identifier: VW35628 to the API
2026-03-27 10:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_0b61aa7f06819414ba27daccf94c52a8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:02:59Z',
'fuel_type': 'petrol',
'id': '0abe673c-8b77-541a-9295-cefbdf803274',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW35628',
'listing': 'auction',
'location': 'DE, Frankfurt',
'make': 'Toyota',
'model': 'Corolla',
'odometer': 166657,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0abe673c-8b77-541a-9295-cefbdf803274/0abe673c-8b77-541a-9295-cefbdf803274_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94422,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_e6c7983e0bc4389c305664ffb83e9556.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0abe673c-8b77-541a-9295-cefbdf803274/0abe673c-8b77-541a-9295-cefbdf803274_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89640,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_846e7a799f990270e947e027abcddce5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0abe673c-8b77-541a-9295-cefbdf803274/0abe673c-8b77-541a-9295-cefbdf803274_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_73877291f7f9817a5c22da6329852b93.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0abe673c-8b77-541a-9295-cefbdf803274/0abe673c-8b77-541a-9295-cefbdf803274_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83400,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_0b61aa7f06819414ba27daccf94c52a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0abe673c-8b77-541a-9295-cefbdf803274/0abe673c-8b77-541a-9295-cefbdf803274_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 127861,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/07/2f07fbea3e7a90bc66a907a3c5200256/pa/VW35628_75dc76d28fe035443c690291461d8932.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2003-11-02',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Corolla 1.6 Compact',
'transmission': 'manual',
'trim': 'Compact',
'year': 2003}
2026-03-27 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW35628%27 HTTP/1.1" 200 None
2026-03-27 10:34:55 [auto1.de] INFO: Saving data for VW35628: {'created_time': 1774607695.469255, 'last_price_update_time': 1774607695.469267, 'auction_closing_time': 1774713779.0}
2026-03-27 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW35628') HTTP/1.1" 204 0
2026-03-27 10:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_c393454800e5fe3a61e2e964a2000c58.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZW26780/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53c69dda-dcac-5e57-8e79-44b586e0ef5c with identifier: ZV29308
2026-03-27 10:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53c69dda-dcac-5e57-8e79-44b586e0ef5c with scrape type 1
2026-03-27 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53c69dda-dcac-5e57-8e79-44b586e0ef5c
2026-03-27 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_08fb09e2a76dbbc213b4f11fabc4f9fb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_08fb09e2a76dbbc213b4f11fabc4f9fb.jpg not downloaded yet
2026-03-27 10:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf588150>
2026-03-27 10:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F52%252F38528fa2d993237a5103a3d717538e37%252Fpa%252FEA13561_9e2a7cc69f327d2d68227dfdbd132db8.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_9e2a7cc69f327d2d68227dfdbd132db8.jpg saved to cache
2026-03-27 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0e39d28-937d-54ff-a131-ab56b06a77ab
2026-03-27 10:34:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0e39d28-937d-54ff-a131-ab56b06a77ab, skipping ID generation
2026-03-27 10:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0e39d28-937d-54ff-a131-ab56b06a77ab with scrape type 1
2026-03-27 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0e39d28-937d-54ff-a131-ab56b06a77ab sending to next pipeline
2026-03-27 10:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0e39d28-937d-54ff-a131-ab56b06a77ab, identifier: EA13561
2026-03-27 10:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf80b90>
2026-03-27 10:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F1c%252F231cdbbe573ef3b8d7d13e11b74ad782%252Fpa%252FTR96754_2a5d1f282a3ba5dc4af58041a265fc8b.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_2a5d1f282a3ba5dc4af58041a265fc8b.jpg saved to cache
2026-03-27 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 39892cdc-c5a9-5146-8e08-9c537b08567e
2026-03-27 10:34:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39892cdc-c5a9-5146-8e08-9c537b08567e, skipping ID generation
2026-03-27 10:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39892cdc-c5a9-5146-8e08-9c537b08567e with scrape type 1
2026-03-27 10:34:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39892cdc-c5a9-5146-8e08-9c537b08567e sending to next pipeline
2026-03-27 10:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39892cdc-c5a9-5146-8e08-9c537b08567e, identifier: TR96754
2026-03-27 10:34:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0e39d28-937d-54ff-a131-ab56b06a77ab with identifier: EA13561
2026-03-27 10:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0e39d28-937d-54ff-a131-ab56b06a77ab with identifier: EA13561
2026-03-27 10:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0e39d28-937d-54ff-a131-ab56b06a77ab with identifier: EA13561 to the API
2026-03-27 10:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_9e2a7cc69f327d2d68227dfdbd132db8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:01:44Z',
'fuel_type': 'petrol',
'id': 'd0e39d28-937d-54ff-a131-ab56b06a77ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA13561',
'listing': 'auction',
'location': 'DE, Mannheim',
'make': 'Citroen',
'model': 'C4',
'odometer': 30261,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_9e2a7cc69f327d2d68227dfdbd132db8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_d17128113bd4e01ac4da164149d8532d.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_756baddb81d75c345f2b1bc1a545c72b.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_886a16b828aa0ae626a55ff541de158a.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80123,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_82e1fbb30a074dda1e283c23cfeeded0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_9ea7d81567212fed6fb7fe6ee5459005.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_24bd6b02d85619b88138abf1b7688af0.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_bf848376665e207187ca3a7b819dfb0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_c3830e5e18e4c128735225cc0c020a95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0e39d28-937d-54ff-a131-ab56b06a77ab/d0e39d28-937d-54ff-a131-ab56b06a77ab_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81627,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/52/38528fa2d993237a5103a3d717538e37/pa/EA13561_54e613f32908ba9564d77f07f2c06264.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-11-20',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.2 PureTech Max',
'transmission': 'automatic',
'trim': 'Max',
'year': 2023}
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13561%27 HTTP/1.1" 200 None
2026-03-27 10:34:56 [auto1.de] INFO: Saving data for EA13561: {'created_time': 1774607696.282242, 'last_price_update_time': 1774607696.282256, 'auction_closing_time': 1774713704.0}
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA13561') HTTP/1.1" 204 0
2026-03-27 10:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39892cdc-c5a9-5146-8e08-9c537b08567e with identifier: TR96754
2026-03-27 10:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39892cdc-c5a9-5146-8e08-9c537b08567e with identifier: TR96754
2026-03-27 10:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39892cdc-c5a9-5146-8e08-9c537b08567e with identifier: TR96754 to the API
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_2a5d1f282a3ba5dc4af58041a265fc8b.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 195,
'expiration_date': '2026-03-28T16:00:00Z',
'fuel_type': 'diesel',
'id': '39892cdc-c5a9-5146-8e08-9c537b08567e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR96754',
'listing': 'auction',
'location': 'DE',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 100155,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 43,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89375,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_9c04c23442a406b8fbb7f92de8f28302.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_eab96b34423321b6960aa212b97491a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_d99c620b10a945ccc5fdfb7290e1c571.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_e584e42e288de7126ec14b2e0c6d89fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101065,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_9e926d2a2403d7fe4e476a873c68b84f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96635,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_7c3d38304fb13b72cf4d8172b33894b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91297,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_4a5a2665ab6117b07d969eea8b8b6872.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109726,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_4b8bd369c1c6f7c25a185e6e719b5b04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_378d1bbd599aecaf052a34467bf60cf8.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39892cdc-c5a9-5146-8e08-9c537b08567e/39892cdc-c5a9-5146-8e08-9c537b08567e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/1c/231cdbbe573ef3b8d7d13e11b74ad782/pa/TR96754_2a5d1f282a3ba5dc4af58041a265fc8b.jpg',
'Width': 450}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-08',
'seats_number': 4,
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR96754%27 HTTP/1.1" 200 None
2026-03-27 10:34:56 [auto1.de] INFO: Saving data for TR96754: {'created_time': 1774607696.67057, 'last_price_update_time': 1774607696.670582, 'auction_closing_time': 1774713600.0}
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR96754') HTTP/1.1" 204 0
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_3ee4ab19bb1c9b7c21689e8a9df553f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_3ee4ab19bb1c9b7c21689e8a9df553f1.jpg not downloaded yet
2026-03-27 10:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_46850de216a4ec15a6125b70311111dc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC35382> (referer: https://www.auto1.com/v1/car-details-view/KC35382/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB33034/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA36365> (referer: https://www.auto1.com/v1/car-details-view/PA36365/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN48826/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR18629/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3afad0>
2026-03-27 10:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_c393454800e5fe3a61e2e964a2000c58.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_c393454800e5fe3a61e2e964a2000c58.jpg saved to cache
2026-03-27 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe047b51-72f5-552c-84ed-2f45b2927b3c
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_fc24ad881ab98d8ea30b75010213982c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_fc24ad881ab98d8ea30b75010213982c.jpg not downloaded yet
2026-03-27 10:34:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_0fc23daa43d5822b8171cc2117a4710d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_0fc23daa43d5822b8171cc2117a4710d.jpg not downloaded yet
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_23c8d05a919b9ddcccc619ba50e8dc6b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_23c8d05a919b9ddcccc619ba50e8dc6b.jpg not downloaded yet
2026-03-27 10:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_d5f1867f3ac531049cbda53fc46ac959.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_534952895a432cd888e68648ed0ae5f8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_b7d4f8ac26c7900a3305b4a2721dbc94.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_b7d4f8ac26c7900a3305b4a2721dbc94.jpg not downloaded yet
2026-03-27 10:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_08fb09e2a76dbbc213b4f11fabc4f9fb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_3ee4ab19bb1c9b7c21689e8a9df553f1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_56f9872a8c7101456ed2dc536c28b3d0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_56f9872a8c7101456ed2dc536c28b3d0.jpg not downloaded yet
2026-03-27 10:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be129550>
2026-03-27 10:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05173537-eda3-5b76-9666-74ea991d2f44/05173537-eda3-5b76-9666-74ea991d2f44_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2b%252Fa82b3d9c1d3d83c3526f681a8e73d745%252Fpa%252FAX51342_46850de216a4ec15a6125b70311111dc.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_46850de216a4ec15a6125b70311111dc.jpg saved to cache
2026-03-27 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05173537-eda3-5b76-9666-74ea991d2f44
2026-03-27 10:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb615a1b-1996-5280-a7b5-0122438e64ae with identifier: KC35382
2026-03-27 10:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb615a1b-1996-5280-a7b5-0122438e64ae with scrape type 1
2026-03-27 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb615a1b-1996-5280-a7b5-0122438e64ae
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_aa9f3a13e842e128cf4b8afc1cf2e582.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_aa9f3a13e842e128cf4b8afc1cf2e582.jpg not downloaded yet
2026-03-27 10:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: PA36365
2026-03-27 10:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 975e6ac5-250d-5bb6-8ecf-3308799273a7 with scrape type 1
2026-03-27 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_65a0c88dc9e443f0306a94101478f581.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_65a0c88dc9e443f0306a94101478f581.jpg not downloaded yet
2026-03-27 10:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_dafb67bea31846d42e37f907837975c2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_8c0620ce843d2ba3c645486f2830c316.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_8c0620ce843d2ba3c645486f2830c316.jpg not downloaded yet
2026-03-27 10:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_159158611014d245f9af0a6b369adcea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_159158611014d245f9af0a6b369adcea.jpg not downloaded yet
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_c1518000fede7ce43379f3fbd74fc52e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_c1518000fede7ce43379f3fbd74fc52e.jpg not downloaded yet
2026-03-27 10:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_05d12ce53d07131f1fb154be0b9dde18.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_41d301983fb3a7feef105bce97e8d3ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_41d301983fb3a7feef105bce97e8d3ba.jpg not downloaded yet
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_3d431a97dbad3e69e7eb0cd2dfea0dd5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_3d431a97dbad3e69e7eb0cd2dfea0dd5.jpg not downloaded yet
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_184ced121a0a86623e41ecf238ecde77.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_184ced121a0a86623e41ecf238ecde77.jpg not downloaded yet
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_90b412e3a516be32a44085f080209862.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_90b412e3a516be32a44085f080209862.jpg not downloaded yet
2026-03-27 10:34:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1ea510>
2026-03-27 10:34:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F0b%252Fcc0b2efd1a3ccd6901c7ef79690be01d%252Fpa%252FXK99060_d5f1867f3ac531049cbda53fc46ac959.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_d5f1867f3ac531049cbda53fc46ac959.jpg saved to cache
2026-03-27 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5853aa09-134f-535f-a047-c4db9b75a0b9
2026-03-27 10:34:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5853aa09-134f-535f-a047-c4db9b75a0b9, skipping ID generation
2026-03-27 10:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5853aa09-134f-535f-a047-c4db9b75a0b9 with scrape type 1
2026-03-27 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5853aa09-134f-535f-a047-c4db9b75a0b9 sending to next pipeline
2026-03-27 10:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5853aa09-134f-535f-a047-c4db9b75a0b9, identifier: XK99060
2026-03-27 10:34:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:34:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c535b950>
2026-03-27 10:34:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fa2%252Fdda2874269d93558778b9fefd28dfcb8%252Fpa%252FGB59587_534952895a432cd888e68648ed0ae5f8.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_534952895a432cd888e68648ed0ae5f8.jpg saved to cache
2026-03-27 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12903823-e98d-5fff-a95d-ef898ad9f779
2026-03-27 10:34:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12903823-e98d-5fff-a95d-ef898ad9f779, skipping ID generation
2026-03-27 10:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12903823-e98d-5fff-a95d-ef898ad9f779 with scrape type 1
2026-03-27 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12903823-e98d-5fff-a95d-ef898ad9f779 sending to next pipeline
2026-03-27 10:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12903823-e98d-5fff-a95d-ef898ad9f779, identifier: GB59587
2026-03-27 10:34:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be217650>
2026-03-27 10:34:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_08fb09e2a76dbbc213b4f11fabc4f9fb.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_08fb09e2a76dbbc213b4f11fabc4f9fb.jpg saved to cache
2026-03-27 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53c69dda-dcac-5e57-8e79-44b586e0ef5c
2026-03-27 10:34:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf0f910>
2026-03-27 10:34:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_3ee4ab19bb1c9b7c21689e8a9df553f1.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_3ee4ab19bb1c9b7c21689e8a9df553f1.jpg saved to cache
2026-03-27 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53c69dda-dcac-5e57-8e79-44b586e0ef5c
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_7637138f945c88565e9ae70c6a153e57.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_7637138f945c88565e9ae70c6a153e57.jpg not downloaded yet
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_544fe4b09e9bb5d3f8df78d0025d6009.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_544fe4b09e9bb5d3f8df78d0025d6009.jpg not downloaded yet
2026-03-27 10:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5853aa09-134f-535f-a047-c4db9b75a0b9 with identifier: XK99060
2026-03-27 10:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5853aa09-134f-535f-a047-c4db9b75a0b9 with identifier: XK99060
2026-03-27 10:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5853aa09-134f-535f-a047-c4db9b75a0b9 with identifier: XK99060 to the API
2026-03-27 10:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_d5f1867f3ac531049cbda53fc46ac959.jpg>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 67,
'expiration_date': '2026-03-28T16:03:25Z',
'fuel_type': 'petrol',
'id': '5853aa09-134f-535f-a047-c4db9b75a0b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK99060',
'listing': 'auction',
'location': 'DE, Lahnstein',
'make': 'Hyundai',
'model': 'i10',
'odometer': 41400,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77039,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_d20913ecbc274256b4a486004bb0660a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_e3f5800e85fcb3879dce851d2cd8bba6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2642642,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_d5f1867f3ac531049cbda53fc46ac959.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63544,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_8cbf4a86f692939672da2ea07a3e3de8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_b136eb8a84ebd98fb014326054d69f17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_022109b659a56d9201db6d8c2492d4ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59362,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_160df2c3ac8d5acaa7f6aee0cfb0a80f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75873,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_891725942ffb90f3b2c2baf19230a2f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2605493,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_cd9aa882476a54a3e2e1a0470f6dce30.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5853aa09-134f-535f-a047-c4db9b75a0b9/5853aa09-134f-535f-a047-c4db9b75a0b9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77109,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/0b/cc0b2efd1a3ccd6901c7ef79690be01d/pa/XK99060_607a062c129e876846555ccb7b255b0f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-25',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai i10 1.0 Select',
'transmission': 'manual',
'trim': 'Select',
'year': 2019}
2026-03-27 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK99060%27 HTTP/1.1" 200 None
2026-03-27 10:34:58 [auto1.de] INFO: Saving data for XK99060: {'created_time': 1774607698.921852, 'last_price_update_time': 1774607698.921864, 'auction_closing_time': 1774713805.0}
2026-03-27 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK99060') HTTP/1.1" 204 0
2026-03-27 10:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12903823-e98d-5fff-a95d-ef898ad9f779 with identifier: GB59587
2026-03-27 10:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12903823-e98d-5fff-a95d-ef898ad9f779 with identifier: GB59587
2026-03-27 10:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12903823-e98d-5fff-a95d-ef898ad9f779 with identifier: GB59587 to the API
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_534952895a432cd888e68648ed0ae5f8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:40:37Z',
'fuel_type': 'diesel',
'id': '12903823-e98d-5fff-a95d-ef898ad9f779',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB59587',
'listing': 'auction',
'location': 'DE, Lüneburg',
'make': 'MINI',
'model': 'Clubman',
'odometer': 93177,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_d8a95b186786bbad83876dce6279c7b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2731725,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_534952895a432cd888e68648ed0ae5f8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_8417ef84b0a2a1bb7b3e381e968b7064.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62070,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_b925209634539f32357a41edd397ddba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2429707,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_7fb9cab3e69108311d72d000fa38c041.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2262470,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_e9cd47413909e149eab91205253de24d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2082680,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_50aaac9d1063c5f55c539a991b662d96.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2565446,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_09fc3c3e2a0df0c6bff7d9a969e3e63a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2479057,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_216d8a5783988139c04ccd47d87a02fc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12903823-e98d-5fff-a95d-ef898ad9f779/12903823-e98d-5fff-a95d-ef898ad9f779_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2317056,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/a2/dda2874269d93558778b9fefd28dfcb8/pa/GB59587_f7d56090455e6f083bf1c6849ed722a2.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-09-11',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Clubman Cooper SD',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB59587%27 HTTP/1.1" 200 None
2026-03-27 10:34:59 [auto1.de] INFO: Saving data for GB59587: {'created_time': 1774607699.442725, 'last_price_update_time': 1774607699.442736, 'auction_closing_time': 1774716037.0}
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB59587') HTTP/1.1" 204 0
2026-03-27 10:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be261e90>
2026-03-27 10:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_dafb67bea31846d42e37f907837975c2.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_dafb67bea31846d42e37f907837975c2.jpg saved to cache
2026-03-27 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe047b51-72f5-552c-84ed-2f45b2927b3c
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_b26fef9353a8bd08ba9a82d4b330584b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_b26fef9353a8bd08ba9a82d4b330584b.jpg not downloaded yet
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_daab39d075886e529f8f2732d3764acf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_daab39d075886e529f8f2732d3764acf.jpg not downloaded yet
2026-03-27 10:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE37655/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZU85888/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf32c910>
2026-03-27 10:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05173537-eda3-5b76-9666-74ea991d2f44/05173537-eda3-5b76-9666-74ea991d2f44_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F2b%252Fa82b3d9c1d3d83c3526f681a8e73d745%252Fpa%252FAX51342_05d12ce53d07131f1fb154be0b9dde18.jpg') HTTP/1.1" 204 0
2026-03-27 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_05d12ce53d07131f1fb154be0b9dde18.jpg saved to cache
2026-03-27 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05173537-eda3-5b76-9666-74ea991d2f44
2026-03-27 10:34:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05173537-eda3-5b76-9666-74ea991d2f44, skipping ID generation
2026-03-27 10:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05173537-eda3-5b76-9666-74ea991d2f44 with scrape type 1
2026-03-27 10:34:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05173537-eda3-5b76-9666-74ea991d2f44 sending to next pipeline
2026-03-27 10:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05173537-eda3-5b76-9666-74ea991d2f44, identifier: AX51342
2026-03-27 10:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_5cc93f7b8864fb3366ebc469bec3c59c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05173537-eda3-5b76-9666-74ea991d2f44 with identifier: AX51342
2026-03-27 10:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05173537-eda3-5b76-9666-74ea991d2f44 with identifier: AX51342
2026-03-27 10:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05173537-eda3-5b76-9666-74ea991d2f44 with identifier: AX51342 to the API
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_05d12ce53d07131f1fb154be0b9dde18.jpg>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:46:59Z',
'fuel_type': 'petrol',
'id': '05173537-eda3-5b76-9666-74ea991d2f44',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX51342',
'listing': 'auction',
'location': 'DE, Regensburg',
'make': 'Opel',
'model': 'Corsa',
'odometer': 130502,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05173537-eda3-5b76-9666-74ea991d2f44/05173537-eda3-5b76-9666-74ea991d2f44_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109777,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_05d12ce53d07131f1fb154be0b9dde18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05173537-eda3-5b76-9666-74ea991d2f44/05173537-eda3-5b76-9666-74ea991d2f44_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93553,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_46850de216a4ec15a6125b70311111dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05173537-eda3-5b76-9666-74ea991d2f44/05173537-eda3-5b76-9666-74ea991d2f44_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_8842d2e68bc749c446e7edcd56849d08.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05173537-eda3-5b76-9666-74ea991d2f44/05173537-eda3-5b76-9666-74ea991d2f44_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_f8bf3749661004f02ddb7e58cd4e286c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05173537-eda3-5b76-9666-74ea991d2f44/05173537-eda3-5b76-9666-74ea991d2f44_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_e2afdbe9f23bc8db0bd2af2aaf4deb3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05173537-eda3-5b76-9666-74ea991d2f44/05173537-eda3-5b76-9666-74ea991d2f44_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/2b/a82b3d9c1d3d83c3526f681a8e73d745/pa/AX51342_61e7f51b79c64a50716bad0e74d53e03.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.4 Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2006}
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX51342%27 HTTP/1.1" 200 None
2026-03-27 10:35:00 [auto1.de] INFO: Saving data for AX51342: {'created_time': 1774607700.087076, 'last_price_update_time': 1774607700.08709, 'auction_closing_time': 1774716419.0}
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX51342') HTTP/1.1" 204 0
2026-03-27 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_245a5906f4ee24fe4b1a86970a5122ad.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_820895ef06bcd12b5f1c1ffdef563de5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_820895ef06bcd12b5f1c1ffdef563de5.jpg not downloaded yet
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_d47fb783168c0cc7a1d0c32bd7f72d36.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_d47fb783168c0cc7a1d0c32bd7f72d36.jpg not downloaded yet
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_a1dad940768a825c801cf77cb586b3a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_a1dad940768a825c801cf77cb586b3a1.jpg not downloaded yet
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_97b396580617ac8804f25289329cd7b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_97b396580617ac8804f25289329cd7b8.jpg not downloaded yet
2026-03-27 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_c7debf8a6a5600c51bcd61bd8fa3bae1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0ab850>
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_5cc93f7b8864fb3366ebc469bec3c59c.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_5cc93f7b8864fb3366ebc469bec3c59c.jpg saved to cache
2026-03-27 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fe047b51-72f5-552c-84ed-2f45b2927b3c
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_98c3ce4ca5606ba95f50bbed5786e048.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_98c3ce4ca5606ba95f50bbed5786e048.jpg not downloaded yet
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_5e0044f5d399fe5144af524b9957f4e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_5e0044f5d399fe5144af524b9957f4e8.jpg not downloaded yet
2026-03-27 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_7637138f945c88565e9ae70c6a153e57.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_daab39d075886e529f8f2732d3764acf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_184ced121a0a86623e41ecf238ecde77.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_b26fef9353a8bd08ba9a82d4b330584b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_77f4b5bc3c383245d5e6141cfe8474a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_77f4b5bc3c383245d5e6141cfe8474a5.jpg not downloaded yet
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_b2e2c8bf200c0c00e7a63d2ce320b94f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_b2e2c8bf200c0c00e7a63d2ce320b94f.jpg not downloaded yet
2026-03-27 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT90816> (referer: https://www.auto1.com/v1/car-details-view/PT90816/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0b14d0>
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_245a5906f4ee24fe4b1a86970a5122ad.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_245a5906f4ee24fe4b1a86970a5122ad.jpg saved to cache
2026-03-27 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fe047b51-72f5-552c-84ed-2f45b2927b3c
2026-03-27 10:35:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0ab290>
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_c7debf8a6a5600c51bcd61bd8fa3bae1.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_c7debf8a6a5600c51bcd61bd8fa3bae1.jpg saved to cache
2026-03-27 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe047b51-72f5-552c-84ed-2f45b2927b3c
2026-03-27 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_544fe4b09e9bb5d3f8df78d0025d6009.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JY33610> (referer: https://www.auto1.com/v1/car-details-view/JY33610/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_99953863bc817a2006f6f067ed261087.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_99953863bc817a2006f6f067ed261087.jpg not downloaded yet
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_62eb294dbd207289c12ec23812505f5c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_62eb294dbd207289c12ec23812505f5c.jpg not downloaded yet
2026-03-27 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV97613> (referer: https://www.auto1.com/v1/car-details-view/YV97613/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT97344/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be08d4d0>
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_7637138f945c88565e9ae70c6a153e57.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_7637138f945c88565e9ae70c6a153e57.jpg saved to cache
2026-03-27 10:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb615a1b-1996-5280-a7b5-0122438e64ae
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3a6390>
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_daab39d075886e529f8f2732d3764acf.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_daab39d075886e529f8f2732d3764acf.jpg saved to cache
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be28ac10>
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_184ced121a0a86623e41ecf238ecde77.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_184ced121a0a86623e41ecf238ecde77.jpg saved to cache
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2dd610>
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_b26fef9353a8bd08ba9a82d4b330584b.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_b26fef9353a8bd08ba9a82d4b330584b.jpg saved to cache
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb615a1b-1996-5280-a7b5-0122438e64ae
2026-03-27 10:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 with identifier: PT90816
2026-03-27 10:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 with scrape type 1
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_6632752ad6e1c885dda5b6d656c30a52.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_6632752ad6e1c885dda5b6d656c30a52.jpg not downloaded yet
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_c3ea63262b88ec9f72a1ac85f23c751b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_c3ea63262b88ec9f72a1ac85f23c751b.jpg not downloaded yet
2026-03-27 10:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_5e0044f5d399fe5144af524b9957f4e8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_c1518000fede7ce43379f3fbd74fc52e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_97b396580617ac8804f25289329cd7b8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_98c3ce4ca5606ba95f50bbed5786e048.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_d96a0f3429086d1a98283e6680ec550e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_d96a0f3429086d1a98283e6680ec550e.jpg not downloaded yet
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be16bd10>
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_544fe4b09e9bb5d3f8df78d0025d6009.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_544fe4b09e9bb5d3f8df78d0025d6009.jpg saved to cache
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-27 10:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 with identifier: JY33610
2026-03-27 10:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 with scrape type 1
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_08353e2976736b66bd7d88206812d2de.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_08353e2976736b66bd7d88206812d2de.jpg not downloaded yet
2026-03-27 10:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1275aaaa-ca9c-5168-85c7-e13a5f66e419 with identifier: YV97613
2026-03-27 10:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1275aaaa-ca9c-5168-85c7-e13a5f66e419 with scrape type 1
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1275aaaa-ca9c-5168-85c7-e13a5f66e419
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_979632791519aaf2b83fedaa708a6a0b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_979632791519aaf2b83fedaa708a6a0b.jpg not downloaded yet
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_7adcc475f2aeeaf91ff659fe7c14a10d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_7adcc475f2aeeaf91ff659fe7c14a10d.jpg not downloaded yet
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_7f8033e477be590d9dceae0ff5cb17f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_7f8033e477be590d9dceae0ff5cb17f7.jpg not downloaded yet
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_df98ea33c4f3138ffa6b02cac0a2eac0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_df98ea33c4f3138ffa6b02cac0a2eac0.jpg not downloaded yet
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2639d0>
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_5e0044f5d399fe5144af524b9957f4e8.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_5e0044f5d399fe5144af524b9957f4e8.jpg saved to cache
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be289910>
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_c1518000fede7ce43379f3fbd74fc52e.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_c1518000fede7ce43379f3fbd74fc52e.jpg saved to cache
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4dc650>
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_97b396580617ac8804f25289329cd7b8.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_97b396580617ac8804f25289329cd7b8.jpg saved to cache
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be10fd10>
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_98c3ce4ca5606ba95f50bbed5786e048.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_98c3ce4ca5606ba95f50bbed5786e048.jpg saved to cache
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb615a1b-1996-5280-a7b5-0122438e64ae
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_c5fc189b9b531c62e61fcabc6a633008.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_c5fc189b9b531c62e61fcabc6a633008.jpg not downloaded yet
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_ccf160f91d04084c7957c696bb135f95.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_ccf160f91d04084c7957c696bb135f95.jpg not downloaded yet
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_a90136c7e5cec820a63dc96b2fe587da.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_a90136c7e5cec820a63dc96b2fe587da.jpg not downloaded yet
2026-03-27 10:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_6632752ad6e1c885dda5b6d656c30a52.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_d47fb783168c0cc7a1d0c32bd7f72d36.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_b2e2c8bf200c0c00e7a63d2ce320b94f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_c26ff4c6ea4056547175b94525d9a003.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_c26ff4c6ea4056547175b94525d9a003.jpg not downloaded yet
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_98eb87872f7f1b955337ac9b71a1d132.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_98eb87872f7f1b955337ac9b71a1d132.jpg not downloaded yet
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_58b0cf7f715edf278f1ac703671bb6c3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_58b0cf7f715edf278f1ac703671bb6c3.jpg not downloaded yet
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_15f0f8131e21a2e2b08e9512f3cf4da7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_15f0f8131e21a2e2b08e9512f3cf4da7.jpg not downloaded yet
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_93c0ea8b461643752837b1ef17752d96.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_93c0ea8b461643752837b1ef17752d96.jpg not downloaded yet
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_bc4172913b5615fbb6f4f169852508d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_bc4172913b5615fbb6f4f169852508d5.jpg not downloaded yet
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_22b4ea8b85237be7dcf8388090c6d38e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_22b4ea8b85237be7dcf8388090c6d38e.jpg not downloaded yet
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_94c77b57124ff13a4251d3bbc432cb8e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_94c77b57124ff13a4251d3bbc432cb8e.jpg not downloaded yet
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_1a5fd51ee6cfa8392f60f01ce372197d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_1a5fd51ee6cfa8392f60f01ce372197d.jpg not downloaded yet
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1f5b10>
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_6632752ad6e1c885dda5b6d656c30a52.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_6632752ad6e1c885dda5b6d656c30a52.jpg saved to cache
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf07b50>
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_d47fb783168c0cc7a1d0c32bd7f72d36.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_d47fb783168c0cc7a1d0c32bd7f72d36.jpg saved to cache
2026-03-27 10:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf571790>
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_b2e2c8bf200c0c00e7a63d2ce320b94f.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_b2e2c8bf200c0c00e7a63d2ce320b94f.jpg saved to cache
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_af44fdf81b7d7e4834a827843ee26659.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_af44fdf81b7d7e4834a827843ee26659.jpg not downloaded yet
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_a2bdac1423c71b2119b67e9e588ae702.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_a2bdac1423c71b2119b67e9e588ae702.jpg not downloaded yet
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_3b858cdba9bec4069ae7e2e39cf2d235.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_3b858cdba9bec4069ae7e2e39cf2d235.jpg not downloaded yet
2026-03-27 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_62eb294dbd207289c12ec23812505f5c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_99953863bc817a2006f6f067ed261087.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_77f4b5bc3c383245d5e6141cfe8474a5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_3539eb8e99d723fa42cd3c2a3e0b1cb8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_3539eb8e99d723fa42cd3c2a3e0b1cb8.jpg not downloaded yet
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_fc4fddedba477c6dd7e4905842fc14ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_fc4fddedba477c6dd7e4905842fc14ae.jpg not downloaded yet
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_88c9145c402ec5da9628938f31494117.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_88c9145c402ec5da9628938f31494117.jpg not downloaded yet
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_f83e3174c396eed03491c6a1a360d972.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_f83e3174c396eed03491c6a1a360d972.jpg not downloaded yet
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_1160da2df03a9c92849ad7ab98b81903.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_1160da2df03a9c92849ad7ab98b81903.jpg not downloaded yet
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_4794530aeeed86e168aa1437def36a84.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_4794530aeeed86e168aa1437def36a84.jpg not downloaded yet
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_74c27b29acc81273540aad35db85b402.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_74c27b29acc81273540aad35db85b402.jpg not downloaded yet
2026-03-27 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_8c0620ce843d2ba3c645486f2830c316.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE37655> (referer: https://www.auto1.com/v1/car-details-view/GE37655/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be23f210>
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_62eb294dbd207289c12ec23812505f5c.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_62eb294dbd207289c12ec23812505f5c.jpg saved to cache
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf65cd0>
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_99953863bc817a2006f6f067ed261087.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_99953863bc817a2006f6f067ed261087.jpg saved to cache
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb615a1b-1996-5280-a7b5-0122438e64ae
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0ad3d0>
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_77f4b5bc3c383245d5e6141cfe8474a5.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_77f4b5bc3c383245d5e6141cfe8474a5.jpg saved to cache
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb615a1b-1996-5280-a7b5-0122438e64ae
2026-03-27 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_df98ea33c4f3138ffa6b02cac0a2eac0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_820895ef06bcd12b5f1c1ffdef563de5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4390d0>
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_8c0620ce843d2ba3c645486f2830c316.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_8c0620ce843d2ba3c645486f2830c316.jpg saved to cache
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53c69dda-dcac-5e57-8e79-44b586e0ef5c
2026-03-27 10:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: badceaec-0e01-5c5e-9127-6ea619c9275e with identifier: GE37655
2026-03-27 10:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item badceaec-0e01-5c5e-9127-6ea619c9275e with scrape type 1
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item badceaec-0e01-5c5e-9127-6ea619c9275e
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_17dc23a5f327f02fdbd35ed0f1f4c053.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_17dc23a5f327f02fdbd35ed0f1f4c053.jpg not downloaded yet
2026-03-27 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZU85888> (referer: https://www.auto1.com/v1/car-details-view/ZU85888/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_16ba78161dee48b0695855499e33ab87.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_16ba78161dee48b0695855499e33ab87.jpg not downloaded yet
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_0d66212e85a9bb5b44e7868ca034b539.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_0d66212e85a9bb5b44e7868ca034b539.jpg not downloaded yet
2026-03-27 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_3d431a97dbad3e69e7eb0cd2dfea0dd5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_13cdcf639e764f397da128440d62c713.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_13cdcf639e764f397da128440d62c713.jpg not downloaded yet
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf38a310>
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_df98ea33c4f3138ffa6b02cac0a2eac0.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_df98ea33c4f3138ffa6b02cac0a2eac0.jpg saved to cache
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1275aaaa-ca9c-5168-85c7-e13a5f66e419
2026-03-27 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_90b412e3a516be32a44085f080209862.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_a90136c7e5cec820a63dc96b2fe587da.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_d8dc21b24603b6e4ca36e02b416eff3e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_d8dc21b24603b6e4ca36e02b416eff3e.jpg not downloaded yet
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5513450>
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_820895ef06bcd12b5f1c1ffdef563de5.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_820895ef06bcd12b5f1c1ffdef563de5.jpg saved to cache
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb615a1b-1996-5280-a7b5-0122438e64ae
2026-03-27 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_ccf160f91d04084c7957c696bb135f95.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_92c68a566e8e7981e42d057d23e0ab5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_92c68a566e8e7981e42d057d23e0ab5b.jpg not downloaded yet
2026-03-27 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_41d301983fb3a7feef105bce97e8d3ba.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_159158611014d245f9af0a6b369adcea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_3b858cdba9bec4069ae7e2e39cf2d235.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0f1b08f-2561-5fb0-886a-0e49d3d43b97 with identifier: ZU85888
2026-03-27 10:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0f1b08f-2561-5fb0-886a-0e49d3d43b97 with scrape type 1
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0f1b08f-2561-5fb0-886a-0e49d3d43b97
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff7%252F39f773e7e9853b6779ace1afd073d538%252Fpa%252FZU85888_f10c05ef2e3faf710dfdcc7d2276fdbd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_f10c05ef2e3faf710dfdcc7d2276fdbd.jpg already downloaded
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff7%252F39f773e7e9853b6779ace1afd073d538%252Fpa%252FZU85888_25a88fc9b835778a60ee0fcf9a558de3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_25a88fc9b835778a60ee0fcf9a558de3.jpg already downloaded
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff7%252F39f773e7e9853b6779ace1afd073d538%252Fpa%252FZU85888_57d3dd983807e6bd39b48b88aaac534f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_57d3dd983807e6bd39b48b88aaac534f.jpg already downloaded
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff7%252F39f773e7e9853b6779ace1afd073d538%252Fpa%252FZU85888_a4d4535490ba1e5f25678378f88be6d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_a4d4535490ba1e5f25678378f88be6d5.jpg already downloaded
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff7%252F39f773e7e9853b6779ace1afd073d538%252Fpa%252FZU85888_a91d2c1c67cb64f523a5a4655a8a3b2b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_a91d2c1c67cb64f523a5a4655a8a3b2b.jpg already downloaded
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff7%252F39f773e7e9853b6779ace1afd073d538%252Fpa%252FZU85888_6e9795ee045e603309b4c39f01ea7907.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_6e9795ee045e603309b4c39f01ea7907.jpg already downloaded
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff7%252F39f773e7e9853b6779ace1afd073d538%252Fpa%252FZU85888_b4049cf533466f4783f96e3fac37e77c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_b4049cf533466f4783f96e3fac37e77c.jpg already downloaded
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff7%252F39f773e7e9853b6779ace1afd073d538%252Fpa%252FZU85888_7393cedeffd6ff33e87e6e0f23515d0e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_7393cedeffd6ff33e87e6e0f23515d0e.jpg already downloaded
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff7%252F39f773e7e9853b6779ace1afd073d538%252Fpa%252FZU85888_120c6ad439033a466b679ee7f8cb1b81.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_120c6ad439033a466b679ee7f8cb1b81.jpg already downloaded
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Ff7%252F39f773e7e9853b6779ace1afd073d538%252Fpa%252FZU85888_111243d4e656c9ea05ffa8794706fe6a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_111243d4e656c9ea05ffa8794706fe6a.jpg already downloaded
2026-03-27 10:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0f1b08f-2561-5fb0-886a-0e49d3d43b97, identifier: ZU85888
2026-03-27 10:35:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf43df10>
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_3d431a97dbad3e69e7eb0cd2dfea0dd5.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_3d431a97dbad3e69e7eb0cd2dfea0dd5.jpg saved to cache
2026-03-27 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb615a1b-1996-5280-a7b5-0122438e64ae
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_5fa7e5c9c6ed9e77e5fbe76032d4f419.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_5fa7e5c9c6ed9e77e5fbe76032d4f419.jpg not downloaded yet
2026-03-27 10:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0f1b08f-2561-5fb0-886a-0e49d3d43b97 with identifier: ZU85888
2026-03-27 10:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0f1b08f-2561-5fb0-886a-0e49d3d43b97 with identifier: ZU85888
2026-03-27 10:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0f1b08f-2561-5fb0-886a-0e49d3d43b97 with identifier: ZU85888 to the API
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZU85888>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.3L',
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:06:05Z',
'fuel_type': 'petrol',
'id': 'd0f1b08f-2561-5fb0-886a-0e49d3d43b97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU85888',
'listing': 'auction',
'location': 'DE, Schkopau (OT Rassnitz)',
'make': 'Honda',
'model': 'Jazz',
'odometer': 101609,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_f10c05ef2e3faf710dfdcc7d2276fdbd.jpg',
'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_25a88fc9b835778a60ee0fcf9a558de3.jpg',
'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_57d3dd983807e6bd39b48b88aaac534f.jpg',
'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_a4d4535490ba1e5f25678378f88be6d5.jpg',
'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_a91d2c1c67cb64f523a5a4655a8a3b2b.jpg',
'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_6e9795ee045e603309b4c39f01ea7907.jpg',
'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_b4049cf533466f4783f96e3fac37e77c.jpg',
'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_7393cedeffd6ff33e87e6e0f23515d0e.jpg',
'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_120c6ad439033a466b679ee7f8cb1b81.jpg',
'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_111243d4e656c9ea05ffa8794706fe6a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f1b08f-2561-5fb0-886a-0e49d3d43b97/d0f1b08f-2561-5fb0-886a-0e49d3d43b97_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70377,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_f10c05ef2e3faf710dfdcc7d2276fdbd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f1b08f-2561-5fb0-886a-0e49d3d43b97/d0f1b08f-2561-5fb0-886a-0e49d3d43b97_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65993,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_25a88fc9b835778a60ee0fcf9a558de3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f1b08f-2561-5fb0-886a-0e49d3d43b97/d0f1b08f-2561-5fb0-886a-0e49d3d43b97_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2266343,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_57d3dd983807e6bd39b48b88aaac534f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f1b08f-2561-5fb0-886a-0e49d3d43b97/d0f1b08f-2561-5fb0-886a-0e49d3d43b97_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56854,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_a4d4535490ba1e5f25678378f88be6d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f1b08f-2561-5fb0-886a-0e49d3d43b97/d0f1b08f-2561-5fb0-886a-0e49d3d43b97_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56915,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_a91d2c1c67cb64f523a5a4655a8a3b2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f1b08f-2561-5fb0-886a-0e49d3d43b97/d0f1b08f-2561-5fb0-886a-0e49d3d43b97_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66268,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_6e9795ee045e603309b4c39f01ea7907.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f1b08f-2561-5fb0-886a-0e49d3d43b97/d0f1b08f-2561-5fb0-886a-0e49d3d43b97_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60723,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_b4049cf533466f4783f96e3fac37e77c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f1b08f-2561-5fb0-886a-0e49d3d43b97/d0f1b08f-2561-5fb0-886a-0e49d3d43b97_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70231,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_7393cedeffd6ff33e87e6e0f23515d0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f1b08f-2561-5fb0-886a-0e49d3d43b97/d0f1b08f-2561-5fb0-886a-0e49d3d43b97_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_120c6ad439033a466b679ee7f8cb1b81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f1b08f-2561-5fb0-886a-0e49d3d43b97/d0f1b08f-2561-5fb0-886a-0e49d3d43b97_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75021,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/f7/39f773e7e9853b6779ace1afd073d538/pa/ZU85888_111243d4e656c9ea05ffa8794706fe6a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-10-23',
'seats_number': 5,
'seller_name': None,
'title': 'Honda Jazz 1.4 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2013}
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU85888%27 HTTP/1.1" 200 None
2026-03-27 10:35:03 [auto1.de] INFO: Saving data for ZU85888: {'created_time': 1774607703.654761, 'last_price_update_time': 1774607703.654772, 'auction_closing_time': 1774713965.0}
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU85888') HTTP/1.1" 204 0
2026-03-27 10:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_74c27b29acc81273540aad35db85b402.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_4794530aeeed86e168aa1437def36a84.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_a4a9b1c23877211d29da081973d77a5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_a4a9b1c23877211d29da081973d77a5b.jpg not downloaded yet
2026-03-27 10:35:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5654150>
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_90b412e3a516be32a44085f080209862.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_90b412e3a516be32a44085f080209862.jpg saved to cache
2026-03-27 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53c69dda-dcac-5e57-8e79-44b586e0ef5c
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf3e590>
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_a90136c7e5cec820a63dc96b2fe587da.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_a90136c7e5cec820a63dc96b2fe587da.jpg saved to cache
2026-03-27 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1275aaaa-ca9c-5168-85c7-e13a5f66e419
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c564bc90>
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_ccf160f91d04084c7957c696bb135f95.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_ccf160f91d04084c7957c696bb135f95.jpg saved to cache
2026-03-27 10:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51
2026-03-27 10:35:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4f9f10>
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_41d301983fb3a7feef105bce97e8d3ba.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_41d301983fb3a7feef105bce97e8d3ba.jpg saved to cache
2026-03-27 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53c69dda-dcac-5e57-8e79-44b586e0ef5c
2026-03-27 10:35:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f6c90>
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_159158611014d245f9af0a6b369adcea.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_159158611014d245f9af0a6b369adcea.jpg saved to cache
2026-03-27 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb615a1b-1996-5280-a7b5-0122438e64ae
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b1d50>
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_3b858cdba9bec4069ae7e2e39cf2d235.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_3b858cdba9bec4069ae7e2e39cf2d235.jpg saved to cache
2026-03-27 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1275aaaa-ca9c-5168-85c7-e13a5f66e419
2026-03-27 10:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_17dc23a5f327f02fdbd35ed0f1f4c053.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_a1dad940768a825c801cf77cb586b3a1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_3105f5ce98ac1a184a59d40a0d3af533.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_3105f5ce98ac1a184a59d40a0d3af533.jpg not downloaded yet
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_687615adcd02341c841a24914df6a8ff.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_687615adcd02341c841a24914df6a8ff.jpg not downloaded yet
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf38e0d0>
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_74c27b29acc81273540aad35db85b402.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_74c27b29acc81273540aad35db85b402.jpg saved to cache
2026-03-27 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1275aaaa-ca9c-5168-85c7-e13a5f66e419
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf26d90>
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_4794530aeeed86e168aa1437def36a84.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_4794530aeeed86e168aa1437def36a84.jpg saved to cache
2026-03-27 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf05290>
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_17dc23a5f327f02fdbd35ed0f1f4c053.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_17dc23a5f327f02fdbd35ed0f1f4c053.jpg saved to cache
2026-03-27 10:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item badceaec-0e01-5c5e-9127-6ea619c9275e
2026-03-27 10:35:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf386d50>
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_a1dad940768a825c801cf77cb586b3a1.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_a1dad940768a825c801cf77cb586b3a1.jpg saved to cache
2026-03-27 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb615a1b-1996-5280-a7b5-0122438e64ae
2026-03-27 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_5fa7e5c9c6ed9e77e5fbe76032d4f419.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_0d66212e85a9bb5b44e7868ca034b539.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_a4a9b1c23877211d29da081973d77a5b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_a2bdac1423c71b2119b67e9e588ae702.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_af44fdf81b7d7e4834a827843ee26659.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_1160da2df03a9c92849ad7ab98b81903.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_f83e3174c396eed03491c6a1a360d972.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_92c68a566e8e7981e42d057d23e0ab5b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3df150>
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_5fa7e5c9c6ed9e77e5fbe76032d4f419.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_5fa7e5c9c6ed9e77e5fbe76032d4f419.jpg saved to cache
2026-03-27 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item badceaec-0e01-5c5e-9127-6ea619c9275e
2026-03-27 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_3539eb8e99d723fa42cd3c2a3e0b1cb8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_13cdcf639e764f397da128440d62c713.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_d8dc21b24603b6e4ca36e02b416eff3e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3c4090>
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_0d66212e85a9bb5b44e7868ca034b539.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_0d66212e85a9bb5b44e7868ca034b539.jpg saved to cache
2026-03-27 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item badceaec-0e01-5c5e-9127-6ea619c9275e
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c55114d0>
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_a4a9b1c23877211d29da081973d77a5b.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_a4a9b1c23877211d29da081973d77a5b.jpg saved to cache
2026-03-27 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item badceaec-0e01-5c5e-9127-6ea619c9275e
2026-03-27 10:35:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be114cd0>
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_a2bdac1423c71b2119b67e9e588ae702.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_a2bdac1423c71b2119b67e9e588ae702.jpg saved to cache
2026-03-27 10:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51
2026-03-27 10:35:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5511d10>
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_af44fdf81b7d7e4834a827843ee26659.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_af44fdf81b7d7e4834a827843ee26659.jpg saved to cache
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923
2026-03-27 10:35:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf44d390>
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_1160da2df03a9c92849ad7ab98b81903.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_1160da2df03a9c92849ad7ab98b81903.jpg saved to cache
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1275aaaa-ca9c-5168-85c7-e13a5f66e419
2026-03-27 10:35:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4e9910>
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_f83e3174c396eed03491c6a1a360d972.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_f83e3174c396eed03491c6a1a360d972.jpg saved to cache
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51
2026-03-27 10:35:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c57ec190>
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_92c68a566e8e7981e42d057d23e0ab5b.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_92c68a566e8e7981e42d057d23e0ab5b.jpg saved to cache
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item badceaec-0e01-5c5e-9127-6ea619c9275e
2026-03-27 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_16ba78161dee48b0695855499e33ab87.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf559a10>
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_3539eb8e99d723fa42cd3c2a3e0b1cb8.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_3539eb8e99d723fa42cd3c2a3e0b1cb8.jpg saved to cache
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e8110>
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_13cdcf639e764f397da128440d62c713.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_13cdcf639e764f397da128440d62c713.jpg saved to cache
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item badceaec-0e01-5c5e-9127-6ea619c9275e
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be208910>
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_d8dc21b24603b6e4ca36e02b416eff3e.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_d8dc21b24603b6e4ca36e02b416eff3e.jpg saved to cache
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item badceaec-0e01-5c5e-9127-6ea619c9275e
2026-03-27 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_94c77b57124ff13a4251d3bbc432cb8e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be29ca50>
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_16ba78161dee48b0695855499e33ab87.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_16ba78161dee48b0695855499e33ab87.jpg saved to cache
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item badceaec-0e01-5c5e-9127-6ea619c9275e
2026-03-27 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_1a5fd51ee6cfa8392f60f01ce372197d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_687615adcd02341c841a24914df6a8ff.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_88c9145c402ec5da9628938f31494117.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_fc4fddedba477c6dd7e4905842fc14ae.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf64250>
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_94c77b57124ff13a4251d3bbc432cb8e.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_94c77b57124ff13a4251d3bbc432cb8e.jpg saved to cache
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51
2026-03-27 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_3105f5ce98ac1a184a59d40a0d3af533.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_93c0ea8b461643752837b1ef17752d96.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_bc4172913b5615fbb6f4f169852508d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be167a90>
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_1a5fd51ee6cfa8392f60f01ce372197d.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_1a5fd51ee6cfa8392f60f01ce372197d.jpg saved to cache
2026-03-27 10:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1275aaaa-ca9c-5168-85c7-e13a5f66e419
2026-03-27 10:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_22b4ea8b85237be7dcf8388090c6d38e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf42e9d0>
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_687615adcd02341c841a24914df6a8ff.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_687615adcd02341c841a24914df6a8ff.jpg saved to cache
2026-03-27 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item badceaec-0e01-5c5e-9127-6ea619c9275e
2026-03-27 10:35:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1ef8d0>
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_88c9145c402ec5da9628938f31494117.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_88c9145c402ec5da9628938f31494117.jpg saved to cache
2026-03-27 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1275aaaa-ca9c-5168-85c7-e13a5f66e419
2026-03-27 10:35:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1d3f90>
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_fc4fddedba477c6dd7e4905842fc14ae.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_fc4fddedba477c6dd7e4905842fc14ae.jpg saved to cache
2026-03-27 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51
2026-03-27 10:35:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2ec8d0>
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F99%252F5899e6cee0b50ca833c3515b53a1eb2f%252Fpa%252FGE37655_3105f5ce98ac1a184a59d40a0d3af533.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_3105f5ce98ac1a184a59d40a0d3af533.jpg saved to cache
2026-03-27 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item badceaec-0e01-5c5e-9127-6ea619c9275e
2026-03-27 10:35:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: badceaec-0e01-5c5e-9127-6ea619c9275e, skipping ID generation
2026-03-27 10:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item badceaec-0e01-5c5e-9127-6ea619c9275e with scrape type 1
2026-03-27 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item badceaec-0e01-5c5e-9127-6ea619c9275e sending to next pipeline
2026-03-27 10:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: badceaec-0e01-5c5e-9127-6ea619c9275e, identifier: GE37655
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1b3c90>
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_93c0ea8b461643752837b1ef17752d96.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_93c0ea8b461643752837b1ef17752d96.jpg saved to cache
2026-03-27 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be01a0d0>
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_bc4172913b5615fbb6f4f169852508d5.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_bc4172913b5615fbb6f4f169852508d5.jpg saved to cache
2026-03-27 10:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1275aaaa-ca9c-5168-85c7-e13a5f66e419
2026-03-27 10:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: badceaec-0e01-5c5e-9127-6ea619c9275e with identifier: GE37655
2026-03-27 10:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: badceaec-0e01-5c5e-9127-6ea619c9275e with identifier: GE37655
2026-03-27 10:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: badceaec-0e01-5c5e-9127-6ea619c9275e with identifier: GE37655 to the API
2026-03-27 10:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_3105f5ce98ac1a184a59d40a0d3af533.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:36:16Z',
'fuel_type': 'petrol',
'id': 'badceaec-0e01-5c5e-9127-6ea619c9275e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE37655',
'listing': 'auction',
'location': 'DE, Tradein',
'make': 'Opel',
'model': 'Mokka',
'odometer': 131003,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78356,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_17dc23a5f327f02fdbd35ed0f1f4c053.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_16ba78161dee48b0695855499e33ab87.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_0d66212e85a9bb5b44e7868ca034b539.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62060,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_13cdcf639e764f397da128440d62c713.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_d8dc21b24603b6e4ca36e02b416eff3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2545781,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_92c68a566e8e7981e42d057d23e0ab5b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61857,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_5fa7e5c9c6ed9e77e5fbe76032d4f419.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_a4a9b1c23877211d29da081973d77a5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2753134,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_3105f5ce98ac1a184a59d40a0d3af533.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badceaec-0e01-5c5e-9127-6ea619c9275e/badceaec-0e01-5c5e-9127-6ea619c9275e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2399901,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img58/99/5899e6cee0b50ca833c3515b53a1eb2f/pa/GE37655_687615adcd02341c841a24914df6a8ff.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-10-15',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex 4x4',
'transmission': 'manual',
'trim': 'Innovation ecoFlex 4x4',
'year': 2014}
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE37655%27 HTTP/1.1" 200 None
2026-03-27 10:35:08 [auto1.de] INFO: Saving data for GE37655: {'created_time': 1774607708.263554, 'last_price_update_time': 1774607708.263567, 'auction_closing_time': 1774715776.0}
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE37655') HTTP/1.1" 204 0
2026-03-27 10:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_7f8033e477be590d9dceae0ff5cb17f7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_7adcc475f2aeeaf91ff659fe7c14a10d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:08 [scrapy.extensions.logstats] INFO: Crawled 175 pages (at 75 pages/min), scraped 100 items (at 49 items/min)
2026-03-27 10:35:08 [scrapy.extensions.memusage] INFO: Peak memory usage is 189MiB
2026-03-27 10:35:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf0db10>
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_22b4ea8b85237be7dcf8388090c6d38e.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_22b4ea8b85237be7dcf8388090c6d38e.jpg saved to cache
2026-03-27 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923
2026-03-27 10:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_c26ff4c6ea4056547175b94525d9a003.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_98eb87872f7f1b955337ac9b71a1d132.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_08353e2976736b66bd7d88206812d2de.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_979632791519aaf2b83fedaa708a6a0b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_58b0cf7f715edf278f1ac703671bb6c3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_15f0f8131e21a2e2b08e9512f3cf4da7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_c5fc189b9b531c62e61fcabc6a633008.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf58b810>
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_7f8033e477be590d9dceae0ff5cb17f7.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_7f8033e477be590d9dceae0ff5cb17f7.jpg saved to cache
2026-03-27 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51
2026-03-27 10:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_d96a0f3429086d1a98283e6680ec550e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b1e90>
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_7adcc475f2aeeaf91ff659fe7c14a10d.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_7adcc475f2aeeaf91ff659fe7c14a10d.jpg saved to cache
2026-03-27 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923
2026-03-27 10:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_65a0c88dc9e443f0306a94101478f581.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf379d50>
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_c26ff4c6ea4056547175b94525d9a003.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_c26ff4c6ea4056547175b94525d9a003.jpg saved to cache
2026-03-27 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923
2026-03-27 10:35:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2cd750>
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_98eb87872f7f1b955337ac9b71a1d132.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_98eb87872f7f1b955337ac9b71a1d132.jpg saved to cache
2026-03-27 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf5ae10>
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F84%252Fdd847307c686c1a27dbbf99b6b46a162%252Fpa%252FJY33610_08353e2976736b66bd7d88206812d2de.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_08353e2976736b66bd7d88206812d2de.jpg saved to cache
2026-03-27 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51
2026-03-27 10:35:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51, skipping ID generation
2026-03-27 10:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 with scrape type 1
2026-03-27 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 sending to next pipeline
2026-03-27 10:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51, identifier: JY33610
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf0d550>
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_979632791519aaf2b83fedaa708a6a0b.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_979632791519aaf2b83fedaa708a6a0b.jpg saved to cache
2026-03-27 10:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1275aaaa-ca9c-5168-85c7-e13a5f66e419
2026-03-27 10:35:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1d7a10>
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b5b10fd4405cc0219408fca11413aa%252Fpa%252FYV97613_58b0cf7f715edf278f1ac703671bb6c3.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_58b0cf7f715edf278f1ac703671bb6c3.jpg saved to cache
2026-03-27 10:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1275aaaa-ca9c-5168-85c7-e13a5f66e419
2026-03-27 10:35:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1275aaaa-ca9c-5168-85c7-e13a5f66e419, skipping ID generation
2026-03-27 10:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1275aaaa-ca9c-5168-85c7-e13a5f66e419 with scrape type 1
2026-03-27 10:35:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1275aaaa-ca9c-5168-85c7-e13a5f66e419 sending to next pipeline
2026-03-27 10:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1275aaaa-ca9c-5168-85c7-e13a5f66e419, identifier: YV97613
2026-03-27 10:35:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be020710>
2026-03-27 10:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_15f0f8131e21a2e2b08e9512f3cf4da7.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_15f0f8131e21a2e2b08e9512f3cf4da7.jpg saved to cache
2026-03-27 10:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923
2026-03-27 10:35:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0ac2d0>
2026-03-27 10:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_c5fc189b9b531c62e61fcabc6a633008.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_c5fc189b9b531c62e61fcabc6a633008.jpg saved to cache
2026-03-27 10:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923
2026-03-27 10:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 with identifier: JY33610
2026-03-27 10:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 with identifier: JY33610
2026-03-27 10:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51 with identifier: JY33610 to the API
2026-03-27 10:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_08353e2976736b66bd7d88206812d2de.jpg>
{'auction_title': '',
'c_o_2_emission_value': 267,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 199,
'expiration_date': '2026-03-28T16:33:21Z',
'fuel_type': 'diesel',
'id': 'b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY33610',
'listing': 'auction',
'location': 'DE, Trier',
'make': 'Volkswagen',
'model': 'T6 California',
'odometer': 101289,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_08353e2976736b66bd7d88206812d2de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68486,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_7f8033e477be590d9dceae0ff5cb17f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67205,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_ccf160f91d04084c7957c696bb135f95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2603421,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_98eb87872f7f1b955337ac9b71a1d132.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59413,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_93c0ea8b461643752837b1ef17752d96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_94c77b57124ff13a4251d3bbc432cb8e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2768263,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_a2bdac1423c71b2119b67e9e588ae702.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2801699,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_fc4fddedba477c6dd7e4905842fc14ae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3063738,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_f83e3174c396eed03491c6a1a360d972.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51/b3e7e7c0-47a7-5fa2-94c1-1dc86efafa51_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/84/dd847307c686c1a27dbbf99b6b46a162/pa/JY33610_4794530aeeed86e168aa1437def36a84.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-24',
'seats_number': 4,
'seller_name': None,
'title': 'Volkswagen T6 California 2.0 TDI Ocean Edition 4Motion',
'transmission': 'automatic',
'trim': 'Ocean Edition 4Motion',
'year': 2020}
2026-03-27 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY33610%27 HTTP/1.1" 200 None
2026-03-27 10:35:09 [auto1.de] INFO: Saving data for JY33610: {'created_time': 1774607709.888909, 'last_price_update_time': 1774607709.888921, 'auction_closing_time': 1774715601.0}
2026-03-27 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY33610') HTTP/1.1" 204 0
2026-03-27 10:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1275aaaa-ca9c-5168-85c7-e13a5f66e419 with identifier: YV97613
2026-03-27 10:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1275aaaa-ca9c-5168-85c7-e13a5f66e419 with identifier: YV97613
2026-03-27 10:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1275aaaa-ca9c-5168-85c7-e13a5f66e419 with identifier: YV97613 to the API
2026-03-27 10:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_58b0cf7f715edf278f1ac703671bb6c3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 203,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.2L',
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:07:50Z',
'fuel_type': 'diesel',
'id': '1275aaaa-ca9c-5168-85c7-e13a5f66e419',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV97613',
'listing': 'auction',
'location': 'DE, Bretzenheim',
'make': 'Chevrolet',
'model': 'Captiva',
'odometer': 162873,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_979632791519aaf2b83fedaa708a6a0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63588,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_df98ea33c4f3138ffa6b02cac0a2eac0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54622,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_a90136c7e5cec820a63dc96b2fe587da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2511336,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_58b0cf7f715edf278f1ac703671bb6c3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67533,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_bc4172913b5615fbb6f4f169852508d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2120981,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_1a5fd51ee6cfa8392f60f01ce372197d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67789,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_3b858cdba9bec4069ae7e2e39cf2d235.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2275153,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_88c9145c402ec5da9628938f31494117.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2802158,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_1160da2df03a9c92849ad7ab98b81903.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1275aaaa-ca9c-5168-85c7-e13a5f66e419/1275aaaa-ca9c-5168-85c7-e13a5f66e419_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76583,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b5b10fd4405cc0219408fca11413aa/pa/YV97613_74c27b29acc81273540aad35db85b402.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-11-28',
'seats_number': 7,
'seller_name': None,
'title': 'Chevrolet Captiva 2.2 Diesel D LTZ 4WD',
'transmission': 'automatic',
'trim': 'D LTZ 4WD',
'year': 2011}
2026-03-27 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV97613%27 HTTP/1.1" 200 None
2026-03-27 10:35:10 [auto1.de] INFO: Saving data for YV97613: {'created_time': 1774607710.286563, 'last_price_update_time': 1774607710.286576, 'auction_closing_time': 1774714070.0}
2026-03-27 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV97613') HTTP/1.1" 204 0
2026-03-27 10:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_aa9f3a13e842e128cf4b8afc1cf2e582.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT97344> (referer: https://www.auto1.com/v1/car-details-view/JT97344/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0e2250>
2026-03-27 10:35:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_d96a0f3429086d1a98283e6680ec550e.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_d96a0f3429086d1a98283e6680ec550e.jpg saved to cache
2026-03-27 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923
2026-03-27 10:35:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5719450>
2026-03-27 10:35:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F72%252F1b7241c2c55c6ce67af1b599edc91acd%252Fpa%252FPA36365_65a0c88dc9e443f0306a94101478f581.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_65a0c88dc9e443f0306a94101478f581.jpg saved to cache
2026-03-27 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 975e6ac5-250d-5bb6-8ecf-3308799273a7
2026-03-27 10:35:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 975e6ac5-250d-5bb6-8ecf-3308799273a7, skipping ID generation
2026-03-27 10:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 975e6ac5-250d-5bb6-8ecf-3308799273a7 with scrape type 1
2026-03-27 10:35:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 975e6ac5-250d-5bb6-8ecf-3308799273a7 sending to next pipeline
2026-03-27 10:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 975e6ac5-250d-5bb6-8ecf-3308799273a7, identifier: PA36365
2026-03-27 10:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: PA36365
2026-03-27 10:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:35:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-27 10:35:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: PA36365
2026-03-27 10:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: PA36365 to the API
2026-03-27 10:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_65a0c88dc9e443f0306a94101478f581.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'engine_horse_power': 65,
'expiration_date': '2026-03-28T16:26:42Z',
'fuel_type': 'electro',
'id': '975e6ac5-250d-5bb6-8ecf-3308799273a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA36365',
'listing': 'auction',
'location': 'DE',
'make': 'Dacia',
'model': 'Spring',
'odometer': 9,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118365,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_65a0c88dc9e443f0306a94101478f581.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_c1518000fede7ce43379f3fbd74fc52e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118275,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_184ced121a0a86623e41ecf238ecde77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130128,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_544fe4b09e9bb5d3f8df78d0025d6009.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_daab39d075886e529f8f2732d3764acf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_d47fb783168c0cc7a1d0c32bd7f72d36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_97b396580617ac8804f25289329cd7b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112127,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_5e0044f5d399fe5144af524b9957f4e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80523,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_b2e2c8bf200c0c00e7a63d2ce320b94f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_975e6ac5-250d-5bb6-8ecf-3308799273a7/975e6ac5-250d-5bb6-8ecf-3308799273a7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/72/1b7241c2c55c6ce67af1b599edc91acd/pa/PA36365_62eb294dbd207289c12ec23812505f5c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2025-12-18',
'seats_number': 4,
'seller_name': None,
'title': 'Dacia Spring electric drive 48 kW Extreme',
'transmission': 'automatic',
'trim': 'Extreme',
'year': 2025}
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA36365%27 HTTP/1.1" 200 None
2026-03-27 10:35:11 [auto1.de] INFO: Saving data for PA36365: {'created_time': 1774607711.25831, 'last_price_update_time': 1774607711.258323, 'auction_closing_time': 1774715202.0}
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA36365') HTTP/1.1" 204 0
2026-03-27 10:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_5cd2322444577a98dc76e3795a7c0222.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_56f9872a8c7101456ed2dc536c28b3d0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB33034> (referer: https://www.auto1.com/v1/car-details-view/BB33034/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN48826> (referer: https://www.auto1.com/v1/car-details-view/BN48826/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR18629> (referer: https://www.auto1.com/v1/car-details-view/LR18629/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_fc24ad881ab98d8ea30b75010213982c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0e3090>
2026-03-27 10:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa805c22472d573d901642865385be%252Fpa%252FKC35382_aa9f3a13e842e128cf4b8afc1cf2e582.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_aa9f3a13e842e128cf4b8afc1cf2e582.jpg saved to cache
2026-03-27 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb615a1b-1996-5280-a7b5-0122438e64ae
2026-03-27 10:35:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb615a1b-1996-5280-a7b5-0122438e64ae, skipping ID generation
2026-03-27 10:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb615a1b-1996-5280-a7b5-0122438e64ae with scrape type 1
2026-03-27 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb615a1b-1996-5280-a7b5-0122438e64ae sending to next pipeline
2026-03-27 10:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb615a1b-1996-5280-a7b5-0122438e64ae, identifier: KC35382
2026-03-27 10:35:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 with identifier: JT97344
2026-03-27 10:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 with scrape type 1
2026-03-27 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_36457e8daf0a3d1e5e9a7c1c937fb7a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_36457e8daf0a3d1e5e9a7c1c937fb7a0.jpg not downloaded yet
2026-03-27 10:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb615a1b-1996-5280-a7b5-0122438e64ae with identifier: KC35382
2026-03-27 10:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb615a1b-1996-5280-a7b5-0122438e64ae with identifier: KC35382
2026-03-27 10:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb615a1b-1996-5280-a7b5-0122438e64ae with identifier: KC35382 to the API
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_aa9f3a13e842e128cf4b8afc1cf2e582.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.2L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:56:51Z',
'fuel_type': 'diesel',
'id': 'cb615a1b-1996-5280-a7b5-0122438e64ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC35382',
'listing': 'auction',
'location': 'DE, Höxter',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 202577,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69740,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_aa9f3a13e842e128cf4b8afc1cf2e582.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2503414,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_159158611014d245f9af0a6b369adcea.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2528088,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_3d431a97dbad3e69e7eb0cd2dfea0dd5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_7637138f945c88565e9ae70c6a153e57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65645,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_b26fef9353a8bd08ba9a82d4b330584b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_820895ef06bcd12b5f1c1ffdef563de5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2547421,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_a1dad940768a825c801cf77cb586b3a1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_98c3ce4ca5606ba95f50bbed5786e048.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_77f4b5bc3c383245d5e6141cfe8474a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb615a1b-1996-5280-a7b5-0122438e64ae/cb615a1b-1996-5280-a7b5-0122438e64ae_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa805c22472d573d901642865385be/pa/KC35382_99953863bc817a2006f6f067ed261087.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-04-12',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line 2WD',
'transmission': 'manual',
'trim': 'Exclusive-Line 2WD',
'year': 2016}
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC35382%27 HTTP/1.1" 200 None
2026-03-27 10:35:11 [auto1.de] INFO: Saving data for KC35382: {'created_time': 1774607711.85655, 'last_price_update_time': 1774607711.856562, 'auction_closing_time': 1774717011.0}
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC35382') HTTP/1.1" 204 0
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_f000024b3a69d63575d8f8117c72779d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_f000024b3a69d63575d8f8117c72779d.jpg not downloaded yet
2026-03-27 10:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_6a34b10722f3a0664d2151822363a1a0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_78a363d97ea2487175d1c04427ddb4dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_6bcc0aa6cc05f5f6fc551196899e486e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_7ffa70023087471f54611279297d607d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_7ffa70023087471f54611279297d607d.jpg not downloaded yet
2026-03-27 10:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf31bb10>
2026-03-27 10:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_5cd2322444577a98dc76e3795a7c0222.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_5cd2322444577a98dc76e3795a7c0222.jpg saved to cache
2026-03-27 10:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0e5d654-c934-59e0-8631-c7e648c17b03
2026-03-27 10:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf41f050>
2026-03-27 10:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_56f9872a8c7101456ed2dc536c28b3d0.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_56f9872a8c7101456ed2dc536c28b3d0.jpg saved to cache
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53c69dda-dcac-5e57-8e79-44b586e0ef5c
2026-03-27 10:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b641efa-2fe5-5e81-b564-e66e5de30046 with identifier: BB33034
2026-03-27 10:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b641efa-2fe5-5e81-b564-e66e5de30046 with scrape type 1
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1b641efa-2fe5-5e81-b564-e66e5de30046
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F3e%252F4b3e8088da16c5d3fd2b661861b94185%252Fpa%252FBB33034_249005484bab634ddc42350650934e34.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_249005484bab634ddc42350650934e34.jpg not downloaded yet
2026-03-27 10:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d2072bb-abe0-5396-9d15-155b7e92c1c6 with identifier: BN48826
2026-03-27 10:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2072bb-abe0-5396-9d15-155b7e92c1c6 with scrape type 1
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3d2072bb-abe0-5396-9d15-155b7e92c1c6
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe2%252F71e29885604877d8fccfca5d6e2bbbc4%252Fpa%252FBN48826_42290d85a6ca84737ec849b4215ddf80.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_42290d85a6ca84737ec849b4215ddf80.jpg not downloaded yet
2026-03-27 10:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83334a2b-1f01-51c3-aadc-43ee3bbe70e6 with identifier: LR18629
2026-03-27 10:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83334a2b-1f01-51c3-aadc-43ee3bbe70e6 with scrape type 1
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 83334a2b-1f01-51c3-aadc-43ee3bbe70e6
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fb2%252F46b25a4c9e4b974034bc37c974523260%252Fpa%252FLR18629_c81a37a41c70033cca59bc05c2278943.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_c81a37a41c70033cca59bc05c2278943.jpg not downloaded yet
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf389190>
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_fc24ad881ab98d8ea30b75010213982c.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_fc24ad881ab98d8ea30b75010213982c.jpg saved to cache
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53c69dda-dcac-5e57-8e79-44b586e0ef5c
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_ac551a78ae369c782cf266af6ffbd329.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_ac551a78ae369c782cf266af6ffbd329.jpg not downloaded yet
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F3e%252F4b3e8088da16c5d3fd2b661861b94185%252Fpa%252FBB33034_0d4ae1481cb3c4f1dbb37347a931ce03.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_0d4ae1481cb3c4f1dbb37347a931ce03.jpg not downloaded yet
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe2%252F71e29885604877d8fccfca5d6e2bbbc4%252Fpa%252FBN48826_8ab50d986f5ae81e5a1e70a028a17974.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_8ab50d986f5ae81e5a1e70a028a17974.jpg not downloaded yet
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fb2%252F46b25a4c9e4b974034bc37c974523260%252Fpa%252FLR18629_7feda218d40151b642b87238598d11f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_7feda218d40151b642b87238598d11f6.jpg not downloaded yet
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f46d0>
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d0c80b-d4ae-5cc4-a782-626d2367a789/d1d0c80b-d4ae-5cc4-a782-626d2367a789_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5f%252F335f98e35cc659bff28022e76809c6b0%252Fpa%252FYS13064_6a34b10722f3a0664d2151822363a1a0.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_6a34b10722f3a0664d2151822363a1a0.jpg saved to cache
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1d0c80b-d4ae-5cc4-a782-626d2367a789
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be016850>
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_78a363d97ea2487175d1c04427ddb4dd.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_78a363d97ea2487175d1c04427ddb4dd.jpg saved to cache
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2636e10-6ba9-578c-ada5-3013d96fdaad
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf41de50>
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_6bcc0aa6cc05f5f6fc551196899e486e.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_6bcc0aa6cc05f5f6fc551196899e486e.jpg saved to cache
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_6df766de561e637b3045be9dc87821f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_6df766de561e637b3045be9dc87821f7.jpg not downloaded yet
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F3e%252F4b3e8088da16c5d3fd2b661861b94185%252Fpa%252FBB33034_b46c227fb8770ad05cce481de3a4e614.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_b46c227fb8770ad05cce481de3a4e614.jpg not downloaded yet
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe2%252F71e29885604877d8fccfca5d6e2bbbc4%252Fpa%252FBN48826_b44635988a093de3c9ae5d430598017d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_b44635988a093de3c9ae5d430598017d.jpg not downloaded yet
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fb2%252F46b25a4c9e4b974034bc37c974523260%252Fpa%252FLR18629_169e37986cc25c85c5f73064beb7345a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_169e37986cc25c85c5f73064beb7345a.jpg not downloaded yet
2026-03-27 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_e927e118b88916560711a6f454aa0be8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_c40d41634330ea66055aa08a62e36667.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_ce3c608b8f489722e4200bd494aba8b0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_ca885762a24653815fde14266a66d9ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_ca885762a24653815fde14266a66d9ed.jpg not downloaded yet
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F3e%252F4b3e8088da16c5d3fd2b661861b94185%252Fpa%252FBB33034_65f0e39379ab29176de7523032dd5063.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_65f0e39379ab29176de7523032dd5063.jpg not downloaded yet
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe2%252F71e29885604877d8fccfca5d6e2bbbc4%252Fpa%252FBN48826_25106da94eb8c5446ad7b4315991c0ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_25106da94eb8c5446ad7b4315991c0ed.jpg not downloaded yet
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fb2%252F46b25a4c9e4b974034bc37c974523260%252Fpa%252FLR18629_14c2f44928cf5a4ff5b8b82ae679a940.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_14c2f44928cf5a4ff5b8b82ae679a940.jpg not downloaded yet
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_67d8cb0ceaa43ffc9ef5a3b099ca2288.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_67d8cb0ceaa43ffc9ef5a3b099ca2288.jpg not downloaded yet
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F3e%252F4b3e8088da16c5d3fd2b661861b94185%252Fpa%252FBB33034_327680bd04228bdaceadf30c879da5f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_327680bd04228bdaceadf30c879da5f3.jpg not downloaded yet
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe2%252F71e29885604877d8fccfca5d6e2bbbc4%252Fpa%252FBN48826_26d5917092da6d518f7039fbe8deaa06.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_26d5917092da6d518f7039fbe8deaa06.jpg not downloaded yet
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fb2%252F46b25a4c9e4b974034bc37c974523260%252Fpa%252FLR18629_fd7143017f960931e46d658bd2431f80.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_fd7143017f960931e46d658bd2431f80.jpg not downloaded yet
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_dc487f98e1ef57d574093515b5cfff5c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_dc487f98e1ef57d574093515b5cfff5c.jpg not downloaded yet
2026-03-27 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_36457e8daf0a3d1e5e9a7c1c937fb7a0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf30e010>
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_e927e118b88916560711a6f454aa0be8.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_e927e118b88916560711a6f454aa0be8.jpg saved to cache
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0e5d654-c934-59e0-8631-c7e648c17b03
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be023890>
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_c40d41634330ea66055aa08a62e36667.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_c40d41634330ea66055aa08a62e36667.jpg saved to cache
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2636e10-6ba9-578c-ada5-3013d96fdaad
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf32f550>
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d0c80b-d4ae-5cc4-a782-626d2367a789/d1d0c80b-d4ae-5cc4-a782-626d2367a789_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5f%252F335f98e35cc659bff28022e76809c6b0%252Fpa%252FYS13064_ce3c608b8f489722e4200bd494aba8b0.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_ce3c608b8f489722e4200bd494aba8b0.jpg saved to cache
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1d0c80b-d4ae-5cc4-a782-626d2367a789
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_f6d2fa8362046d9b7be7fa5a7284f826.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_f6d2fa8362046d9b7be7fa5a7284f826.jpg not downloaded yet
2026-03-27 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_39db3e8dab57656076ffa8a3d27893d9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_f000024b3a69d63575d8f8117c72779d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_d6d1667309300612f2653aff9dece132.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_d6d1667309300612f2653aff9dece132.jpg not downloaded yet
2026-03-27 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_8468369c458165147766cef5bc8e3d2e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f4710>
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_36457e8daf0a3d1e5e9a7c1c937fb7a0.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_36457e8daf0a3d1e5e9a7c1c937fb7a0.jpg saved to cache
2026-03-27 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16
2026-03-27 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM88719/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZW26780> (referer: https://www.auto1.com/v1/car-details-view/ZW26780/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_c3ea63262b88ec9f72a1ac85f23c751b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_1e31e5a9ee188205741a8ba5964c0074.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:12 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 10493 | hits on page: 40
2026-03-27 10:35:12 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-27 10:35:12 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL31894%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [auto1.de] INFO: Scrape type for KL31894: 0
2026-03-27 10:35:12 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-27 10:35:12 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-27 10:35:12 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-27 10:35:12 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-27 10:35:12 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-27 10:35:12 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-27 10:35:12 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-27 10:35:12 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD47640%27 HTTP/1.1" 200 None
2026-03-27 10:35:12 [auto1.de] INFO: Scrape type for VD47640: 1
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be261b50>
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_39db3e8dab57656076ffa8a3d27893d9.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_39db3e8dab57656076ffa8a3d27893d9.jpg saved to cache
2026-03-27 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d
2026-03-27 10:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf81b50>
2026-03-27 10:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_f000024b3a69d63575d8f8117c72779d.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_f000024b3a69d63575d8f8117c72779d.jpg saved to cache
2026-03-27 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16
2026-03-27 10:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_0fc23daa43d5822b8171cc2117a4710d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:13 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13341%27 HTTP/1.1" 200 None
2026-03-27 10:35:13 [auto1.de] INFO: Scrape type for DU13341: 1
2026-03-27 10:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_f6d2fa8362046d9b7be7fa5a7284f826.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_b44635988a093de3c9ae5d430598017d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_169e37986cc25c85c5f73064beb7345a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_23c8d05a919b9ddcccc619ba50e8dc6b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_fd7143017f960931e46d658bd2431f80.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_b46c227fb8770ad05cce481de3a4e614.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:13 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85584%27 HTTP/1.1" 200 None
2026-03-27 10:35:13 [auto1.de] INFO: Scrape type for XB85584: 1
2026-03-27 10:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf30cd10>
2026-03-27 10:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F4f%252F4f4ffabf0675f2ef8239a6bb594adb36%252Fpa%252FZK69536_8468369c458165147766cef5bc8e3d2e.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_8468369c458165147766cef5bc8e3d2e.jpg saved to cache
2026-03-27 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0e5d654-c934-59e0-8631-c7e648c17b03
2026-03-27 10:35:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0e5d654-c934-59e0-8631-c7e648c17b03, skipping ID generation
2026-03-27 10:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0e5d654-c934-59e0-8631-c7e648c17b03 with scrape type 1
2026-03-27 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0e5d654-c934-59e0-8631-c7e648c17b03 sending to next pipeline
2026-03-27 10:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0e5d654-c934-59e0-8631-c7e648c17b03, identifier: ZK69536
2026-03-27 10:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3285384a-2312-5ad7-a02e-5f2753b85caf with identifier: ZW26780
2026-03-27 10:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3285384a-2312-5ad7-a02e-5f2753b85caf with scrape type 1
2026-03-27 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3285384a-2312-5ad7-a02e-5f2753b85caf
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fdb%252F32dbba5a70d6ecd57d40fc3f1c1e4f68%252Fpa%252FZW26780_474b5030c09b2469c29bc02a89140663.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_474b5030c09b2469c29bc02a89140663.jpg not downloaded yet
2026-03-27 10:35:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1054d0>
2026-03-27 10:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb7%252Fe5b72d0c07037a8737c9218d15f30267%252Fpa%252FPT90816_c3ea63262b88ec9f72a1ac85f23c751b.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_c3ea63262b88ec9f72a1ac85f23c751b.jpg saved to cache
2026-03-27 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923
2026-03-27 10:35:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923, skipping ID generation
2026-03-27 10:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 with scrape type 1
2026-03-27 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 sending to next pipeline
2026-03-27 10:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923, identifier: PT90816
2026-03-27 10:35:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3afa10>
2026-03-27 10:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F6c%252F936cf4ab8c7aee1ff81ad2ab813dfdc1%252Fpa%252FCK79873_1e31e5a9ee188205741a8ba5964c0074.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_1e31e5a9ee188205741a8ba5964c0074.jpg saved to cache
2026-03-27 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe047b51-72f5-552c-84ed-2f45b2927b3c
2026-03-27 10:35:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe047b51-72f5-552c-84ed-2f45b2927b3c, skipping ID generation
2026-03-27 10:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe047b51-72f5-552c-84ed-2f45b2927b3c with scrape type 1
2026-03-27 10:35:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe047b51-72f5-552c-84ed-2f45b2927b3c sending to next pipeline
2026-03-27 10:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe047b51-72f5-552c-84ed-2f45b2927b3c, identifier: CK79873
2026-03-27 10:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0e5d654-c934-59e0-8631-c7e648c17b03 with identifier: ZK69536
2026-03-27 10:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0e5d654-c934-59e0-8631-c7e648c17b03 with identifier: ZK69536
2026-03-27 10:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0e5d654-c934-59e0-8631-c7e648c17b03 with identifier: ZK69536 to the API
2026-03-27 10:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_8468369c458165147766cef5bc8e3d2e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.0L',
'engine_horse_power': 60,
'expiration_date': '2026-03-28T16:12:15Z',
'fuel_type': 'petrol',
'id': 'a0e5d654-c934-59e0-8631-c7e648c17b03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK69536',
'listing': 'auction',
'location': 'DE, Schwerin',
'make': 'Skoda',
'model': 'Citigo',
'odometer': 85958,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73542,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_8468369c458165147766cef5bc8e3d2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67667,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_e927e118b88916560711a6f454aa0be8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_5cd2322444577a98dc76e3795a7c0222.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2202098,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_da45aa6c0a53ce7a649b45237fabbae0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2375248,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_1cc49ad3c744ab686ff962ad84a8a124.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53364,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_ca59ce054988815aadd0176ece655771.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1966832,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_0bfa550468fbef543cb885bfe2966bcf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2079730,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_06e4bf06e852d287ce16437e03757c43.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2442837,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_9b19c8c4017ae6c219e363a837727674.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e5d654-c934-59e0-8631-c7e648c17b03/a0e5d654-c934-59e0-8631-c7e648c17b03_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/4f/4f4ffabf0675f2ef8239a6bb594adb36/pa/ZK69536_4c25d67bb0c634487885cd1c4a555e80.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-01-06',
'seats_number': 4,
'seller_name': None,
'title': 'Skoda Citigo 1.0 MPI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2014}
2026-03-27 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK69536%27 HTTP/1.1" 200 None
2026-03-27 10:35:15 [auto1.de] INFO: Saving data for ZK69536: {'created_time': 1774607715.167994, 'last_price_update_time': 1774607715.168007, 'auction_closing_time': 1774714335.0}
2026-03-27 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK69536') HTTP/1.1" 204 0
2026-03-27 10:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 with identifier: PT90816
2026-03-27 10:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 with identifier: PT90816
2026-03-27 10:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923 with identifier: PT90816 to the API
2026-03-27 10:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_c3ea63262b88ec9f72a1ac85f23c751b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 166,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:25:07Z',
'fuel_type': 'diesel',
'id': '7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT90816',
'listing': 'auction',
'location': 'DE, Braunschweig',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 214177,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_6632752ad6e1c885dda5b6d656c30a52.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2653054,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_c3ea63262b88ec9f72a1ac85f23c751b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_d96a0f3429086d1a98283e6680ec550e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63811,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_7adcc475f2aeeaf91ff659fe7c14a10d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2618643,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_c5fc189b9b531c62e61fcabc6a633008.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2639227,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_c26ff4c6ea4056547175b94525d9a003.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2710932,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_15f0f8131e21a2e2b08e9512f3cf4da7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_22b4ea8b85237be7dcf8388090c6d38e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2626612,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_af44fdf81b7d7e4834a827843ee26659.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923/7acc5b9a-bd50-5cf1-8c59-0bcdc92bd923_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81053,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/b7/e5b72d0c07037a8737c9218d15f30267/pa/PT90816_3539eb8e99d723fa42cd3c2a3e0b1cb8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-13',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2019}
2026-03-27 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT90816%27 HTTP/1.1" 200 None
2026-03-27 10:35:16 [auto1.de] INFO: Saving data for PT90816: {'created_time': 1774607716.469401, 'last_price_update_time': 1774607716.469416, 'auction_closing_time': 1774715107.0}
2026-03-27 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT90816') HTTP/1.1" 204 0
2026-03-27 10:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe047b51-72f5-552c-84ed-2f45b2927b3c with identifier: CK79873
2026-03-27 10:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe047b51-72f5-552c-84ed-2f45b2927b3c with identifier: CK79873
2026-03-27 10:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe047b51-72f5-552c-84ed-2f45b2927b3c with identifier: CK79873 to the API
2026-03-27 10:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_1e31e5a9ee188205741a8ba5964c0074.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:33:15Z',
'fuel_type': 'diesel',
'id': 'fe047b51-72f5-552c-84ed-2f45b2927b3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK79873',
'listing': 'auction',
'location': 'DE, Schweinfurt',
'make': 'Volvo',
'model': 'V60 Cross Country',
'odometer': 193061,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1985074,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_1e31e5a9ee188205741a8ba5964c0074.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62799,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_dafb67bea31846d42e37f907837975c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_57a7ba4217e0fad314d24872527885c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1763343,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_6150495c9fe816480178be3b3a0f282a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_fd3bc00d76936df421fb2b20eb5bf5ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62359,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_c393454800e5fe3a61e2e964a2000c58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49378,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_fa867c16e582e51dbe739bf96f80ee8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1879266,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_c7debf8a6a5600c51bcd61bd8fa3bae1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1913418,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_5cc93f7b8864fb3366ebc469bec3c59c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe047b51-72f5-552c-84ed-2f45b2927b3c/fe047b51-72f5-552c-84ed-2f45b2927b3c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1996741,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img93/6c/936cf4ab8c7aee1ff81ad2ab813dfdc1/pa/CK79873_245a5906f4ee24fe4b1a86970a5122ad.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-10-11',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V60 Cross Country 2.0 D4 Momentum',
'transmission': 'automatic',
'trim': 'Momentum',
'year': 2016}
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK79873%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [auto1.de] INFO: Saving data for CK79873: {'created_time': 1774607717.798057, 'last_price_update_time': 1774607717.798069, 'auction_closing_time': 1774715595.0}
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK79873') HTTP/1.1" 204 0
2026-03-27 10:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_b7d4f8ac26c7900a3305b4a2721dbc94.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC36574%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [auto1.de] INFO: Scrape type for WC36574: 2
2026-03-27 10:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a59a4e2-eaee-5bde-997a-74185c967ddd with identifier: WC36574
2026-03-27 10:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a59a4e2-eaee-5bde-997a-74185c967ddd with scrape type 2
2026-03-27 10:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a59a4e2-eaee-5bde-997a-74185c967ddd with scrape type 2
2026-03-27 10:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a59a4e2-eaee-5bde-997a-74185c967ddd, identifier: WC36574
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fdb%252F32dbba5a70d6ecd57d40fc3f1c1e4f68%252Fpa%252FZW26780_0f59fbeeb469076b83e47d0eac7e5e7f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_0f59fbeeb469076b83e47d0eac7e5e7f.jpg not downloaded yet
2026-03-27 10:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_67d8cb0ceaa43ffc9ef5a3b099ca2288.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_dc487f98e1ef57d574093515b5cfff5c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a59a4e2-eaee-5bde-997a-74185c967ddd with identifier: WC36574
2026-03-27 10:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a59a4e2-eaee-5bde-997a-74185c967ddd with identifier: WC36574
2026-03-27 10:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a59a4e2-eaee-5bde-997a-74185c967ddd with identifier: WC36574 to the API
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:00:47Z',
'fuel_type': 'diesel',
'id': '3a59a4e2-eaee-5bde-997a-74185c967ddd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC36574',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 148460,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-18',
'seller_name': None,
'title': 'Audi A6 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2017}
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC36574%27 HTTP/1.1" 200 None
2026-03-27 10:35:18 [auto1.de] INFO: Saving data for WC36574: {'auction_closing_time': 1774713647.0, 'created_time': 1773225333.642473, 'last_price_update_time': 1774607718.31759}
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC36574') HTTP/1.1" 204 0
2026-03-27 10:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_26d5917092da6d518f7039fbe8deaa06.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_d6d1667309300612f2653aff9dece132.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:18 [auto1.de] INFO: Found listing with ID: HB67521
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB67521%27 HTTP/1.1" 200 None
2026-03-27 10:35:18 [auto1.de] INFO: Scrape type for HB67521: 1
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fdb%252F32dbba5a70d6ecd57d40fc3f1c1e4f68%252Fpa%252FZW26780_967c26327aa337738b7bf12c9942278b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_967c26327aa337738b7bf12c9942278b.jpg not downloaded yet
2026-03-27 10:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB09525/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_327680bd04228bdaceadf30c879da5f3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be017d50>
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_0fc23daa43d5822b8171cc2117a4710d.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_0fc23daa43d5822b8171cc2117a4710d.jpg saved to cache
2026-03-27 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53c69dda-dcac-5e57-8e79-44b586e0ef5c
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1c6ed0>
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_f6d2fa8362046d9b7be7fa5a7284f826.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_f6d2fa8362046d9b7be7fa5a7284f826.jpg saved to cache
2026-03-27 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2c67d0>
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d2072bb-abe0-5396-9d15-155b7e92c1c6/3d2072bb-abe0-5396-9d15-155b7e92c1c6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe2%252F71e29885604877d8fccfca5d6e2bbbc4%252Fpa%252FBN48826_b44635988a093de3c9ae5d430598017d.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_b44635988a093de3c9ae5d430598017d.jpg saved to cache
2026-03-27 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3d2072bb-abe0-5396-9d15-155b7e92c1c6
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3c7590>
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83334a2b-1f01-51c3-aadc-43ee3bbe70e6/83334a2b-1f01-51c3-aadc-43ee3bbe70e6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fb2%252F46b25a4c9e4b974034bc37c974523260%252Fpa%252FLR18629_169e37986cc25c85c5f73064beb7345a.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_169e37986cc25c85c5f73064beb7345a.jpg saved to cache
2026-03-27 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 83334a2b-1f01-51c3-aadc-43ee3bbe70e6
2026-03-27 10:35:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2c77d0>
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_23c8d05a919b9ddcccc619ba50e8dc6b.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_23c8d05a919b9ddcccc619ba50e8dc6b.jpg saved to cache
2026-03-27 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53c69dda-dcac-5e57-8e79-44b586e0ef5c
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf18610>
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83334a2b-1f01-51c3-aadc-43ee3bbe70e6/83334a2b-1f01-51c3-aadc-43ee3bbe70e6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fb2%252F46b25a4c9e4b974034bc37c974523260%252Fpa%252FLR18629_fd7143017f960931e46d658bd2431f80.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_fd7143017f960931e46d658bd2431f80.jpg saved to cache
2026-03-27 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 83334a2b-1f01-51c3-aadc-43ee3bbe70e6
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf35ebd0>
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b641efa-2fe5-5e81-b564-e66e5de30046/1b641efa-2fe5-5e81-b564-e66e5de30046_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F3e%252F4b3e8088da16c5d3fd2b661861b94185%252Fpa%252FBB33034_b46c227fb8770ad05cce481de3a4e614.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_b46c227fb8770ad05cce481de3a4e614.jpg saved to cache
2026-03-27 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b641efa-2fe5-5e81-b564-e66e5de30046
2026-03-27 10:35:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3c5690>
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F2e%252Fcc2ea24f7b4df30a1e6eae787d0ed812%252Fpa%252FZV29308_b7d4f8ac26c7900a3305b4a2721dbc94.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_b7d4f8ac26c7900a3305b4a2721dbc94.jpg saved to cache
2026-03-27 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53c69dda-dcac-5e57-8e79-44b586e0ef5c
2026-03-27 10:35:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53c69dda-dcac-5e57-8e79-44b586e0ef5c, skipping ID generation
2026-03-27 10:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53c69dda-dcac-5e57-8e79-44b586e0ef5c with scrape type 1
2026-03-27 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53c69dda-dcac-5e57-8e79-44b586e0ef5c sending to next pipeline
2026-03-27 10:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53c69dda-dcac-5e57-8e79-44b586e0ef5c, identifier: ZV29308
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE52893%27 HTTP/1.1" 200 None
2026-03-27 10:35:19 [auto1.de] INFO: Scrape type for SE52893: 1
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fdb%252F32dbba5a70d6ecd57d40fc3f1c1e4f68%252Fpa%252FZW26780_52dcb5ba52ae5501959211d1bb6a5b72.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_52dcb5ba52ae5501959211d1bb6a5b72.jpg not downloaded yet
2026-03-27 10:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53c69dda-dcac-5e57-8e79-44b586e0ef5c with identifier: ZV29308
2026-03-27 10:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53c69dda-dcac-5e57-8e79-44b586e0ef5c with identifier: ZV29308
2026-03-27 10:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53c69dda-dcac-5e57-8e79-44b586e0ef5c with identifier: ZV29308 to the API
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_b7d4f8ac26c7900a3305b4a2721dbc94.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 136,
'expiration_date': '2026-03-28T16:20:07Z',
'fuel_type': 'petrol',
'id': '53c69dda-dcac-5e57-8e79-44b586e0ef5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV29308',
'listing': 'auction',
'location': 'DE, Passau',
'make': 'MINI',
'model': 'MINI',
'odometer': 37465,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91292,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_08fb09e2a76dbbc213b4f11fabc4f9fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_3ee4ab19bb1c9b7c21689e8a9df553f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_fc24ad881ab98d8ea30b75010213982c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2507469,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_0fc23daa43d5822b8171cc2117a4710d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2651961,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_23c8d05a919b9ddcccc619ba50e8dc6b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2797938,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_b7d4f8ac26c7900a3305b4a2721dbc94.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_56f9872a8c7101456ed2dc536c28b3d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87507,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_8c0620ce843d2ba3c645486f2830c316.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2747021,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_41d301983fb3a7feef105bce97e8d3ba.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c69dda-dcac-5e57-8e79-44b586e0ef5c/53c69dda-dcac-5e57-8e79-44b586e0ef5c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2669675,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/2e/cc2ea24f7b4df30a1e6eae787d0ed812/pa/ZV29308_90b412e3a516be32a44085f080209862.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-14',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Cooper Classic Trim',
'transmission': 'automatic',
'trim': 'Classic Trim',
'year': 2021}
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV29308%27 HTTP/1.1" 200 None
2026-03-27 10:35:19 [auto1.de] INFO: Saving data for ZV29308: {'created_time': 1774607719.695803, 'last_price_update_time': 1774607719.695816, 'auction_closing_time': 1774714807.0}
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV29308') HTTP/1.1" 204 0
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: ZN32695
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD86365%27 HTTP/1.1" 200 None
2026-03-27 10:35:19 [auto1.de] INFO: Scrape type for SD86365: 1
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fdb%252F32dbba5a70d6ecd57d40fc3f1c1e4f68%252Fpa%252FZW26780_4b4241ac99e116c6fefd2f76b5bf31ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_4b4241ac99e116c6fefd2f76b5bf31ed.jpg not downloaded yet
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5652790>
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_67d8cb0ceaa43ffc9ef5a3b099ca2288.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_67d8cb0ceaa43ffc9ef5a3b099ca2288.jpg saved to cache
2026-03-27 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be274450>
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_dc487f98e1ef57d574093515b5cfff5c.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_dc487f98e1ef57d574093515b5cfff5c.jpg saved to cache
2026-03-27 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16
2026-03-27 10:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5650510>
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d2072bb-abe0-5396-9d15-155b7e92c1c6/3d2072bb-abe0-5396-9d15-155b7e92c1c6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe2%252F71e29885604877d8fccfca5d6e2bbbc4%252Fpa%252FBN48826_26d5917092da6d518f7039fbe8deaa06.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_26d5917092da6d518f7039fbe8deaa06.jpg saved to cache
2026-03-27 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3d2072bb-abe0-5396-9d15-155b7e92c1c6
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be277510>
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_d6d1667309300612f2653aff9dece132.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_d6d1667309300612f2653aff9dece132.jpg saved to cache
2026-03-27 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf011d0>
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b641efa-2fe5-5e81-b564-e66e5de30046/1b641efa-2fe5-5e81-b564-e66e5de30046_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F3e%252F4b3e8088da16c5d3fd2b661861b94185%252Fpa%252FBB33034_327680bd04228bdaceadf30c879da5f3.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_327680bd04228bdaceadf30c879da5f3.jpg saved to cache
2026-03-27 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b641efa-2fe5-5e81-b564-e66e5de30046
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF03511%27 HTTP/1.1" 200 None
2026-03-27 10:35:19 [auto1.de] INFO: Scrape type for LF03511: 1
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: MK03700
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: FK77468
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN22226%27 HTTP/1.1" 200 None
2026-03-27 10:35:20 [auto1.de] INFO: Scrape type for PN22226: 2
2026-03-27 10:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d4533af-3406-5918-a6b3-59ccde7f674c with identifier: PN22226
2026-03-27 10:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d4533af-3406-5918-a6b3-59ccde7f674c with scrape type 2
2026-03-27 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d4533af-3406-5918-a6b3-59ccde7f674c with scrape type 2
2026-03-27 10:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d4533af-3406-5918-a6b3-59ccde7f674c, identifier: PN22226
2026-03-27 10:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d4533af-3406-5918-a6b3-59ccde7f674c with identifier: PN22226
2026-03-27 10:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d4533af-3406-5918-a6b3-59ccde7f674c with identifier: PN22226
2026-03-27 10:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d4533af-3406-5918-a6b3-59ccde7f674c with identifier: PN22226 to the API
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:40:57Z',
'fuel_type': 'petrol',
'id': '2d4533af-3406-5918-a6b3-59ccde7f674c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN22226',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 180303,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-10-04',
'seller_name': None,
'title': 'Volkswagen Golf V 2.0 TFSI GTI',
'transmission': 'manual',
'trim': 'GTI',
'year': 2006}
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN22226%27 HTTP/1.1" 200 None
2026-03-27 10:35:20 [auto1.de] INFO: Saving data for PN22226: {'auction_closing_time': 1774716057.0, 'created_time': 1774349879.172949, 'last_price_update_time': 1774607720.440693}
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN22226') HTTP/1.1" 204 0
2026-03-27 10:35:20 [auto1.de] INFO: Found listing with ID: AG44420
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44420%27 HTTP/1.1" 200 None
2026-03-27 10:35:20 [auto1.de] INFO: Scrape type for AG44420: 1
2026-03-27 10:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_25106da94eb8c5446ad7b4315991c0ed.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_474b5030c09b2469c29bc02a89140663.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_0f59fbeeb469076b83e47d0eac7e5e7f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_52dcb5ba52ae5501959211d1bb6a5b72.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_14c2f44928cf5a4ff5b8b82ae679a940.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_65f0e39379ab29176de7523032dd5063.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_967c26327aa337738b7bf12c9942278b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_ca885762a24653815fde14266a66d9ed.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:20 [auto1.de] INFO: Found listing with ID: KZ23226
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ23226%27 HTTP/1.1" 200 None
2026-03-27 10:35:20 [auto1.de] INFO: Scrape type for KZ23226: 1
2026-03-27 10:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:20 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ13308%27 HTTP/1.1" 200 None
2026-03-27 10:35:20 [auto1.de] INFO: Scrape type for MJ13308: 1
2026-03-27 10:35:20 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63339%27 HTTP/1.1" 200 None
2026-03-27 10:35:20 [auto1.de] INFO: Scrape type for WC63339: 1
2026-03-27 10:35:20 [auto1.de] INFO: Found listing with ID: LL66179
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL66179%27 HTTP/1.1" 200 None
2026-03-27 10:35:20 [auto1.de] INFO: Scrape type for LL66179: 1
2026-03-27 10:35:20 [auto1.de] INFO: Found listing with ID: VP53971
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP53971%27 HTTP/1.1" 200 None
2026-03-27 10:35:20 [auto1.de] INFO: Scrape type for VP53971: 1
2026-03-27 10:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_0d4ae1481cb3c4f1dbb37347a931ce03.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:20 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE09566%27 HTTP/1.1" 200 None
2026-03-27 10:35:20 [auto1.de] INFO: Scrape type for DE09566: 2
2026-03-27 10:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c46f2104-2545-581e-b8f2-ebd402e80dbd with identifier: DE09566
2026-03-27 10:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c46f2104-2545-581e-b8f2-ebd402e80dbd with scrape type 2
2026-03-27 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c46f2104-2545-581e-b8f2-ebd402e80dbd with scrape type 2
2026-03-27 10:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c46f2104-2545-581e-b8f2-ebd402e80dbd, identifier: DE09566
2026-03-27 10:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c46f2104-2545-581e-b8f2-ebd402e80dbd with identifier: DE09566
2026-03-27 10:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c46f2104-2545-581e-b8f2-ebd402e80dbd with identifier: DE09566
2026-03-27 10:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c46f2104-2545-581e-b8f2-ebd402e80dbd with identifier: DE09566 to the API
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:02:32Z',
'fuel_type': 'diesel',
'id': 'c46f2104-2545-581e-b8f2-ebd402e80dbd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE09566',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 76671,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-22',
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 2.0 TDI Highline 4Motion',
'transmission': 'automatic',
'trim': 'Highline 4Motion',
'year': 2021}
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE09566%27 HTTP/1.1" 200 None
2026-03-27 10:35:21 [auto1.de] INFO: Saving data for DE09566: {'auction_closing_time': 1774713752.0, 'created_time': 1773830261.466794, 'last_price_update_time': 1774607721.151601}
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE09566') HTTP/1.1" 204 0
2026-03-27 10:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_7feda218d40151b642b87238598d11f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_6df766de561e637b3045be9dc87821f7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_8ab50d986f5ae81e5a1e70a028a17974.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:21 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-27 10:35:21 [auto1.de] INFO: Found listing with ID: FB90112
2026-03-27 10:35:21 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-27 10:35:21 [auto1.de] INFO: Found listing with ID: JW30909
2026-03-27 10:35:21 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35268%27 HTTP/1.1" 200 None
2026-03-27 10:35:21 [auto1.de] INFO: Scrape type for NR35268: 1
2026-03-27 10:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_4b4241ac99e116c6fefd2f76b5bf31ed.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf362d0>
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d2072bb-abe0-5396-9d15-155b7e92c1c6/3d2072bb-abe0-5396-9d15-155b7e92c1c6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe2%252F71e29885604877d8fccfca5d6e2bbbc4%252Fpa%252FBN48826_25106da94eb8c5446ad7b4315991c0ed.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_25106da94eb8c5446ad7b4315991c0ed.jpg saved to cache
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3d2072bb-abe0-5396-9d15-155b7e92c1c6
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be25b590>
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3285384a-2312-5ad7-a02e-5f2753b85caf/3285384a-2312-5ad7-a02e-5f2753b85caf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fdb%252F32dbba5a70d6ecd57d40fc3f1c1e4f68%252Fpa%252FZW26780_474b5030c09b2469c29bc02a89140663.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_474b5030c09b2469c29bc02a89140663.jpg saved to cache
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3285384a-2312-5ad7-a02e-5f2753b85caf
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0e39d0>
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3285384a-2312-5ad7-a02e-5f2753b85caf/3285384a-2312-5ad7-a02e-5f2753b85caf_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fdb%252F32dbba5a70d6ecd57d40fc3f1c1e4f68%252Fpa%252FZW26780_0f59fbeeb469076b83e47d0eac7e5e7f.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_0f59fbeeb469076b83e47d0eac7e5e7f.jpg saved to cache
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3285384a-2312-5ad7-a02e-5f2753b85caf
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e4dd0>
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3285384a-2312-5ad7-a02e-5f2753b85caf/3285384a-2312-5ad7-a02e-5f2753b85caf_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fdb%252F32dbba5a70d6ecd57d40fc3f1c1e4f68%252Fpa%252FZW26780_52dcb5ba52ae5501959211d1bb6a5b72.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_52dcb5ba52ae5501959211d1bb6a5b72.jpg saved to cache
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3285384a-2312-5ad7-a02e-5f2753b85caf
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0e3750>
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83334a2b-1f01-51c3-aadc-43ee3bbe70e6/83334a2b-1f01-51c3-aadc-43ee3bbe70e6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fb2%252F46b25a4c9e4b974034bc37c974523260%252Fpa%252FLR18629_14c2f44928cf5a4ff5b8b82ae679a940.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_14c2f44928cf5a4ff5b8b82ae679a940.jpg saved to cache
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 83334a2b-1f01-51c3-aadc-43ee3bbe70e6
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b4b10>
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b641efa-2fe5-5e81-b564-e66e5de30046/1b641efa-2fe5-5e81-b564-e66e5de30046_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F3e%252F4b3e8088da16c5d3fd2b661861b94185%252Fpa%252FBB33034_65f0e39379ab29176de7523032dd5063.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_65f0e39379ab29176de7523032dd5063.jpg saved to cache
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b641efa-2fe5-5e81-b564-e66e5de30046
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0e1090>
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3285384a-2312-5ad7-a02e-5f2753b85caf/3285384a-2312-5ad7-a02e-5f2753b85caf_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fdb%252F32dbba5a70d6ecd57d40fc3f1c1e4f68%252Fpa%252FZW26780_967c26327aa337738b7bf12c9942278b.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_967c26327aa337738b7bf12c9942278b.jpg saved to cache
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3285384a-2312-5ad7-a02e-5f2753b85caf
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be20d7d0>
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_ca885762a24653815fde14266a66d9ed.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_ca885762a24653815fde14266a66d9ed.jpg saved to cache
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be037010>
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b641efa-2fe5-5e81-b564-e66e5de30046/1b641efa-2fe5-5e81-b564-e66e5de30046_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F3e%252F4b3e8088da16c5d3fd2b661861b94185%252Fpa%252FBB33034_0d4ae1481cb3c4f1dbb37347a931ce03.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_0d4ae1481cb3c4f1dbb37347a931ce03.jpg saved to cache
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b641efa-2fe5-5e81-b564-e66e5de30046
2026-03-27 10:35:21 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41412%27 HTTP/1.1" 200 None
2026-03-27 10:35:21 [auto1.de] INFO: Scrape type for VE41412: 1
2026-03-27 10:35:21 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-27 10:35:21 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-27 10:35:21 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c54c01d0>
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83334a2b-1f01-51c3-aadc-43ee3bbe70e6/83334a2b-1f01-51c3-aadc-43ee3bbe70e6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fb2%252F46b25a4c9e4b974034bc37c974523260%252Fpa%252FLR18629_7feda218d40151b642b87238598d11f6.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_7feda218d40151b642b87238598d11f6.jpg saved to cache
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 83334a2b-1f01-51c3-aadc-43ee3bbe70e6
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf3efd0>
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_6df766de561e637b3045be9dc87821f7.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_6df766de561e637b3045be9dc87821f7.jpg saved to cache
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be102b90>
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d2072bb-abe0-5396-9d15-155b7e92c1c6/3d2072bb-abe0-5396-9d15-155b7e92c1c6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe2%252F71e29885604877d8fccfca5d6e2bbbc4%252Fpa%252FBN48826_8ab50d986f5ae81e5a1e70a028a17974.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_8ab50d986f5ae81e5a1e70a028a17974.jpg saved to cache
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3d2072bb-abe0-5396-9d15-155b7e92c1c6
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0a48d0>
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3285384a-2312-5ad7-a02e-5f2753b85caf/3285384a-2312-5ad7-a02e-5f2753b85caf_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fdb%252F32dbba5a70d6ecd57d40fc3f1c1e4f68%252Fpa%252FZW26780_4b4241ac99e116c6fefd2f76b5bf31ed.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_4b4241ac99e116c6fefd2f76b5bf31ed.jpg saved to cache
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3285384a-2312-5ad7-a02e-5f2753b85caf
2026-03-27 10:35:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3285384a-2312-5ad7-a02e-5f2753b85caf, skipping ID generation
2026-03-27 10:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3285384a-2312-5ad7-a02e-5f2753b85caf with scrape type 1
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3285384a-2312-5ad7-a02e-5f2753b85caf sending to next pipeline
2026-03-27 10:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3285384a-2312-5ad7-a02e-5f2753b85caf, identifier: ZW26780
2026-03-27 10:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3285384a-2312-5ad7-a02e-5f2753b85caf with identifier: ZW26780
2026-03-27 10:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3285384a-2312-5ad7-a02e-5f2753b85caf with identifier: ZW26780
2026-03-27 10:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3285384a-2312-5ad7-a02e-5f2753b85caf with identifier: ZW26780 to the API
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_4b4241ac99e116c6fefd2f76b5bf31ed.jpg>
{'auction_title': '',
'c_o_2_emission_value': 157,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:02:51Z',
'fuel_type': 'diesel',
'id': '3285384a-2312-5ad7-a02e-5f2753b85caf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW26780',
'listing': 'auction',
'location': 'DE, Münster',
'make': 'Volvo',
'model': 'V70',
'odometer': 466645,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3285384a-2312-5ad7-a02e-5f2753b85caf/3285384a-2312-5ad7-a02e-5f2753b85caf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80527,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_474b5030c09b2469c29bc02a89140663.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3285384a-2312-5ad7-a02e-5f2753b85caf/3285384a-2312-5ad7-a02e-5f2753b85caf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_0f59fbeeb469076b83e47d0eac7e5e7f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3285384a-2312-5ad7-a02e-5f2753b85caf/3285384a-2312-5ad7-a02e-5f2753b85caf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_967c26327aa337738b7bf12c9942278b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3285384a-2312-5ad7-a02e-5f2753b85caf/3285384a-2312-5ad7-a02e-5f2753b85caf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_52dcb5ba52ae5501959211d1bb6a5b72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3285384a-2312-5ad7-a02e-5f2753b85caf/3285384a-2312-5ad7-a02e-5f2753b85caf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128611,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/db/32dbba5a70d6ecd57d40fc3f1c1e4f68/pa/ZW26780_4b4241ac99e116c6fefd2f76b5bf31ed.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-06-01',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V70 2.0 D3 Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2008}
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW26780%27 HTTP/1.1" 200 None
2026-03-27 10:35:22 [auto1.de] INFO: Saving data for ZW26780: {'created_time': 1774607722.436272, 'last_price_update_time': 1774607722.436283, 'auction_closing_time': 1774713771.0}
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW26780') HTTP/1.1" 204 0
2026-03-27 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE52893/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB67521/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG44420/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB85584/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM88719> (referer: https://www.auto1.com/v1/car-details-view/VM88719/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DU13341/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VD47640/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_42290d85a6ca84737ec849b4215ddf80.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_249005484bab634ddc42350650934e34.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:22 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 10493 | hits on page: 40
2026-03-27 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_7ffa70023087471f54611279297d607d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_ac551a78ae369c782cf266af6ffbd329.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_9a4419523503aa5501e97830e35b9ecd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_8022c74097d0723835c88e983ce3cc04.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:22 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-27 10:35:22 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX01003%27 HTTP/1.1" 200 None
2026-03-27 10:35:22 [auto1.de] INFO: Scrape type for BX01003: 2
2026-03-27 10:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98c38b85-ceba-5d4b-956a-6b2d4cb9925a with identifier: BX01003
2026-03-27 10:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98c38b85-ceba-5d4b-956a-6b2d4cb9925a with scrape type 2
2026-03-27 10:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98c38b85-ceba-5d4b-956a-6b2d4cb9925a with scrape type 2
2026-03-27 10:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98c38b85-ceba-5d4b-956a-6b2d4cb9925a, identifier: BX01003
2026-03-27 10:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbdd0925-1030-5135-b202-7815fa866981 with identifier: VM88719
2026-03-27 10:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbdd0925-1030-5135-b202-7815fa866981 with scrape type 1
2026-03-27 10:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fbdd0925-1030-5135-b202-7815fa866981
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_6f0a96ff4025dd56c2d14157c82cad99.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_6f0a96ff4025dd56c2d14157c82cad99.jpg not downloaded yet
2026-03-27 10:35:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf3f610>
2026-03-27 10:35:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d2072bb-abe0-5396-9d15-155b7e92c1c6/3d2072bb-abe0-5396-9d15-155b7e92c1c6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe2%252F71e29885604877d8fccfca5d6e2bbbc4%252Fpa%252FBN48826_42290d85a6ca84737ec849b4215ddf80.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_42290d85a6ca84737ec849b4215ddf80.jpg saved to cache
2026-03-27 10:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d2072bb-abe0-5396-9d15-155b7e92c1c6
2026-03-27 10:35:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d2072bb-abe0-5396-9d15-155b7e92c1c6, skipping ID generation
2026-03-27 10:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2072bb-abe0-5396-9d15-155b7e92c1c6 with scrape type 1
2026-03-27 10:35:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d2072bb-abe0-5396-9d15-155b7e92c1c6 sending to next pipeline
2026-03-27 10:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d2072bb-abe0-5396-9d15-155b7e92c1c6, identifier: BN48826
2026-03-27 10:35:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf32ff10>
2026-03-27 10:35:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b641efa-2fe5-5e81-b564-e66e5de30046/1b641efa-2fe5-5e81-b564-e66e5de30046_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F3e%252F4b3e8088da16c5d3fd2b661861b94185%252Fpa%252FBB33034_249005484bab634ddc42350650934e34.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_249005484bab634ddc42350650934e34.jpg saved to cache
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b641efa-2fe5-5e81-b564-e66e5de30046
2026-03-27 10:35:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b641efa-2fe5-5e81-b564-e66e5de30046, skipping ID generation
2026-03-27 10:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b641efa-2fe5-5e81-b564-e66e5de30046 with scrape type 1
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b641efa-2fe5-5e81-b564-e66e5de30046 sending to next pipeline
2026-03-27 10:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b641efa-2fe5-5e81-b564-e66e5de30046, identifier: BB33034
2026-03-27 10:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98c38b85-ceba-5d4b-956a-6b2d4cb9925a with identifier: BX01003
2026-03-27 10:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98c38b85-ceba-5d4b-956a-6b2d4cb9925a with identifier: BX01003
2026-03-27 10:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98c38b85-ceba-5d4b-956a-6b2d4cb9925a with identifier: BX01003 to the API
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:05:48Z',
'fuel_type': 'petrol',
'id': '98c38b85-ceba-5d4b-956a-6b2d4cb9925a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX01003',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 55721,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-17',
'seller_name': None,
'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2023}
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX01003%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [auto1.de] INFO: Saving data for BX01003: {'auction_closing_time': 1774713948.0, 'created_time': 1774033517.222013, 'last_price_update_time': 1774607723.629105}
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX01003') HTTP/1.1" 204 0
2026-03-27 10:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d2072bb-abe0-5396-9d15-155b7e92c1c6 with identifier: BN48826
2026-03-27 10:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d2072bb-abe0-5396-9d15-155b7e92c1c6 with identifier: BN48826
2026-03-27 10:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d2072bb-abe0-5396-9d15-155b7e92c1c6 with identifier: BN48826 to the API
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_42290d85a6ca84737ec849b4215ddf80.jpg>
{'auction_title': '',
'c_o_2_emission_value': 187,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '1.9L',
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:32:10Z',
'fuel_type': 'diesel',
'id': '3d2072bb-abe0-5396-9d15-155b7e92c1c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN48826',
'listing': 'auction',
'location': 'DE, Aschaffenburg',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 333254,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d2072bb-abe0-5396-9d15-155b7e92c1c6/3d2072bb-abe0-5396-9d15-155b7e92c1c6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_42290d85a6ca84737ec849b4215ddf80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d2072bb-abe0-5396-9d15-155b7e92c1c6/3d2072bb-abe0-5396-9d15-155b7e92c1c6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_8ab50d986f5ae81e5a1e70a028a17974.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d2072bb-abe0-5396-9d15-155b7e92c1c6/3d2072bb-abe0-5396-9d15-155b7e92c1c6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94258,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_b44635988a093de3c9ae5d430598017d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d2072bb-abe0-5396-9d15-155b7e92c1c6/3d2072bb-abe0-5396-9d15-155b7e92c1c6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79133,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_25106da94eb8c5446ad7b4315991c0ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d2072bb-abe0-5396-9d15-155b7e92c1c6/3d2072bb-abe0-5396-9d15-155b7e92c1c6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/e2/71e29885604877d8fccfca5d6e2bbbc4/pa/BN48826_26d5917092da6d518f7039fbe8deaa06.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-04-21',
'seats_number': 2,
'seller_name': None,
'title': 'Volkswagen Caddy 1.9 TDI Kasten',
'transmission': 'manual',
'trim': 'Kasten',
'year': 2009}
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN48826%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [auto1.de] INFO: Saving data for BN48826: {'created_time': 1774607724.093854, 'last_price_update_time': 1774607724.093865, 'auction_closing_time': 1774715530.0}
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN48826') HTTP/1.1" 204 0
2026-03-27 10:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b641efa-2fe5-5e81-b564-e66e5de30046 with identifier: BB33034
2026-03-27 10:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b641efa-2fe5-5e81-b564-e66e5de30046 with identifier: BB33034
2026-03-27 10:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b641efa-2fe5-5e81-b564-e66e5de30046 with identifier: BB33034 to the API
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_249005484bab634ddc42350650934e34.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.2L',
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:58:17Z',
'fuel_type': 'diesel',
'id': '1b641efa-2fe5-5e81-b564-e66e5de30046',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB33034',
'listing': 'auction',
'location': 'DE, Gelsenkirchen',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 171576,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b641efa-2fe5-5e81-b564-e66e5de30046/1b641efa-2fe5-5e81-b564-e66e5de30046_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83114,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_249005484bab634ddc42350650934e34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b641efa-2fe5-5e81-b564-e66e5de30046/1b641efa-2fe5-5e81-b564-e66e5de30046_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72072,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_0d4ae1481cb3c4f1dbb37347a931ce03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b641efa-2fe5-5e81-b564-e66e5de30046/1b641efa-2fe5-5e81-b564-e66e5de30046_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87698,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_b46c227fb8770ad05cce481de3a4e614.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b641efa-2fe5-5e81-b564-e66e5de30046/1b641efa-2fe5-5e81-b564-e66e5de30046_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_65f0e39379ab29176de7523032dd5063.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b641efa-2fe5-5e81-b564-e66e5de30046/1b641efa-2fe5-5e81-b564-e66e5de30046_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/3e/4b3e8088da16c5d3fd2b661861b94185/pa/BB33034_327680bd04228bdaceadf30c879da5f3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '1998-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 CDI Avantgarde',
'transmission': 'manual',
'trim': 'Avantgarde',
'year': 1998}
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB33034%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [auto1.de] INFO: Saving data for BB33034: {'created_time': 1774607724.567191, 'last_price_update_time': 1774607724.567201, 'auction_closing_time': 1774717097.0}
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB33034') HTTP/1.1" 204 0
2026-03-27 10:35:24 [auto1.de] INFO: Found listing with ID: DT14163
2026-03-27 10:35:24 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK20534%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [auto1.de] INFO: Scrape type for HK20534: 1
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_bd1b4ae32e96bdf859ebb761c30bbca1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_bd1b4ae32e96bdf859ebb761c30bbca1.jpg not downloaded yet
2026-03-27 10:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_c81a37a41c70033cca59bc05c2278943.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be019150>
2026-03-27 10:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_7ffa70023087471f54611279297d607d.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_7ffa70023087471f54611279297d607d.jpg saved to cache
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16
2026-03-27 10:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0cd750>
2026-03-27 10:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa4%252F6ea4fdece0972ef0ccc67804bde89e12%252Fpa%252FJT97344_ac551a78ae369c782cf266af6ffbd329.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_ac551a78ae369c782cf266af6ffbd329.jpg saved to cache
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16
2026-03-27 10:35:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16, skipping ID generation
2026-03-27 10:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 with scrape type 1
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 sending to next pipeline
2026-03-27 10:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16, identifier: JT97344
2026-03-27 10:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3013d0>
2026-03-27 10:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d0c80b-d4ae-5cc4-a782-626d2367a789/d1d0c80b-d4ae-5cc4-a782-626d2367a789_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5f%252F335f98e35cc659bff28022e76809c6b0%252Fpa%252FYS13064_9a4419523503aa5501e97830e35b9ecd.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_9a4419523503aa5501e97830e35b9ecd.jpg saved to cache
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1d0c80b-d4ae-5cc4-a782-626d2367a789
2026-03-27 10:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0cf790>
2026-03-27 10:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_8022c74097d0723835c88e983ce3cc04.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_8022c74097d0723835c88e983ce3cc04.jpg saved to cache
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d
2026-03-27 10:35:24 [auto1.de] INFO: Found listing with ID: UF20593
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF20593%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [auto1.de] INFO: Scrape type for UF20593: 1
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_6e87a9ef707ed3628429bad6c65b818e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_6e87a9ef707ed3628429bad6c65b818e.jpg not downloaded yet
2026-03-27 10:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 with identifier: JT97344
2026-03-27 10:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 with identifier: JT97344
2026-03-27 10:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e7cdcb4-4aba-585c-98fe-7da47fcbfc16 with identifier: JT97344 to the API
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_ac551a78ae369c782cf266af6ffbd329.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:56:31Z',
'fuel_type': 'petrol',
'id': '5e7cdcb4-4aba-585c-98fe-7da47fcbfc16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT97344',
'listing': 'auction',
'location': 'DE, Darmstadt',
'make': 'BMW',
'model': '2er',
'odometer': 125822,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_36457e8daf0a3d1e5e9a7c1c937fb7a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_f000024b3a69d63575d8f8117c72779d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80058,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_7ffa70023087471f54611279297d607d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_ac551a78ae369c782cf266af6ffbd329.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_6df766de561e637b3045be9dc87821f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_ca885762a24653815fde14266a66d9ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_67d8cb0ceaa43ffc9ef5a3b099ca2288.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78281,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_dc487f98e1ef57d574093515b5cfff5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81622,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_f6d2fa8362046d9b7be7fa5a7284f826.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7cdcb4-4aba-585c-98fe-7da47fcbfc16/5e7cdcb4-4aba-585c-98fe-7da47fcbfc16_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76820,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/a4/6ea4fdece0972ef0ccc67804bde89e12/pa/JT97344_d6d1667309300612f2653aff9dece132.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-09-02',
'seats_number': 4,
'seller_name': None,
'title': 'BMW 2er 218i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2015}
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT97344%27 HTTP/1.1" 200 None
2026-03-27 10:35:25 [auto1.de] INFO: Saving data for JT97344: {'created_time': 1774607725.328708, 'last_price_update_time': 1774607725.328719, 'auction_closing_time': 1774716991.0}
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT97344') HTTP/1.1" 204 0
2026-03-27 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_91aa59e93aaa1bd64cb50b8f08f74986.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:25 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC81369%27 HTTP/1.1" 200 None
2026-03-27 10:35:25 [auto1.de] INFO: Scrape type for CC81369: 2
2026-03-27 10:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ade8a767-c193-5a42-8ddd-a038d1536bd4 with identifier: CC81369
2026-03-27 10:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ade8a767-c193-5a42-8ddd-a038d1536bd4 with scrape type 2
2026-03-27 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ade8a767-c193-5a42-8ddd-a038d1536bd4 with scrape type 2
2026-03-27 10:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ade8a767-c193-5a42-8ddd-a038d1536bd4, identifier: CC81369
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_a407e1d000fe55ce80dd3fe9bddd4ac3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_a407e1d000fe55ce80dd3fe9bddd4ac3.jpg not downloaded yet
2026-03-27 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LL66179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD86365/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP53971/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ13308/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ23226/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ade8a767-c193-5a42-8ddd-a038d1536bd4 with identifier: CC81369
2026-03-27 10:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ade8a767-c193-5a42-8ddd-a038d1536bd4 with identifier: CC81369
2026-03-27 10:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ade8a767-c193-5a42-8ddd-a038d1536bd4 with identifier: CC81369 to the API
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:39:53Z',
'fuel_type': 'diesel',
'id': 'ade8a767-c193-5a42-8ddd-a038d1536bd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC81369',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 135660,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-29',
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi 340 L1 Trail',
'transmission': 'manual',
'trim': '340 L1 Trail',
'year': 2022}
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC81369%27 HTTP/1.1" 200 None
2026-03-27 10:35:25 [auto1.de] INFO: Saving data for CC81369: {'auction_closing_time': 1774715993.0, 'created_time': 1773427441.741455, 'last_price_update_time': 1774607725.920949}
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC81369') HTTP/1.1" 204 0
2026-03-27 10:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5bdf90>
2026-03-27 10:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83334a2b-1f01-51c3-aadc-43ee3bbe70e6/83334a2b-1f01-51c3-aadc-43ee3bbe70e6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fb2%252F46b25a4c9e4b974034bc37c974523260%252Fpa%252FLR18629_c81a37a41c70033cca59bc05c2278943.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_c81a37a41c70033cca59bc05c2278943.jpg saved to cache
2026-03-27 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83334a2b-1f01-51c3-aadc-43ee3bbe70e6
2026-03-27 10:35:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 83334a2b-1f01-51c3-aadc-43ee3bbe70e6, skipping ID generation
2026-03-27 10:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83334a2b-1f01-51c3-aadc-43ee3bbe70e6 with scrape type 1
2026-03-27 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83334a2b-1f01-51c3-aadc-43ee3bbe70e6 sending to next pipeline
2026-03-27 10:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83334a2b-1f01-51c3-aadc-43ee3bbe70e6, identifier: LR18629
2026-03-27 10:35:26 [auto1.de] INFO: Found listing with ID: UN23019
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN23019%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [auto1.de] INFO: Scrape type for UN23019: 1
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_69135472daa1fa7357f6d619efc1eeb2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_69135472daa1fa7357f6d619efc1eeb2.jpg not downloaded yet
2026-03-27 10:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83334a2b-1f01-51c3-aadc-43ee3bbe70e6 with identifier: LR18629
2026-03-27 10:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83334a2b-1f01-51c3-aadc-43ee3bbe70e6 with identifier: LR18629
2026-03-27 10:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83334a2b-1f01-51c3-aadc-43ee3bbe70e6 with identifier: LR18629 to the API
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_c81a37a41c70033cca59bc05c2278943.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.8L',
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:25:49Z',
'fuel_type': 'petrol',
'id': '83334a2b-1f01-51c3-aadc-43ee3bbe70e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR18629',
'listing': 'auction',
'location': 'DE, Osnabrück',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 196305,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83334a2b-1f01-51c3-aadc-43ee3bbe70e6/83334a2b-1f01-51c3-aadc-43ee3bbe70e6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_c81a37a41c70033cca59bc05c2278943.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83334a2b-1f01-51c3-aadc-43ee3bbe70e6/83334a2b-1f01-51c3-aadc-43ee3bbe70e6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84833,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_7feda218d40151b642b87238598d11f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83334a2b-1f01-51c3-aadc-43ee3bbe70e6/83334a2b-1f01-51c3-aadc-43ee3bbe70e6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_169e37986cc25c85c5f73064beb7345a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83334a2b-1f01-51c3-aadc-43ee3bbe70e6/83334a2b-1f01-51c3-aadc-43ee3bbe70e6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_14c2f44928cf5a4ff5b8b82ae679a940.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83334a2b-1f01-51c3-aadc-43ee3bbe70e6/83334a2b-1f01-51c3-aadc-43ee3bbe70e6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136216,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/b2/46b25a4c9e4b974034bc37c974523260/pa/LR18629_fd7143017f960931e46d658bd2431f80.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-03-22',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 1.8 TSI Ambiente 4x4',
'transmission': 'manual',
'trim': 'Ambiente 4x4',
'year': 2011}
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR18629%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [auto1.de] INFO: Saving data for LR18629: {'created_time': 1774607726.496714, 'last_price_update_time': 1774607726.496726, 'auction_closing_time': 1774715149.0}
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR18629') HTTP/1.1" 204 0
2026-03-27 10:35:26 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK21596%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [auto1.de] INFO: Scrape type for EK21596: 1
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_88464d64915395da77f690e12811da85.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_88464d64915395da77f690e12811da85.jpg not downloaded yet
2026-03-27 10:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC63339/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB09525> (referer: https://www.auto1.com/v1/car-details-view/FB09525/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be106310>
2026-03-27 10:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_91aa59e93aaa1bd64cb50b8f08f74986.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_91aa59e93aaa1bd64cb50b8f08f74986.jpg saved to cache
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2636e10-6ba9-578c-ada5-3013d96fdaad
2026-03-27 10:35:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:26 [auto1.de] INFO: Found listing with ID: AC15853
2026-03-27 10:35:26 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD28198%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [auto1.de] INFO: Scrape type for SD28198: 2
2026-03-27 10:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84fe5ade-85e6-5fcb-a92a-02bebc918c4c with identifier: SD28198
2026-03-27 10:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84fe5ade-85e6-5fcb-a92a-02bebc918c4c with scrape type 2
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84fe5ade-85e6-5fcb-a92a-02bebc918c4c with scrape type 2
2026-03-27 10:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84fe5ade-85e6-5fcb-a92a-02bebc918c4c, identifier: SD28198
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_cb7caa25fd782c733efd9862e2686aea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_cb7caa25fd782c733efd9862e2686aea.jpg not downloaded yet
2026-03-27 10:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_6f0a96ff4025dd56c2d14157c82cad99.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84fe5ade-85e6-5fcb-a92a-02bebc918c4c with identifier: SD28198
2026-03-27 10:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84fe5ade-85e6-5fcb-a92a-02bebc918c4c with identifier: SD28198
2026-03-27 10:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84fe5ade-85e6-5fcb-a92a-02bebc918c4c with identifier: SD28198 to the API
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-03-28T16:11:07Z',
'fuel_type': 'petrol',
'id': '84fe5ade-85e6-5fcb-a92a-02bebc918c4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD28198',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 58422,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-08',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 250',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD28198%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [auto1.de] INFO: Saving data for SD28198: {'auction_closing_time': 1774714267.0, 'created_time': 1774349177.001502, 'last_price_update_time': 1774607727.12667}
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD28198') HTTP/1.1" 204 0
2026-03-27 10:35:27 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG44703%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [auto1.de] INFO: Scrape type for NG44703: 1
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_0f84355d21197f322f37257f7368c4ad.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_0f84355d21197f322f37257f7368c4ad.jpg not downloaded yet
2026-03-27 10:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4875374d-89bd-5a6f-bca6-da0fbda33735 with identifier: FB09525
2026-03-27 10:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4875374d-89bd-5a6f-bca6-da0fbda33735 with scrape type 1
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4875374d-89bd-5a6f-bca6-da0fbda33735
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_3921af10622390a5a8382eed4a030385.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_3921af10622390a5a8382eed4a030385.jpg not downloaded yet
2026-03-27 10:35:27 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-27 10:35:27 [auto1.de] INFO: Found listing with ID: LU27790
2026-03-27 10:35:27 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-27 10:35:27 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP18010%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [auto1.de] INFO: Scrape type for HP18010: 2
2026-03-27 10:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ace3c96b-073d-5738-ba17-0aac289b23c1 with identifier: HP18010
2026-03-27 10:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ace3c96b-073d-5738-ba17-0aac289b23c1 with scrape type 2
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ace3c96b-073d-5738-ba17-0aac289b23c1 with scrape type 2
2026-03-27 10:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ace3c96b-073d-5738-ba17-0aac289b23c1, identifier: HP18010
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_0118c85a27062100a3fdd211720d99ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_0118c85a27062100a3fdd211720d99ac.jpg not downloaded yet
2026-03-27 10:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ace3c96b-073d-5738-ba17-0aac289b23c1 with identifier: HP18010
2026-03-27 10:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ace3c96b-073d-5738-ba17-0aac289b23c1 with identifier: HP18010
2026-03-27 10:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ace3c96b-073d-5738-ba17-0aac289b23c1 with identifier: HP18010 to the API
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-28T16:56:25Z',
'fuel_type': 'petrol',
'id': 'ace3c96b-073d-5738-ba17-0aac289b23c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP18010',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 131920,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-01',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2010}
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP18010%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [auto1.de] INFO: Saving data for HP18010: {'auction_closing_time': 1774716985.0, 'created_time': 1773946331.362141, 'last_price_update_time': 1774607727.707585}
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP18010') HTTP/1.1" 204 0
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_4d18243d7ae0715203751fbf7d214dfe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_4d18243d7ae0715203751fbf7d214dfe.jpg not downloaded yet
2026-03-27 10:35:27 [auto1.de] INFO: Found listing with ID: VC15219
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC15219%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [auto1.de] INFO: Scrape type for VC15219: 1
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_126b8fe33d9b03aa1d4b50c512ed3e54.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_126b8fe33d9b03aa1d4b50c512ed3e54.jpg not downloaded yet
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3ac510>
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_6f0a96ff4025dd56c2d14157c82cad99.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_6f0a96ff4025dd56c2d14157c82cad99.jpg saved to cache
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fbdd0925-1030-5135-b202-7815fa866981
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_b5e5d2ef5047e88ce6b2327292212d80.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_b5e5d2ef5047e88ce6b2327292212d80.jpg not downloaded yet
2026-03-27 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE41412/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:27 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-27 10:35:27 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-27 10:35:27 [auto1.de] INFO: Found listing with ID: SJ87943
2026-03-27 10:35:27 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA58010%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [auto1.de] INFO: Scrape type for GA58010: 2
2026-03-27 10:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3407ec16-f216-53cf-8596-04c9d08efdab with identifier: GA58010
2026-03-27 10:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3407ec16-f216-53cf-8596-04c9d08efdab with scrape type 2
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3407ec16-f216-53cf-8596-04c9d08efdab with scrape type 2
2026-03-27 10:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3407ec16-f216-53cf-8596-04c9d08efdab, identifier: GA58010
2026-03-27 10:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3407ec16-f216-53cf-8596-04c9d08efdab with identifier: GA58010
2026-03-27 10:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3407ec16-f216-53cf-8596-04c9d08efdab with identifier: GA58010
2026-03-27 10:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3407ec16-f216-53cf-8596-04c9d08efdab with identifier: GA58010 to the API
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:05:03Z',
'fuel_type': 'petrol',
'id': '3407ec16-f216-53cf-8596-04c9d08efdab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA58010',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 87839,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-15',
'seller_name': None,
'title': 'Skoda Fabia 1.0 TSI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2023}
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA58010%27 HTTP/1.1" 200 None
2026-03-27 10:35:28 [auto1.de] INFO: Saving data for GA58010: {'auction_closing_time': 1774713903.0, 'created_time': 1774032456.724292, 'last_price_update_time': 1774607728.44559}
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA58010') HTTP/1.1" 204 0
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_0f168bfd3f2ac31d4bec10d008ab8cf8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_0f168bfd3f2ac31d4bec10d008ab8cf8.jpg not downloaded yet
2026-03-27 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE52893> (referer: https://www.auto1.com/v1/car-details-view/SE52893/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ46577/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR35268/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:28 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF59303%27 HTTP/1.1" 200 None
2026-03-27 10:35:28 [auto1.de] INFO: Scrape type for DF59303: 2
2026-03-27 10:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dec8777f-db22-5074-8234-bea71fe8a5c3 with identifier: DF59303
2026-03-27 10:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dec8777f-db22-5074-8234-bea71fe8a5c3 with scrape type 2
2026-03-27 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dec8777f-db22-5074-8234-bea71fe8a5c3 with scrape type 2
2026-03-27 10:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dec8777f-db22-5074-8234-bea71fe8a5c3, identifier: DF59303
2026-03-27 10:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dec8777f-db22-5074-8234-bea71fe8a5c3 with identifier: DF59303
2026-03-27 10:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dec8777f-db22-5074-8234-bea71fe8a5c3 with identifier: DF59303
2026-03-27 10:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dec8777f-db22-5074-8234-bea71fe8a5c3 with identifier: DF59303 to the API
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:33:30Z',
'fuel_type': 'petrol',
'id': 'dec8777f-db22-5074-8234-bea71fe8a5c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF59303',
'listing': 'auction',
'make': 'Fiat',
'model': '500C',
'odometer': 19573,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-27',
'seller_name': None,
'title': 'Fiat 500C 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2017}
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF59303%27 HTTP/1.1" 200 None
2026-03-27 10:35:28 [auto1.de] INFO: Saving data for DF59303: {'auction_closing_time': 1774715610.0, 'created_time': 1774349141.749505, 'last_price_update_time': 1774607728.964611}
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF59303') HTTP/1.1" 204 0
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_0813dd3b360d46e87e03c4ccca43599d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_0813dd3b360d46e87e03c4ccca43599d.jpg not downloaded yet
2026-03-27 10:35:29 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-27 10:35:29 [auto1.de] INFO: Found listing with ID: MA93398
2026-03-27 10:35:29 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU49821%27 HTTP/1.1" 200 None
2026-03-27 10:35:29 [auto1.de] INFO: Scrape type for TU49821: 1
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_2eddd9406f07b7d5d824f90333056448.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_2eddd9406f07b7d5d824f90333056448.jpg not downloaded yet
2026-03-27 10:35:29 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG74532%27 HTTP/1.1" 200 None
2026-03-27 10:35:29 [auto1.de] INFO: Scrape type for CG74532: 2
2026-03-27 10:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a58d5979-6367-5f36-826c-2bb8c4b2a739 with identifier: CG74532
2026-03-27 10:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a58d5979-6367-5f36-826c-2bb8c4b2a739 with scrape type 2
2026-03-27 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a58d5979-6367-5f36-826c-2bb8c4b2a739 with scrape type 2
2026-03-27 10:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a58d5979-6367-5f36-826c-2bb8c4b2a739, identifier: CG74532
2026-03-27 10:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF20593/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VD47640> (referer: https://www.auto1.com/v1/car-details-view/VD47640/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:29 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 10493 | hits on page: 40
2026-03-27 10:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fb4b2bf-cac9-5128-a161-31ade47b4930 with identifier: SE52893
2026-03-27 10:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fb4b2bf-cac9-5128-a161-31ade47b4930 with scrape type 1
2026-03-27 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3fb4b2bf-cac9-5128-a161-31ade47b4930
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_b5e2e66ed7c569fec2d4b67b5650276b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_b5e2e66ed7c569fec2d4b67b5650276b.jpg not downloaded yet
2026-03-27 10:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a58d5979-6367-5f36-826c-2bb8c4b2a739 with identifier: CG74532
2026-03-27 10:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a58d5979-6367-5f36-826c-2bb8c4b2a739 with identifier: CG74532
2026-03-27 10:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a58d5979-6367-5f36-826c-2bb8c4b2a739 with identifier: CG74532 to the API
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-28T16:44:52Z',
'fuel_type': 'diesel',
'id': 'a58d5979-6367-5f36-826c-2bb8c4b2a739',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG74532',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 125978,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-23',
'seller_name': None,
'title': 'Audi A6 40 TDI Mild-Hybrid Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2019}
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG74532%27 HTTP/1.1" 200 None
2026-03-27 10:35:29 [auto1.de] INFO: Saving data for CG74532: {'auction_closing_time': 1774716292.0, 'created_time': 1773308375.619079, 'last_price_update_time': 1774607729.644308}
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG74532') HTTP/1.1" 204 0
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_2ae3a6f57316811e2abccb032b394048.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_2ae3a6f57316811e2abccb032b394048.jpg not downloaded yet
2026-03-27 10:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:29 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF30572%27 HTTP/1.1" 200 None
2026-03-27 10:35:29 [auto1.de] INFO: Scrape type for DF30572: 1
2026-03-27 10:35:29 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM23375%27 HTTP/1.1" 200 None
2026-03-27 10:35:29 [auto1.de] INFO: Scrape type for PM23375: 2
2026-03-27 10:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91f7cf98-31ce-5b5c-9c20-140c62704a58 with identifier: PM23375
2026-03-27 10:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91f7cf98-31ce-5b5c-9c20-140c62704a58 with scrape type 2
2026-03-27 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91f7cf98-31ce-5b5c-9c20-140c62704a58 with scrape type 2
2026-03-27 10:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91f7cf98-31ce-5b5c-9c20-140c62704a58, identifier: PM23375
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_b2441d873a8e32edbfd3e3e12cf70160.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_b2441d873a8e32edbfd3e3e12cf70160.jpg not downloaded yet
2026-03-27 10:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_b5e5d2ef5047e88ce6b2327292212d80.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_4d18243d7ae0715203751fbf7d214dfe.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_f934f161dc4d1bf16134a4632135e7f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_f934f161dc4d1bf16134a4632135e7f4.jpg not downloaded yet
2026-03-27 10:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91f7cf98-31ce-5b5c-9c20-140c62704a58 with identifier: PM23375
2026-03-27 10:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91f7cf98-31ce-5b5c-9c20-140c62704a58 with identifier: PM23375
2026-03-27 10:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91f7cf98-31ce-5b5c-9c20-140c62704a58 with identifier: PM23375 to the API
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:43:31Z',
'fuel_type': 'diesel',
'id': '91f7cf98-31ce-5b5c-9c20-140c62704a58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM23375',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 204176,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-03',
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2014}
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM23375%27 HTTP/1.1" 200 None
2026-03-27 10:35:30 [auto1.de] INFO: Saving data for PM23375: {'auction_closing_time': 1774716211.0, 'created_time': 1774349164.412524, 'last_price_update_time': 1774607730.242991}
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM23375') HTTP/1.1" 204 0
2026-03-27 10:35:30 [auto1.de] INFO: Found listing with ID: CH55650
2026-03-27 10:35:30 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK07133%27 HTTP/1.1" 200 None
2026-03-27 10:35:30 [auto1.de] INFO: Scrape type for CK07133: 1
2026-03-27 10:35:30 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ37067%27 HTTP/1.1" 200 None
2026-03-27 10:35:30 [auto1.de] INFO: Scrape type for UZ37067: 1
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_a5f26a84f349e0cbf3db925f42429f55.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_a5f26a84f349e0cbf3db925f42429f55.jpg not downloaded yet
2026-03-27 10:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54967f61-1aaa-5902-8603-1d7d74a7eb13 with identifier: VD47640
2026-03-27 10:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54967f61-1aaa-5902-8603-1d7d74a7eb13 with scrape type 1
2026-03-27 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 54967f61-1aaa-5902-8603-1d7d74a7eb13
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F29%252Ff2297f8a2141cd2caa703c715a5d524f%252Fpa%252FVD47640_c092ed10152f228d1c8673f7fc80ea18.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/29/f2297f8a2141cd2caa703c715a5d524f/pa/VD47640_c092ed10152f228d1c8673f7fc80ea18.jpg already downloaded
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F29%252Ff2297f8a2141cd2caa703c715a5d524f%252Fpa%252FVD47640_94d48a13c0716e6586ea62794315aafb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/29/f2297f8a2141cd2caa703c715a5d524f/pa/VD47640_94d48a13c0716e6586ea62794315aafb.jpg already downloaded
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F29%252Ff2297f8a2141cd2caa703c715a5d524f%252Fpa%252FVD47640_944023b82b45891e7c51c29a403bfe40.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/29/f2297f8a2141cd2caa703c715a5d524f/pa/VD47640_944023b82b45891e7c51c29a403bfe40.jpg already downloaded
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F29%252Ff2297f8a2141cd2caa703c715a5d524f%252Fpa%252FVD47640_0002e4596d2c15f1ed3f01e2ab524062.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/29/f2297f8a2141cd2caa703c715a5d524f/pa/VD47640_0002e4596d2c15f1ed3f01e2ab524062.jpg already downloaded
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F29%252Ff2297f8a2141cd2caa703c715a5d524f%252Fpa%252FVD47640_a13478835716ce380558eefca4318c2b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/29/f2297f8a2141cd2caa703c715a5d524f/pa/VD47640_a13478835716ce380558eefca4318c2b.jpg already downloaded
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F29%252Ff2297f8a2141cd2caa703c715a5d524f%252Fpa%252FVD47640_b295b119d28be736dbaae576096278d9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/29/f2297f8a2141cd2caa703c715a5d524f/pa/VD47640_b295b119d28be736dbaae576096278d9.jpg already downloaded
2026-03-27 10:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54967f61-1aaa-5902-8603-1d7d74a7eb13, identifier: VD47640
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_09b71d89fdfe984f05676ae5ce93130b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_09b71d89fdfe984f05676ae5ce93130b.jpg not downloaded yet
2026-03-27 10:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54967f61-1aaa-5902-8603-1d7d74a7eb13 with identifier: VD47640
2026-03-27 10:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54967f61-1aaa-5902-8603-1d7d74a7eb13 with identifier: VD47640
2026-03-27 10:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54967f61-1aaa-5902-8603-1d7d74a7eb13 with identifier: VD47640 to the API
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VD47640>
{'auction_title': '',
'c_o_2_emission_value': 193,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:56:00Z',
'fuel_type': 'petrol',
'id': '54967f61-1aaa-5902-8603-1d7d74a7eb13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD47640',
'listing': 'auction',
'location': 'DE, Schweitenkirchen',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 282939,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgf2/29/f2297f8a2141cd2caa703c715a5d524f/pa/VD47640_c092ed10152f228d1c8673f7fc80ea18.jpg',
'https://img-pa.auto1.com/imgf2/29/f2297f8a2141cd2caa703c715a5d524f/pa/VD47640_94d48a13c0716e6586ea62794315aafb.jpg',
'https://img-pa.auto1.com/imgf2/29/f2297f8a2141cd2caa703c715a5d524f/pa/VD47640_944023b82b45891e7c51c29a403bfe40.jpg',
'https://img-pa.auto1.com/imgf2/29/f2297f8a2141cd2caa703c715a5d524f/pa/VD47640_0002e4596d2c15f1ed3f01e2ab524062.jpg',
'https://img-pa.auto1.com/imgf2/29/f2297f8a2141cd2caa703c715a5d524f/pa/VD47640_a13478835716ce380558eefca4318c2b.jpg',
'https://img-pa.auto1.com/imgf2/29/f2297f8a2141cd2caa703c715a5d524f/pa/VD47640_b295b119d28be736dbaae576096278d9.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54967f61-1aaa-5902-8603-1d7d74a7eb13/54967f61-1aaa-5902-8603-1d7d74a7eb13_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103286,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/29/f2297f8a2141cd2caa703c715a5d524f/pa/VD47640_c092ed10152f228d1c8673f7fc80ea18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54967f61-1aaa-5902-8603-1d7d74a7eb13/54967f61-1aaa-5902-8603-1d7d74a7eb13_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/29/f2297f8a2141cd2caa703c715a5d524f/pa/VD47640_94d48a13c0716e6586ea62794315aafb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54967f61-1aaa-5902-8603-1d7d74a7eb13/54967f61-1aaa-5902-8603-1d7d74a7eb13_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84163,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/29/f2297f8a2141cd2caa703c715a5d524f/pa/VD47640_944023b82b45891e7c51c29a403bfe40.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54967f61-1aaa-5902-8603-1d7d74a7eb13/54967f61-1aaa-5902-8603-1d7d74a7eb13_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90192,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/29/f2297f8a2141cd2caa703c715a5d524f/pa/VD47640_0002e4596d2c15f1ed3f01e2ab524062.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54967f61-1aaa-5902-8603-1d7d74a7eb13/54967f61-1aaa-5902-8603-1d7d74a7eb13_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/29/f2297f8a2141cd2caa703c715a5d524f/pa/VD47640_a13478835716ce380558eefca4318c2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54967f61-1aaa-5902-8603-1d7d74a7eb13/54967f61-1aaa-5902-8603-1d7d74a7eb13_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40307,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/29/f2297f8a2141cd2caa703c715a5d524f/pa/VD47640_b295b119d28be736dbaae576096278d9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-07-24',
'seats_number': 7,
'seller_name': None,
'title': 'Volkswagen Touran 1.6 United',
'transmission': 'manual',
'trim': 'United',
'year': 2008}
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD47640%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [auto1.de] INFO: Saving data for VD47640: {'created_time': 1774607731.474976, 'last_price_update_time': 1774607731.474991, 'auction_closing_time': 1774716960.0}
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VD47640') HTTP/1.1" 204 0
2026-03-27 10:35:31 [auto1.de] INFO: Found listing with ID: TX89120
2026-03-27 10:35:31 [auto1.de] INFO: Found listing with ID: XH18940
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH18940%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [auto1.de] INFO: Scrape type for XH18940: 1
2026-03-27 10:35:31 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY87564%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [auto1.de] INFO: Scrape type for WY87564: 1
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_5fbbb174b2b0d631e1d0f39ac9353ab8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_5fbbb174b2b0d631e1d0f39ac9353ab8.jpg not downloaded yet
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_63a98f65c48bb0ac203169d90fbcf075.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_63a98f65c48bb0ac203169d90fbcf075.jpg not downloaded yet
2026-03-27 10:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf83850>
2026-03-27 10:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_b5e5d2ef5047e88ce6b2327292212d80.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_b5e5d2ef5047e88ce6b2327292212d80.jpg saved to cache
2026-03-27 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4875374d-89bd-5a6f-bca6-da0fbda33735
2026-03-27 10:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0e2b10>
2026-03-27 10:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_4d18243d7ae0715203751fbf7d214dfe.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_4d18243d7ae0715203751fbf7d214dfe.jpg saved to cache
2026-03-27 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4875374d-89bd-5a6f-bca6-da0fbda33735
2026-03-27 10:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_b5e2e66ed7c569fec2d4b67b5650276b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_2ae3a6f57316811e2abccb032b394048.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:31 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-27 10:35:31 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-27 10:35:31 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE25239%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [auto1.de] INFO: Scrape type for BE25239: 2
2026-03-27 10:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1e4a606-ed58-50e2-98b1-5cd386f24c2e with identifier: BE25239
2026-03-27 10:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1e4a606-ed58-50e2-98b1-5cd386f24c2e with scrape type 2
2026-03-27 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1e4a606-ed58-50e2-98b1-5cd386f24c2e with scrape type 2
2026-03-27 10:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1e4a606-ed58-50e2-98b1-5cd386f24c2e, identifier: BE25239
2026-03-27 10:35:31 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06812%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [auto1.de] INFO: Scrape type for SC06812: 2
2026-03-27 10:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 714de284-560f-5487-aac2-29f81829d383 with identifier: SC06812
2026-03-27 10:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 714de284-560f-5487-aac2-29f81829d383 with scrape type 2
2026-03-27 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 714de284-560f-5487-aac2-29f81829d383 with scrape type 2
2026-03-27 10:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 714de284-560f-5487-aac2-29f81829d383, identifier: SC06812
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_9de636dbaef46f1aaaa02369d6dafc57.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_9de636dbaef46f1aaaa02369d6dafc57.jpg not downloaded yet
2026-03-27 10:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK20534/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ23226> (referer: https://www.auto1.com/v1/car-details-view/KZ23226/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1e4a606-ed58-50e2-98b1-5cd386f24c2e with identifier: BE25239
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-27 10:35:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1e4a606-ed58-50e2-98b1-5cd386f24c2e with identifier: BE25239
2026-03-27 10:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1e4a606-ed58-50e2-98b1-5cd386f24c2e with identifier: BE25239 to the API
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:49:57Z',
'fuel_type': 'gas',
'id': 'a1e4a606-ed58-50e2-98b1-5cd386f24c2e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE25239',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 158666,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-02',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 Kasten EcoFuel',
'transmission': 'manual',
'trim': 'Kasten EcoFuel',
'year': 2009}
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE25239%27 HTTP/1.1" 200 None
2026-03-27 10:35:32 [auto1.de] INFO: Saving data for BE25239: {'auction_closing_time': 1774716597.0, 'created_time': 1774349139.776538, 'last_price_update_time': 1774607732.454396}
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE25239') HTTP/1.1" 204 0
2026-03-27 10:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 714de284-560f-5487-aac2-29f81829d383 with identifier: SC06812
2026-03-27 10:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 714de284-560f-5487-aac2-29f81829d383 with identifier: SC06812
2026-03-27 10:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 714de284-560f-5487-aac2-29f81829d383 with identifier: SC06812 to the API
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:57:55Z',
'fuel_type': 'petrol',
'id': '714de284-560f-5487-aac2-29f81829d383',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC06812',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 68460,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-04',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TSI 4Motion BlueMotion',
'transmission': 'automatic',
'trim': '4Motion BlueMotion',
'year': 2019}
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06812%27 HTTP/1.1" 200 None
2026-03-27 10:35:32 [auto1.de] INFO: Saving data for SC06812: {'auction_closing_time': 1774717075.0, 'created_time': 1773917487.315556, 'last_price_update_time': 1774607732.825501}
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC06812') HTTP/1.1" 204 0
2026-03-27 10:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:32 [auto1.de] INFO: Found listing with ID: JN21638
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN21638%27 HTTP/1.1" 200 None
2026-03-27 10:35:32 [auto1.de] INFO: Scrape type for JN21638: 1
2026-03-27 10:35:32 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF78558%27 HTTP/1.1" 200 None
2026-03-27 10:35:32 [auto1.de] INFO: Scrape type for YF78558: 1
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_cdcd9ab5e6b23305811e5356ed4a719b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_cdcd9ab5e6b23305811e5356ed4a719b.jpg not downloaded yet
2026-03-27 10:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DU13341> (referer: https://www.auto1.com/v1/car-details-view/DU13341/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be176a90>
2026-03-27 10:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_b5e2e66ed7c569fec2d4b67b5650276b.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_b5e2e66ed7c569fec2d4b67b5650276b.jpg saved to cache
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fb4b2bf-cac9-5128-a161-31ade47b4930
2026-03-27 10:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be075550>
2026-03-27 10:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_2ae3a6f57316811e2abccb032b394048.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_2ae3a6f57316811e2abccb032b394048.jpg saved to cache
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4875374d-89bd-5a6f-bca6-da0fbda33735
2026-03-27 10:35:33 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-27 10:35:33 [auto1.de] INFO: Found listing with ID: HL08327
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL08327%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [auto1.de] INFO: Scrape type for HL08327: 1
2026-03-27 10:35:33 [auto1.de] INFO: Found listing with ID: LA14502
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA14502%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [auto1.de] INFO: Scrape type for LA14502: 1
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_243be1a76f7e845b3edfb3d287ae0084.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_243be1a76f7e845b3edfb3d287ae0084.jpg not downloaded yet
2026-03-27 10:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0207ab47-9552-5274-a98e-1707cca2d7f1 with identifier: KZ23226
2026-03-27 10:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0207ab47-9552-5274-a98e-1707cca2d7f1 with scrape type 1
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0207ab47-9552-5274-a98e-1707cca2d7f1
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_fa17c131f70adc323191eb4677807a3f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_fa17c131f70adc323191eb4677807a3f.jpg not downloaded yet
2026-03-27 10:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_5fbbb174b2b0d631e1d0f39ac9353ab8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_63a98f65c48bb0ac203169d90fbcf075.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:33 [auto1.de] INFO: Found listing with ID: PS35101
2026-03-27 10:35:33 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-27 10:35:33 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-27 10:35:33 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-27 10:35:33 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-27 10:35:33 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC05156%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [auto1.de] INFO: Scrape type for GC05156: 1
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_c1777c169558386f29fd90a6f5d29882.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_c1777c169558386f29fd90a6f5d29882.jpg not downloaded yet
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_7c365458c919bd6edf38b236c1430c1d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_7c365458c919bd6edf38b236c1430c1d.jpg not downloaded yet
2026-03-27 10:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 024715b1-48ce-5f67-9e2a-0cc581d891d5 with identifier: DU13341
2026-03-27 10:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 024715b1-48ce-5f67-9e2a-0cc581d891d5 with scrape type 1
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 024715b1-48ce-5f67-9e2a-0cc581d891d5
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F4b%252Fb64b72e8a11dd5ae42ec5b31c1a9480b%252Fpa%252FDU13341_9f330b8de84ce32200d4e66c0823ded2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_9f330b8de84ce32200d4e66c0823ded2.jpg already downloaded
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F4b%252Fb64b72e8a11dd5ae42ec5b31c1a9480b%252Fpa%252FDU13341_3806f7840dad2a0bb00fa25d4aa62e70.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_3806f7840dad2a0bb00fa25d4aa62e70.jpg already downloaded
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F4b%252Fb64b72e8a11dd5ae42ec5b31c1a9480b%252Fpa%252FDU13341_a57c5bb99fc42a633695b2575e5d61f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_a57c5bb99fc42a633695b2575e5d61f5.jpg already downloaded
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F4b%252Fb64b72e8a11dd5ae42ec5b31c1a9480b%252Fpa%252FDU13341_e0ed6980d2c49e462d6a9032f0024895.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_e0ed6980d2c49e462d6a9032f0024895.jpg already downloaded
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F4b%252Fb64b72e8a11dd5ae42ec5b31c1a9480b%252Fpa%252FDU13341_d8a72400d8fa12d2fe9ff55e4b0b9c6a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_d8a72400d8fa12d2fe9ff55e4b0b9c6a.jpg already downloaded
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F4b%252Fb64b72e8a11dd5ae42ec5b31c1a9480b%252Fpa%252FDU13341_0b0eeeeb1f5670bc1d4902d6b220258d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_0b0eeeeb1f5670bc1d4902d6b220258d.jpg already downloaded
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F4b%252Fb64b72e8a11dd5ae42ec5b31c1a9480b%252Fpa%252FDU13341_9adeb01c4d77b5b8267f89900f08d222.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_9adeb01c4d77b5b8267f89900f08d222.jpg already downloaded
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F4b%252Fb64b72e8a11dd5ae42ec5b31c1a9480b%252Fpa%252FDU13341_4e207e32914fb6be956be7ee0ba02b14.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_4e207e32914fb6be956be7ee0ba02b14.jpg already downloaded
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F4b%252Fb64b72e8a11dd5ae42ec5b31c1a9480b%252Fpa%252FDU13341_ae5c6402adfb5710f0e40b769d38c96e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_ae5c6402adfb5710f0e40b769d38c96e.jpg already downloaded
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F4b%252Fb64b72e8a11dd5ae42ec5b31c1a9480b%252Fpa%252FDU13341_ca590845a713c3817eda88c1e63dcf27.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_ca590845a713c3817eda88c1e63dcf27.jpg already downloaded
2026-03-27 10:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 024715b1-48ce-5f67-9e2a-0cc581d891d5, identifier: DU13341
2026-03-27 10:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_4333fcf6635963eaea9477ee1a6cc6d7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 024715b1-48ce-5f67-9e2a-0cc581d891d5 with identifier: DU13341
2026-03-27 10:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 024715b1-48ce-5f67-9e2a-0cc581d891d5 with identifier: DU13341
2026-03-27 10:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 024715b1-48ce-5f67-9e2a-0cc581d891d5 with identifier: DU13341 to the API
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DU13341>
{'auction_title': '',
'c_o_2_emission_value': 177,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:37:49Z',
'fuel_type': 'diesel',
'id': '024715b1-48ce-5f67-9e2a-0cc581d891d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU13341',
'listing': 'auction',
'location': 'DE, Ketzin',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 89534,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_9f330b8de84ce32200d4e66c0823ded2.jpg',
'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_3806f7840dad2a0bb00fa25d4aa62e70.jpg',
'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_a57c5bb99fc42a633695b2575e5d61f5.jpg',
'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_e0ed6980d2c49e462d6a9032f0024895.jpg',
'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_d8a72400d8fa12d2fe9ff55e4b0b9c6a.jpg',
'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_0b0eeeeb1f5670bc1d4902d6b220258d.jpg',
'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_9adeb01c4d77b5b8267f89900f08d222.jpg',
'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_4e207e32914fb6be956be7ee0ba02b14.jpg',
'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_ae5c6402adfb5710f0e40b769d38c96e.jpg',
'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_ca590845a713c3817eda88c1e63dcf27.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024715b1-48ce-5f67-9e2a-0cc581d891d5/024715b1-48ce-5f67-9e2a-0cc581d891d5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_9f330b8de84ce32200d4e66c0823ded2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024715b1-48ce-5f67-9e2a-0cc581d891d5/024715b1-48ce-5f67-9e2a-0cc581d891d5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70310,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_3806f7840dad2a0bb00fa25d4aa62e70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024715b1-48ce-5f67-9e2a-0cc581d891d5/024715b1-48ce-5f67-9e2a-0cc581d891d5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_a57c5bb99fc42a633695b2575e5d61f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024715b1-48ce-5f67-9e2a-0cc581d891d5/024715b1-48ce-5f67-9e2a-0cc581d891d5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53103,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_e0ed6980d2c49e462d6a9032f0024895.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024715b1-48ce-5f67-9e2a-0cc581d891d5/024715b1-48ce-5f67-9e2a-0cc581d891d5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_d8a72400d8fa12d2fe9ff55e4b0b9c6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024715b1-48ce-5f67-9e2a-0cc581d891d5/024715b1-48ce-5f67-9e2a-0cc581d891d5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_0b0eeeeb1f5670bc1d4902d6b220258d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024715b1-48ce-5f67-9e2a-0cc581d891d5/024715b1-48ce-5f67-9e2a-0cc581d891d5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55103,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_9adeb01c4d77b5b8267f89900f08d222.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024715b1-48ce-5f67-9e2a-0cc581d891d5/024715b1-48ce-5f67-9e2a-0cc581d891d5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_4e207e32914fb6be956be7ee0ba02b14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024715b1-48ce-5f67-9e2a-0cc581d891d5/024715b1-48ce-5f67-9e2a-0cc581d891d5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72991,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_ae5c6402adfb5710f0e40b769d38c96e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024715b1-48ce-5f67-9e2a-0cc581d891d5/024715b1-48ce-5f67-9e2a-0cc581d891d5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74066,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/4b/b64b72e8a11dd5ae42ec5b31c1a9480b/pa/DU13341_ca590845a713c3817eda88c1e63dcf27.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-20',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI Xcellence',
'transmission': 'automatic',
'trim': 'Xcellence',
'year': 2019}
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13341%27 HTTP/1.1" 200 None
2026-03-27 10:35:34 [auto1.de] INFO: Saving data for DU13341: {'created_time': 1774607734.573263, 'last_price_update_time': 1774607734.573275, 'auction_closing_time': 1774715869.0}
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU13341') HTTP/1.1" 204 0
2026-03-27 10:35:34 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT57416%27 HTTP/1.1" 200 None
2026-03-27 10:35:34 [auto1.de] INFO: Scrape type for GT57416: 1
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_78810a509b651d414e46e88cf01bb5bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_78810a509b651d414e46e88cf01bb5bf.jpg not downloaded yet
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_382c0487c1dd6056f6123b43a25b1b0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_382c0487c1dd6056f6123b43a25b1b0f.jpg not downloaded yet
2026-03-27 10:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_cdcd9ab5e6b23305811e5356ed4a719b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ13308> (referer: https://www.auto1.com/v1/car-details-view/MJ13308/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4693d0>
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_5fbbb174b2b0d631e1d0f39ac9353ab8.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_5fbbb174b2b0d631e1d0f39ac9353ab8.jpg saved to cache
2026-03-27 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3fb4b2bf-cac9-5128-a161-31ade47b4930
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1ebb90>
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_63a98f65c48bb0ac203169d90fbcf075.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_63a98f65c48bb0ac203169d90fbcf075.jpg saved to cache
2026-03-27 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4875374d-89bd-5a6f-bca6-da0fbda33735
2026-03-27 10:35:34 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-27 10:35:34 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-27 10:35:34 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-27 10:35:34 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-27 10:35:34 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-27 10:35:34 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-27 10:35:34 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR92717%27 HTTP/1.1" 200 None
2026-03-27 10:35:34 [auto1.de] INFO: Scrape type for FR92717: 1
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_02e87f12dcef21484f44cca800ff18b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_02e87f12dcef21484f44cca800ff18b3.jpg not downloaded yet
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_761e72865feb52bb9eb882835c692921.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_761e72865feb52bb9eb882835c692921.jpg not downloaded yet
2026-03-27 10:35:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC15219/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP53971> (referer: https://www.auto1.com/v1/car-details-view/VP53971/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1fa810>
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_4333fcf6635963eaea9477ee1a6cc6d7.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_4333fcf6635963eaea9477ee1a6cc6d7.jpg saved to cache
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2636e10-6ba9-578c-ada5-3013d96fdaad
2026-03-27 10:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_fa17c131f70adc323191eb4677807a3f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:35 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA25367%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [auto1.de] INFO: Scrape type for TA25367: 2
2026-03-27 10:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf71b327-e82d-5cef-afeb-feb0ae5d4c17 with identifier: TA25367
2026-03-27 10:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf71b327-e82d-5cef-afeb-feb0ae5d4c17 with scrape type 2
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf71b327-e82d-5cef-afeb-feb0ae5d4c17 with scrape type 2
2026-03-27 10:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf71b327-e82d-5cef-afeb-feb0ae5d4c17, identifier: TA25367
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_df6f41ee4ead0f711354f0a306672cc4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_df6f41ee4ead0f711354f0a306672cc4.jpg not downloaded yet
2026-03-27 10:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_6e87a9ef707ed3628429bad6c65b818e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_243be1a76f7e845b3edfb3d287ae0084.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf71b327-e82d-5cef-afeb-feb0ae5d4c17 with identifier: TA25367
2026-03-27 10:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf71b327-e82d-5cef-afeb-feb0ae5d4c17 with identifier: TA25367
2026-03-27 10:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf71b327-e82d-5cef-afeb-feb0ae5d4c17 with identifier: TA25367 to the API
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:22:30Z',
'fuel_type': 'petrol',
'id': 'cf71b327-e82d-5cef-afeb-feb0ae5d4c17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA25367',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 145336,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-09-30',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 240 Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 1998}
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA25367%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [auto1.de] INFO: Saving data for TA25367: {'auction_closing_time': 1774714950.0, 'created_time': 1774032971.618361, 'last_price_update_time': 1774607735.6273}
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA25367') HTTP/1.1" 204 0
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be074a90>
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_cdcd9ab5e6b23305811e5356ed4a719b.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_cdcd9ab5e6b23305811e5356ed4a719b.jpg saved to cache
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3fb4b2bf-cac9-5128-a161-31ade47b4930
2026-03-27 10:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 008cc6e2-55c5-5480-8821-9f7a501d47fe with identifier: MJ13308
2026-03-27 10:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 008cc6e2-55c5-5480-8821-9f7a501d47fe with scrape type 1
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 008cc6e2-55c5-5480-8821-9f7a501d47fe
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_d79b80bcba23b048d2c342abbf868c62.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_d79b80bcba23b048d2c342abbf868c62.jpg not downloaded yet
2026-03-27 10:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4 with identifier: VP53971
2026-03-27 10:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4 with scrape type 1
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_46a9aafee079d910853a6e355f1b71ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_46a9aafee079d910853a6e355f1b71ab.jpg not downloaded yet
2026-03-27 10:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_bd1b4ae32e96bdf859ebb761c30bbca1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:35 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN18911%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [auto1.de] INFO: Scrape type for RN18911: 1
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_78cef2912ae2c7d755083a9fb608e499.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_78cef2912ae2c7d755083a9fb608e499.jpg not downloaded yet
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_a9a3d8479be7ffa75779e88f71d83996.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_a9a3d8479be7ffa75779e88f71d83996.jpg not downloaded yet
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_72ef8cfada6f3607c106623c57382f19.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_72ef8cfada6f3607c106623c57382f19.jpg not downloaded yet
2026-03-27 10:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_382c0487c1dd6056f6123b43a25b1b0f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_78810a509b651d414e46e88cf01bb5bf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:35 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF38507%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [auto1.de] INFO: Scrape type for DF38507: 1
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_92025e51a72c2ed23774cec7d50e8ba4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_92025e51a72c2ed23774cec7d50e8ba4.jpg not downloaded yet
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf48f090>
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_fa17c131f70adc323191eb4677807a3f.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_fa17c131f70adc323191eb4677807a3f.jpg saved to cache
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0207ab47-9552-5274-a98e-1707cca2d7f1
2026-03-27 10:35:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf37be90>
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_6e87a9ef707ed3628429bad6c65b818e.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_6e87a9ef707ed3628429bad6c65b818e.jpg saved to cache
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fbdd0925-1030-5135-b202-7815fa866981
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3709d0>
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_243be1a76f7e845b3edfb3d287ae0084.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_243be1a76f7e845b3edfb3d287ae0084.jpg saved to cache
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3fb4b2bf-cac9-5128-a161-31ade47b4930
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_4ed6991dcb8a6390507983199d3cc80b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_4ed6991dcb8a6390507983199d3cc80b.jpg not downloaded yet
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_a29ce574a3360f49b9c0821d3940ffeb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_a29ce574a3360f49b9c0821d3940ffeb.jpg not downloaded yet
2026-03-27 10:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_761e72865feb52bb9eb882835c692921.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_c1777c169558386f29fd90a6f5d29882.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_02e87f12dcef21484f44cca800ff18b3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:36 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-27 10:35:36 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC10304%27 HTTP/1.1" 200 None
2026-03-27 10:35:36 [auto1.de] INFO: Scrape type for SC10304: 1
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_bab6d0a5d4fffcfc9d6d8e1fd624e89e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_bab6d0a5d4fffcfc9d6d8e1fd624e89e.jpg not downloaded yet
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_6cf369c0da9d9789a2ac5d18d8127952.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_6cf369c0da9d9789a2ac5d18d8127952.jpg not downloaded yet
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_888d1c9446121fe8797aa298c83a486c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_888d1c9446121fe8797aa298c83a486c.jpg not downloaded yet
2026-03-27 10:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:36 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM45973%27 HTTP/1.1" 200 None
2026-03-27 10:35:36 [auto1.de] INFO: Scrape type for GM45973: 2
2026-03-27 10:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85a4af3a-454f-5c05-968d-10cbc315d670 with identifier: GM45973
2026-03-27 10:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85a4af3a-454f-5c05-968d-10cbc315d670 with scrape type 2
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85a4af3a-454f-5c05-968d-10cbc315d670 with scrape type 2
2026-03-27 10:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85a4af3a-454f-5c05-968d-10cbc315d670, identifier: GM45973
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_d7a7156ce8fafd7ee0d8ac730a16cde0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_d7a7156ce8fafd7ee0d8ac730a16cde0.jpg not downloaded yet
2026-03-27 10:35:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf80850>
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_bd1b4ae32e96bdf859ebb761c30bbca1.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_bd1b4ae32e96bdf859ebb761c30bbca1.jpg saved to cache
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fbdd0925-1030-5135-b202-7815fa866981
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c564f850>
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_382c0487c1dd6056f6123b43a25b1b0f.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_382c0487c1dd6056f6123b43a25b1b0f.jpg saved to cache
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0207ab47-9552-5274-a98e-1707cca2d7f1
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf3b5d0>
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_78810a509b651d414e46e88cf01bb5bf.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_78810a509b651d414e46e88cf01bb5bf.jpg saved to cache
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3fb4b2bf-cac9-5128-a161-31ade47b4930
2026-03-27 10:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85a4af3a-454f-5c05-968d-10cbc315d670 with identifier: GM45973
2026-03-27 10:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85a4af3a-454f-5c05-968d-10cbc315d670 with identifier: GM45973
2026-03-27 10:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85a4af3a-454f-5c05-968d-10cbc315d670 with identifier: GM45973 to the API
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 165,
'expiration_date': '2026-03-28T16:11:34Z',
'fuel_type': 'diesel',
'id': '85a4af3a-454f-5c05-968d-10cbc315d670',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM45973',
'listing': 'auction',
'make': 'Citroen',
'model': 'Jumper',
'odometer': 57890,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-29',
'seller_name': None,
'title': 'Citroen Jumper 2.2 Blue-HDi 33 L2H1 Control Start&Stop',
'transmission': 'manual',
'trim': '33 L2H1 Control Start&Stop',
'year': 2021}
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM45973%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [auto1.de] INFO: Saving data for GM45973: {'auction_closing_time': 1774714294.0, 'created_time': 1773138765.659527, 'last_price_update_time': 1774607737.010905}
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM45973') HTTP/1.1" 204 0
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_2103804fd24f8e24cc5b85be9f98f8cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_2103804fd24f8e24cc5b85be9f98f8cd.jpg not downloaded yet
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_478427d402ef59abbacdb9d353dc98b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_478427d402ef59abbacdb9d353dc98b0.jpg not downloaded yet
2026-03-27 10:35:37 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM57013%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [auto1.de] INFO: Scrape type for YM57013: 1
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_825b1fae5c52a8d8f49793c7608cc010.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_825b1fae5c52a8d8f49793c7608cc010.jpg not downloaded yet
2026-03-27 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_72ef8cfada6f3607c106623c57382f19.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_92025e51a72c2ed23774cec7d50e8ba4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_4ed6991dcb8a6390507983199d3cc80b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_bd14ebf5330e9f3858c59ee50cbdd094.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_bd14ebf5330e9f3858c59ee50cbdd094.jpg not downloaded yet
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_2082cd9518d0dd2fe69253757769f66f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_2082cd9518d0dd2fe69253757769f66f.jpg not downloaded yet
2026-03-27 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ46577> (referer: https://www.auto1.com/v1/car-details-view/SJ46577/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_a29ce574a3360f49b9c0821d3940ffeb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:37 [auto1.de] INFO: Found listing with ID: BR67018
2026-03-27 10:35:37 [auto1.de] INFO: Found listing with ID: EA75512
2026-03-27 10:35:37 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF83806%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [auto1.de] INFO: Scrape type for VF83806: 1
2026-03-27 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XH18940/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY87564/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK20534> (referer: https://www.auto1.com/v1/car-details-view/HK20534/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf83e90>
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_761e72865feb52bb9eb882835c692921.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_761e72865feb52bb9eb882835c692921.jpg saved to cache
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0207ab47-9552-5274-a98e-1707cca2d7f1
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf54b650>
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_c1777c169558386f29fd90a6f5d29882.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_c1777c169558386f29fd90a6f5d29882.jpg saved to cache
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3fb4b2bf-cac9-5128-a161-31ade47b4930
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be221810>
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_02e87f12dcef21484f44cca800ff18b3.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_02e87f12dcef21484f44cca800ff18b3.jpg saved to cache
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3fb4b2bf-cac9-5128-a161-31ade47b4930
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_45eafe435a8e205ac388de980c015e15.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_45eafe435a8e205ac388de980c015e15.jpg not downloaded yet
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_ddc82641f585772470877deabd9d8629.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_ddc82641f585772470877deabd9d8629.jpg not downloaded yet
2026-03-27 10:35:37 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-27 10:35:37 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR33954%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [auto1.de] INFO: Scrape type for AR33954: 2
2026-03-27 10:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08ad8abe-1545-55e5-b297-bf0e512a54f4 with identifier: AR33954
2026-03-27 10:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ad8abe-1545-55e5-b297-bf0e512a54f4 with scrape type 2
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08ad8abe-1545-55e5-b297-bf0e512a54f4 with scrape type 2
2026-03-27 10:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08ad8abe-1545-55e5-b297-bf0e512a54f4, identifier: AR33954
2026-03-27 10:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08ad8abe-1545-55e5-b297-bf0e512a54f4 with identifier: AR33954
2026-03-27 10:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08ad8abe-1545-55e5-b297-bf0e512a54f4 with identifier: AR33954
2026-03-27 10:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08ad8abe-1545-55e5-b297-bf0e512a54f4 with identifier: AR33954 to the API
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:12:15Z',
'fuel_type': 'diesel',
'id': '08ad8abe-1545-55e5-b297-bf0e512a54f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR33954',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 84126,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-11',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Sportline 4x4',
'transmission': 'automatic',
'trim': 'Sportline 4x4',
'year': 2020}
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR33954%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [auto1.de] INFO: Saving data for AR33954: {'auction_closing_time': 1774714335.0, 'created_time': 1773945914.401284, 'last_price_update_time': 1774607737.9196}
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR33954') HTTP/1.1" 204 0
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_4104e72b8e1beffe297125f9d599fd32.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_4104e72b8e1beffe297125f9d599fd32.jpg not downloaded yet
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_50714bdd94df1fbcabd11db4b2fbef8d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_50714bdd94df1fbcabd11db4b2fbef8d.jpg not downloaded yet
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be194750>
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_72ef8cfada6f3607c106623c57382f19.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_72ef8cfada6f3607c106623c57382f19.jpg saved to cache
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf302d0>
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_92025e51a72c2ed23774cec7d50e8ba4.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_92025e51a72c2ed23774cec7d50e8ba4.jpg saved to cache
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0207ab47-9552-5274-a98e-1707cca2d7f1
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1775d0>
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_4ed6991dcb8a6390507983199d3cc80b.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_4ed6991dcb8a6390507983199d3cc80b.jpg saved to cache
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 008cc6e2-55c5-5480-8821-9f7a501d47fe
2026-03-27 10:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6529c2c3-46b8-5cc7-9a3d-02451a5be90b with identifier: SJ46577
2026-03-27 10:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6529c2c3-46b8-5cc7-9a3d-02451a5be90b with scrape type 1
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6529c2c3-46b8-5cc7-9a3d-02451a5be90b
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_7a604d2bb2e305d95a7d1994ef5a6d13.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_7a604d2bb2e305d95a7d1994ef5a6d13.jpg not downloaded yet
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be090ad0>
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_a29ce574a3360f49b9c0821d3940ffeb.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_a29ce574a3360f49b9c0821d3940ffeb.jpg saved to cache
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4
2026-03-27 10:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15c9de2b-0765-5940-928a-adab1f8b7fb2 with identifier: HK20534
2026-03-27 10:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15c9de2b-0765-5940-928a-adab1f8b7fb2 with scrape type 1
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15c9de2b-0765-5940-928a-adab1f8b7fb2
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_f1997ef84a0dd6ee7cfb25b3929bf941.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_f1997ef84a0dd6ee7cfb25b3929bf941.jpg not downloaded yet
2026-03-27 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_2103804fd24f8e24cc5b85be9f98f8cd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:38 [auto1.de] INFO: Found listing with ID: XH92207
2026-03-27 10:35:38 [auto1.de] INFO: Found listing with ID: FL90187
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL90187%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [auto1.de] INFO: Scrape type for FL90187: 1
2026-03-27 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_d7a7156ce8fafd7ee0d8ac730a16cde0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_75929170ba6cc24a431114aff2717f0d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_75929170ba6cc24a431114aff2717f0d.jpg not downloaded yet
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_9c7b858b51bd9679eca4c48b537f8e1f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_9c7b858b51bd9679eca4c48b537f8e1f.jpg not downloaded yet
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_64c5286e5c10196d4726327d17ed6445.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_64c5286e5c10196d4726327d17ed6445.jpg not downloaded yet
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_736f034210e314b10e97fe74a5b5bdb3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_736f034210e314b10e97fe74a5b5bdb3.jpg not downloaded yet
2026-03-27 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_126b8fe33d9b03aa1d4b50c512ed3e54.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_478427d402ef59abbacdb9d353dc98b0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_825b1fae5c52a8d8f49793c7608cc010.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:38 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB38942%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [auto1.de] INFO: Scrape type for WB38942: 2
2026-03-27 10:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab with identifier: WB38942
2026-03-27 10:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab with scrape type 2
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab with scrape type 2
2026-03-27 10:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab, identifier: WB38942
2026-03-27 10:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab with identifier: WB38942
2026-03-27 10:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab with identifier: WB38942
2026-03-27 10:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d45d5e5-db05-5086-b7f8-c10b9b19e8ab with identifier: WB38942 to the API
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-28T16:09:48Z',
'fuel_type': 'diesel',
'id': '2d45d5e5-db05-5086-b7f8-c10b9b19e8ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB38942',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 353125,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-23',
'seller_name': None,
'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
'transmission': 'automatic',
'trim': 'BlueMotion',
'year': 2012}
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB38942%27 HTTP/1.1" 200 None
2026-03-27 10:35:39 [auto1.de] INFO: Saving data for WB38942: {'auction_closing_time': 1774714188.0, 'created_time': 1773830331.780469, 'last_price_update_time': 1774607739.757069}
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB38942') HTTP/1.1" 204 0
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_23c26123b56da18689d671fdebc7b596.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_23c26123b56da18689d671fdebc7b596.jpg not downloaded yet
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_8a6bd098f8d27ccc2eee0c1b49e81d3c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_8a6bd098f8d27ccc2eee0c1b49e81d3c.jpg not downloaded yet
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_8f0ae59d68cbd9caa6f748acd1e5e344.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_8f0ae59d68cbd9caa6f748acd1e5e344.jpg not downloaded yet
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_c0286b593898ae71a6d5b22bd1d1d1ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_c0286b593898ae71a6d5b22bd1d1d1ce.jpg not downloaded yet
2026-03-27 10:35:39 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT08525%27 HTTP/1.1" 200 None
2026-03-27 10:35:39 [auto1.de] INFO: Scrape type for XT08525: 1
2026-03-27 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_888d1c9446121fe8797aa298c83a486c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_bd14ebf5330e9f3858c59ee50cbdd094.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_ddc82641f585772470877deabd9d8629.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_2082cd9518d0dd2fe69253757769f66f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_5664fd5ab600e2fb31080b5cbc5ceaa6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_5664fd5ab600e2fb31080b5cbc5ceaa6.jpg not downloaded yet
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_e1a02e8acb9179ff7f0175e7b76a4072.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_e1a02e8acb9179ff7f0175e7b76a4072.jpg not downloaded yet
2026-03-27 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF38507/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_0f168bfd3f2ac31d4bec10d008ab8cf8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:39 [auto1.de] INFO: Found listing with ID: EX64550
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX64550%27 HTTP/1.1" 200 None
2026-03-27 10:35:39 [auto1.de] INFO: Scrape type for EX64550: 1
2026-03-27 10:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be015810>
2026-03-27 10:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_2103804fd24f8e24cc5b85be9f98f8cd.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_2103804fd24f8e24cc5b85be9f98f8cd.jpg saved to cache
2026-03-27 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 008cc6e2-55c5-5480-8821-9f7a501d47fe
2026-03-27 10:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be261750>
2026-03-27 10:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_d7a7156ce8fafd7ee0d8ac730a16cde0.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_d7a7156ce8fafd7ee0d8ac730a16cde0.jpg saved to cache
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0207ab47-9552-5274-a98e-1707cca2d7f1
2026-03-27 10:35:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf81510>
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_126b8fe33d9b03aa1d4b50c512ed3e54.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_126b8fe33d9b03aa1d4b50c512ed3e54.jpg saved to cache
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fbdd0925-1030-5135-b202-7815fa866981
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be027e50>
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_478427d402ef59abbacdb9d353dc98b0.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_478427d402ef59abbacdb9d353dc98b0.jpg saved to cache
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf41c390>
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_825b1fae5c52a8d8f49793c7608cc010.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_825b1fae5c52a8d8f49793c7608cc010.jpg saved to cache
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0207ab47-9552-5274-a98e-1707cca2d7f1
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_bf443b86ddae92950c099ce5c1b3e9fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_bf443b86ddae92950c099ce5c1b3e9fe.jpg not downloaded yet
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_b3927087f613b16e5c92e8e72f73fd92.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_b3927087f613b16e5c92e8e72f73fd92.jpg not downloaded yet
2026-03-27 10:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_f1997ef84a0dd6ee7cfb25b3929bf941.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:40 [auto1.de] INFO: Found listing with ID: FZ93202
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ93202%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [auto1.de] INFO: Scrape type for FZ93202: 1
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_c880b248ddafadab64bc5cae7f423bc5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_c880b248ddafadab64bc5cae7f423bc5.jpg not downloaded yet
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_ec1b9bbc40e9ae933f63738826b23cc4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_ec1b9bbc40e9ae933f63738826b23cc4.jpg not downloaded yet
2026-03-27 10:35:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:40 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP37345%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [auto1.de] INFO: Scrape type for YP37345: 1
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2621d0>
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_888d1c9446121fe8797aa298c83a486c.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_888d1c9446121fe8797aa298c83a486c.jpg saved to cache
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf06d10>
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_bd14ebf5330e9f3858c59ee50cbdd094.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_bd14ebf5330e9f3858c59ee50cbdd094.jpg saved to cache
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 008cc6e2-55c5-5480-8821-9f7a501d47fe
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1bccd0>
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_ddc82641f585772470877deabd9d8629.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_ddc82641f585772470877deabd9d8629.jpg saved to cache
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf41d710>
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_2082cd9518d0dd2fe69253757769f66f.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_2082cd9518d0dd2fe69253757769f66f.jpg saved to cache
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4
2026-03-27 10:35:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3d7a90>
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_0f168bfd3f2ac31d4bec10d008ab8cf8.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_0f168bfd3f2ac31d4bec10d008ab8cf8.jpg saved to cache
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4875374d-89bd-5a6f-bca6-da0fbda33735
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_d724501dae91e5af629ff5ae39c47102.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_d724501dae91e5af629ff5ae39c47102.jpg not downloaded yet
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_11a1d3012e3ccc4c63a869391641da0a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_11a1d3012e3ccc4c63a869391641da0a.jpg not downloaded yet
2026-03-27 10:35:40 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-27 10:35:40 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-27 10:35:40 [auto1.de] INFO: Found listing with ID: ML20845
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML20845%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [auto1.de] INFO: Scrape type for ML20845: 1
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_7736c1dc41fa3fa63380caac788f09c3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_7736c1dc41fa3fa63380caac788f09c3.jpg not downloaded yet
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_859c9492b209b634e7551579b65e68d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_859c9492b209b634e7551579b65e68d1.jpg not downloaded yet
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e83d0>
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_f1997ef84a0dd6ee7cfb25b3929bf941.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_f1997ef84a0dd6ee7cfb25b3929bf941.jpg saved to cache
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15c9de2b-0765-5940-928a-adab1f8b7fb2
2026-03-27 10:35:40 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN78852%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [auto1.de] INFO: Scrape type for BN78852: 1
2026-03-27 10:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_b3927087f613b16e5c92e8e72f73fd92.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_3d117c4ce135f3367a92034e0ac119f9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_3d117c4ce135f3367a92034e0ac119f9.jpg not downloaded yet
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_e7a65c8c6713c2206226415096b4df93.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_e7a65c8c6713c2206226415096b4df93.jpg not downloaded yet
2026-03-27 10:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_bf443b86ddae92950c099ce5c1b3e9fe.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:40 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT20326%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [auto1.de] INFO: Scrape type for ZT20326: 2
2026-03-27 10:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afe77dfe-c652-540f-b195-1447fbd1f5cc with identifier: ZT20326
2026-03-27 10:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afe77dfe-c652-540f-b195-1447fbd1f5cc with scrape type 2
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afe77dfe-c652-540f-b195-1447fbd1f5cc with scrape type 2
2026-03-27 10:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afe77dfe-c652-540f-b195-1447fbd1f5cc, identifier: ZT20326
2026-03-27 10:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_5664fd5ab600e2fb31080b5cbc5ceaa6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afe77dfe-c652-540f-b195-1447fbd1f5cc with identifier: ZT20326
2026-03-27 10:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afe77dfe-c652-540f-b195-1447fbd1f5cc with identifier: ZT20326
2026-03-27 10:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afe77dfe-c652-540f-b195-1447fbd1f5cc with identifier: ZT20326 to the API
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:45:08Z',
'fuel_type': 'petrol',
'id': 'afe77dfe-c652-540f-b195-1447fbd1f5cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT20326',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'up!',
'odometer': 75169,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-05',
'seller_name': None,
'title': 'Volkswagen up! 1.0 Move up! BlueMotion Tech',
'transmission': 'manual',
'trim': 'Move BlueMotion Tech',
'year': 2014}
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT20326%27 HTTP/1.1" 200 None
2026-03-27 10:35:41 [auto1.de] INFO: Saving data for ZT20326: {'auction_closing_time': 1774716308.0, 'created_time': 1774349331.688643, 'last_price_update_time': 1774607741.497141}
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT20326') HTTP/1.1" 204 0
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_c35345e592f5c94678e7597c82c6caa8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_c35345e592f5c94678e7597c82c6caa8.jpg not downloaded yet
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_d8e676b8e629730f4182b97e235e29f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_d8e676b8e629730f4182b97e235e29f5.jpg not downloaded yet
2026-03-27 10:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF03511/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XH18940> (referer: https://www.auto1.com/v1/car-details-view/XH18940/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_859c9492b209b634e7551579b65e68d1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1692d0>
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_b3927087f613b16e5c92e8e72f73fd92.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_b3927087f613b16e5c92e8e72f73fd92.jpg saved to cache
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15c9de2b-0765-5940-928a-adab1f8b7fb2
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0cfb10>
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_bf443b86ddae92950c099ce5c1b3e9fe.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_bf443b86ddae92950c099ce5c1b3e9fe.jpg saved to cache
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6529c2c3-46b8-5cc7-9a3d-02451a5be90b
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1c4610>
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_5664fd5ab600e2fb31080b5cbc5ceaa6.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_5664fd5ab600e2fb31080b5cbc5ceaa6.jpg saved to cache
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6529c2c3-46b8-5cc7-9a3d-02451a5be90b
2026-03-27 10:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad with identifier: XH18940
2026-03-27 10:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad with scrape type 1
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_90b3341d107274f7b2f394967893f9dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_90b3341d107274f7b2f394967893f9dd.jpg not downloaded yet
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2ec290>
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_859c9492b209b634e7551579b65e68d1.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_859c9492b209b634e7551579b65e68d1.jpg saved to cache
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15c9de2b-0765-5940-928a-adab1f8b7fb2
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_22479d77ecdd4ea9e8a64f80e0bc110a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_22479d77ecdd4ea9e8a64f80e0bc110a.jpg not downloaded yet
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_e262003643b67f40e1cf8b8a25e0bbb6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_e262003643b67f40e1cf8b8a25e0bbb6.jpg not downloaded yet
2026-03-27 10:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_7c365458c919bd6edf38b236c1430c1d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_36b469999d60de375c6bae92b24e76cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_36b469999d60de375c6bae92b24e76cd.jpg not downloaded yet
2026-03-27 10:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_a9a3d8479be7ffa75779e88f71d83996.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_16fadcfb8743dbf2883bae4c2eff63e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_16fadcfb8743dbf2883bae4c2eff63e3.jpg not downloaded yet
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_acb20cc1e568eea95e74c2ccf5c54c7c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_acb20cc1e568eea95e74c2ccf5c54c7c.jpg not downloaded yet
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_b47c6606bcf78f6308f8502aec7d5cd6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_b47c6606bcf78f6308f8502aec7d5cd6.jpg not downloaded yet
2026-03-27 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_22479d77ecdd4ea9e8a64f80e0bc110a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_c35345e592f5c94678e7597c82c6caa8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_3d117c4ce135f3367a92034e0ac119f9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_d8e676b8e629730f4182b97e235e29f5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_25e9e76ce76a83e19224eb3a7d2a5dfb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_25e9e76ce76a83e19224eb3a7d2a5dfb.jpg not downloaded yet
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_ef35b18dd71bf0005ad22e197344c5e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_ef35b18dd71bf0005ad22e197344c5e8.jpg not downloaded yet
2026-03-27 10:35:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c541d350>
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_7c365458c919bd6edf38b236c1430c1d.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_7c365458c919bd6edf38b236c1430c1d.jpg saved to cache
2026-03-27 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0207ab47-9552-5274-a98e-1707cca2d7f1
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_62e1703881e80bbae30ae10c974026ee.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_62e1703881e80bbae30ae10c974026ee.jpg not downloaded yet
2026-03-27 10:35:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1644d0>
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_a9a3d8479be7ffa75779e88f71d83996.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_a9a3d8479be7ffa75779e88f71d83996.jpg saved to cache
2026-03-27 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 008cc6e2-55c5-5480-8821-9f7a501d47fe
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5651a10>
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_22479d77ecdd4ea9e8a64f80e0bc110a.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_22479d77ecdd4ea9e8a64f80e0bc110a.jpg saved to cache
2026-03-27 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be02ca10>
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_c35345e592f5c94678e7597c82c6caa8.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_c35345e592f5c94678e7597c82c6caa8.jpg saved to cache
2026-03-27 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6529c2c3-46b8-5cc7-9a3d-02451a5be90b
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0fbb10>
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_3d117c4ce135f3367a92034e0ac119f9.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_3d117c4ce135f3367a92034e0ac119f9.jpg saved to cache
2026-03-27 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6529c2c3-46b8-5cc7-9a3d-02451a5be90b
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f4810>
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_d8e676b8e629730f4182b97e235e29f5.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_d8e676b8e629730f4182b97e235e29f5.jpg saved to cache
2026-03-27 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15c9de2b-0765-5940-928a-adab1f8b7fb2
2026-03-27 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_c0286b593898ae71a6d5b22bd1d1d1ce.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_e1a02e8acb9179ff7f0175e7b76a4072.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_e7a65c8c6713c2206226415096b4df93.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM57013/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_ef35b18dd71bf0005ad22e197344c5e8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_62e1703881e80bbae30ae10c974026ee.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_36b469999d60de375c6bae92b24e76cd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_16fadcfb8743dbf2883bae4c2eff63e3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be10f010>
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_c0286b593898ae71a6d5b22bd1d1d1ce.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_c0286b593898ae71a6d5b22bd1d1d1ce.jpg saved to cache
2026-03-27 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15c9de2b-0765-5940-928a-adab1f8b7fb2
2026-03-27 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR35268> (referer: https://www.auto1.com/v1/car-details-view/NR35268/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be10fa50>
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_e1a02e8acb9179ff7f0175e7b76a4072.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_e1a02e8acb9179ff7f0175e7b76a4072.jpg saved to cache
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15c9de2b-0765-5940-928a-adab1f8b7fb2
2026-03-27 10:35:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf542ad0>
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_e7a65c8c6713c2206226415096b4df93.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_e7a65c8c6713c2206226415096b4df93.jpg saved to cache
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15c9de2b-0765-5940-928a-adab1f8b7fb2
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be25e050>
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_ef35b18dd71bf0005ad22e197344c5e8.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_ef35b18dd71bf0005ad22e197344c5e8.jpg saved to cache
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b35d0>
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_62e1703881e80bbae30ae10c974026ee.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_62e1703881e80bbae30ae10c974026ee.jpg saved to cache
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0ad490>
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_36b469999d60de375c6bae92b24e76cd.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_36b469999d60de375c6bae92b24e76cd.jpg saved to cache
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf327450>
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_16fadcfb8743dbf2883bae4c2eff63e3.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_16fadcfb8743dbf2883bae4c2eff63e3.jpg saved to cache
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad
2026-03-27 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_b47c6606bcf78f6308f8502aec7d5cd6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_25e9e76ce76a83e19224eb3a7d2a5dfb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_acb20cc1e568eea95e74c2ccf5c54c7c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbde5c8b-caec-5be7-b8fc-33d8767b0773 with identifier: NR35268
2026-03-27 10:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbde5c8b-caec-5be7-b8fc-33d8767b0773 with scrape type 1
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fbde5c8b-caec-5be7-b8fc-33d8767b0773
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_47bb4bbb98beb1de2fead709b9d80afa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_47bb4bbb98beb1de2fead709b9d80afa.jpg not downloaded yet
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_db61c3e001dc59292d1808047e49ca74.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_db61c3e001dc59292d1808047e49ca74.jpg not downloaded yet
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_8023c0efc9a2ca9faf87b1c10255ba33.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_8023c0efc9a2ca9faf87b1c10255ba33.jpg not downloaded yet
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_ac3afbaae321d4d53b66b57d879d1969.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_ac3afbaae321d4d53b66b57d879d1969.jpg not downloaded yet
2026-03-27 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_90b3341d107274f7b2f394967893f9dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_152ffd1cc94cf777d293bbf168582c01.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_152ffd1cc94cf777d293bbf168582c01.jpg not downloaded yet
2026-03-27 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_e262003643b67f40e1cf8b8a25e0bbb6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_09898dbd5f6da5591db8c7d009786dcc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_09898dbd5f6da5591db8c7d009786dcc.jpg not downloaded yet
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_f3799d546f31816ce010d223e23e2842.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_f3799d546f31816ce010d223e23e2842.jpg not downloaded yet
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf32f510>
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_b47c6606bcf78f6308f8502aec7d5cd6.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_b47c6606bcf78f6308f8502aec7d5cd6.jpg saved to cache
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0367d0>
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_25e9e76ce76a83e19224eb3a7d2a5dfb.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_25e9e76ce76a83e19224eb3a7d2a5dfb.jpg saved to cache
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0ccd50>
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_acb20cc1e568eea95e74c2ccf5c54c7c.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_acb20cc1e568eea95e74c2ccf5c54c7c.jpg saved to cache
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_782e91ba082e575b2f8e2435cc2f9672.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_782e91ba082e575b2f8e2435cc2f9672.jpg not downloaded yet
2026-03-27 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_ac3afbaae321d4d53b66b57d879d1969.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_486a5f4bbb14772cc79be9fba3ce3d55.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_486a5f4bbb14772cc79be9fba3ce3d55.jpg not downloaded yet
2026-03-27 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_152ffd1cc94cf777d293bbf168582c01.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_17c9adda7ea6d996253c2b6ca9ee1d11.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_17c9adda7ea6d996253c2b6ca9ee1d11.jpg not downloaded yet
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be036d10>
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_90b3341d107274f7b2f394967893f9dd.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_90b3341d107274f7b2f394967893f9dd.jpg saved to cache
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be03a410>
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F38%252F1038e7ea0a8e2a701a43a6bb13a0a595%252Fpa%252FXH18940_e262003643b67f40e1cf8b8a25e0bbb6.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_e262003643b67f40e1cf8b8a25e0bbb6.jpg saved to cache
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad
2026-03-27 10:35:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad, skipping ID generation
2026-03-27 10:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad with scrape type 1
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad sending to next pipeline
2026-03-27 10:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad, identifier: XH18940
2026-03-27 10:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad with identifier: XH18940
2026-03-27 10:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad with identifier: XH18940
2026-03-27 10:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2cfc60ef-fade-5bc4-ba8e-b40f682e77ad with identifier: XH18940 to the API
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_e262003643b67f40e1cf8b8a25e0bbb6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 368,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine': '5.7L',
'engine_horse_power': 255,
'expiration_date': '2026-03-28T16:14:12Z',
'fuel_type': 'petrol',
'id': '2cfc60ef-fade-5bc4-ba8e-b40f682e77ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH18940',
'listing': 'auction',
'location': 'DE',
'make': 'Chevrolet',
'model': 'Suburban',
'odometer': 184711,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98213,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_90b3341d107274f7b2f394967893f9dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86621,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_22479d77ecdd4ea9e8a64f80e0bc110a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76866,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_e262003643b67f40e1cf8b8a25e0bbb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59383,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_36b469999d60de375c6bae92b24e76cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77263,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_16fadcfb8743dbf2883bae4c2eff63e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83841,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_acb20cc1e568eea95e74c2ccf5c54c7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95910,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_b47c6606bcf78f6308f8502aec7d5cd6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96937,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_25e9e76ce76a83e19224eb3a7d2a5dfb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_ef35b18dd71bf0005ad22e197344c5e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cfc60ef-fade-5bc4-ba8e-b40f682e77ad/2cfc60ef-fade-5bc4-ba8e-b40f682e77ad_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67618,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/38/1038e7ea0a8e2a701a43a6bb13a0a595/pa/XH18940_62e1703881e80bbae30ae10c974026ee.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-12-31',
'seats_number': 8,
'seller_name': None,
'title': 'Chevrolet Suburban 5.7 V8 LS 4WD',
'transmission': 'automatic',
'trim': 'LS 4WD',
'year': 2018}
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH18940%27 HTTP/1.1" 200 None
2026-03-27 10:35:44 [auto1.de] INFO: Saving data for XH18940: {'created_time': 1774607744.457554, 'last_price_update_time': 1774607744.457565, 'auction_closing_time': 1774714452.0}
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH18940') HTTP/1.1" 204 0
2026-03-27 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_f3799d546f31816ce010d223e23e2842.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf07b50>
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_ac3afbaae321d4d53b66b57d879d1969.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_ac3afbaae321d4d53b66b57d879d1969.jpg saved to cache
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fbde5c8b-caec-5be7-b8fc-33d8767b0773
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f3610>
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_152ffd1cc94cf777d293bbf168582c01.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_152ffd1cc94cf777d293bbf168582c01.jpg saved to cache
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fbde5c8b-caec-5be7-b8fc-33d8767b0773
2026-03-27 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_486a5f4bbb14772cc79be9fba3ce3d55.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_11a1d3012e3ccc4c63a869391641da0a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5716990>
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_f3799d546f31816ce010d223e23e2842.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_f3799d546f31816ce010d223e23e2842.jpg saved to cache
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fbde5c8b-caec-5be7-b8fc-33d8767b0773
2026-03-27 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_7736c1dc41fa3fa63380caac788f09c3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_d724501dae91e5af629ff5ae39c47102.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_17c9adda7ea6d996253c2b6ca9ee1d11.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be014b90>
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_486a5f4bbb14772cc79be9fba3ce3d55.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_486a5f4bbb14772cc79be9fba3ce3d55.jpg saved to cache
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fbde5c8b-caec-5be7-b8fc-33d8767b0773
2026-03-27 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_782e91ba082e575b2f8e2435cc2f9672.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be12edd0>
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_11a1d3012e3ccc4c63a869391641da0a.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_11a1d3012e3ccc4c63a869391641da0a.jpg saved to cache
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15c9de2b-0765-5940-928a-adab1f8b7fb2
2026-03-27 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_09898dbd5f6da5591db8c7d009786dcc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0b3b10>
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_7736c1dc41fa3fa63380caac788f09c3.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_7736c1dc41fa3fa63380caac788f09c3.jpg saved to cache
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6529c2c3-46b8-5cc7-9a3d-02451a5be90b
2026-03-27 10:35:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be256b10>
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_d724501dae91e5af629ff5ae39c47102.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_d724501dae91e5af629ff5ae39c47102.jpg saved to cache
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6529c2c3-46b8-5cc7-9a3d-02451a5be90b
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be291390>
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_17c9adda7ea6d996253c2b6ca9ee1d11.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_17c9adda7ea6d996253c2b6ca9ee1d11.jpg saved to cache
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fbde5c8b-caec-5be7-b8fc-33d8767b0773
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be224090>
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_782e91ba082e575b2f8e2435cc2f9672.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_782e91ba082e575b2f8e2435cc2f9672.jpg saved to cache
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fbde5c8b-caec-5be7-b8fc-33d8767b0773
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be292610>
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_09898dbd5f6da5591db8c7d009786dcc.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_09898dbd5f6da5591db8c7d009786dcc.jpg saved to cache
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fbde5c8b-caec-5be7-b8fc-33d8767b0773
2026-03-27 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_47bb4bbb98beb1de2fead709b9d80afa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_db61c3e001dc59292d1808047e49ca74.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0344d0>
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_47bb4bbb98beb1de2fead709b9d80afa.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_47bb4bbb98beb1de2fead709b9d80afa.jpg saved to cache
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fbde5c8b-caec-5be7-b8fc-33d8767b0773
2026-03-27 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_8023c0efc9a2ca9faf87b1c10255ba33.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be034f10>
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_db61c3e001dc59292d1808047e49ca74.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_db61c3e001dc59292d1808047e49ca74.jpg saved to cache
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fbde5c8b-caec-5be7-b8fc-33d8767b0773
2026-03-27 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_ec1b9bbc40e9ae933f63738826b23cc4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_8f0ae59d68cbd9caa6f748acd1e5e344.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3de990>
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F42%252F3c42791d1d558fc5efc314dcf42e836a%252Fpa%252FNR35268_8023c0efc9a2ca9faf87b1c10255ba33.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_8023c0efc9a2ca9faf87b1c10255ba33.jpg saved to cache
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fbde5c8b-caec-5be7-b8fc-33d8767b0773
2026-03-27 10:35:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fbde5c8b-caec-5be7-b8fc-33d8767b0773, skipping ID generation
2026-03-27 10:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbde5c8b-caec-5be7-b8fc-33d8767b0773 with scrape type 1
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fbde5c8b-caec-5be7-b8fc-33d8767b0773 sending to next pipeline
2026-03-27 10:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbde5c8b-caec-5be7-b8fc-33d8767b0773, identifier: NR35268
2026-03-27 10:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbde5c8b-caec-5be7-b8fc-33d8767b0773 with identifier: NR35268
2026-03-27 10:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbde5c8b-caec-5be7-b8fc-33d8767b0773 with identifier: NR35268
2026-03-27 10:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbde5c8b-caec-5be7-b8fc-33d8767b0773 with identifier: NR35268 to the API
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_8023c0efc9a2ca9faf87b1c10255ba33.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:51:25Z',
'fuel_type': 'diesel',
'id': 'fbde5c8b-caec-5be7-b8fc-33d8767b0773',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR35268',
'listing': 'auction',
'location': 'DE, Bad Oeynhausen',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 197345,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68873,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_47bb4bbb98beb1de2fead709b9d80afa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58204,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_db61c3e001dc59292d1808047e49ca74.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_8023c0efc9a2ca9faf87b1c10255ba33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62367,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_ac3afbaae321d4d53b66b57d879d1969.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_152ffd1cc94cf777d293bbf168582c01.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64218,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_09898dbd5f6da5591db8c7d009786dcc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_f3799d546f31816ce010d223e23e2842.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_782e91ba082e575b2f8e2435cc2f9672.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_486a5f4bbb14772cc79be9fba3ce3d55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbde5c8b-caec-5be7-b8fc-33d8767b0773/fbde5c8b-caec-5be7-b8fc-33d8767b0773_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80572,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/42/3c42791d1d558fc5efc314dcf42e836a/pa/NR35268_17c9adda7ea6d996253c2b6ca9ee1d11.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-03-02',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2020}
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35268%27 HTTP/1.1" 200 None
2026-03-27 10:35:46 [auto1.de] INFO: Saving data for NR35268: {'created_time': 1774607746.049985, 'last_price_update_time': 1774607746.05, 'auction_closing_time': 1774716685.0}
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR35268') HTTP/1.1" 204 0
2026-03-27 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_8a6bd098f8d27ccc2eee0c1b49e81d3c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_23c26123b56da18689d671fdebc7b596.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c56517d0>
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_ec1b9bbc40e9ae933f63738826b23cc4.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_ec1b9bbc40e9ae933f63738826b23cc4.jpg saved to cache
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15c9de2b-0765-5940-928a-adab1f8b7fb2
2026-03-27 10:35:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be086910>
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_8f0ae59d68cbd9caa6f748acd1e5e344.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_8f0ae59d68cbd9caa6f748acd1e5e344.jpg saved to cache
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6529c2c3-46b8-5cc7-9a3d-02451a5be90b
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5646dd0>
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_8a6bd098f8d27ccc2eee0c1b49e81d3c.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_8a6bd098f8d27ccc2eee0c1b49e81d3c.jpg saved to cache
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0319d0>
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_23c26123b56da18689d671fdebc7b596.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_23c26123b56da18689d671fdebc7b596.jpg saved to cache
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 008cc6e2-55c5-5480-8821-9f7a501d47fe
2026-03-27 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_c880b248ddafadab64bc5cae7f423bc5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2fb650>
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_c880b248ddafadab64bc5cae7f423bc5.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_c880b248ddafadab64bc5cae7f423bc5.jpg saved to cache
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6529c2c3-46b8-5cc7-9a3d-02451a5be90b
2026-03-27 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_9c7b858b51bd9679eca4c48b537f8e1f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_736f034210e314b10e97fe74a5b5bdb3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_75929170ba6cc24a431114aff2717f0d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_64c5286e5c10196d4726327d17ed6445.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be031c50>
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_9c7b858b51bd9679eca4c48b537f8e1f.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_9c7b858b51bd9679eca4c48b537f8e1f.jpg saved to cache
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4
2026-03-27 10:35:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2fa910>
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F04%252F3b0493c1d2ff6ea18f310acf24655b6f%252Fpa%252FHK20534_736f034210e314b10e97fe74a5b5bdb3.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_736f034210e314b10e97fe74a5b5bdb3.jpg saved to cache
2026-03-27 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15c9de2b-0765-5940-928a-adab1f8b7fb2
2026-03-27 10:35:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15c9de2b-0765-5940-928a-adab1f8b7fb2, skipping ID generation
2026-03-27 10:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15c9de2b-0765-5940-928a-adab1f8b7fb2 with scrape type 1
2026-03-27 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15c9de2b-0765-5940-928a-adab1f8b7fb2 sending to next pipeline
2026-03-27 10:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15c9de2b-0765-5940-928a-adab1f8b7fb2, identifier: HK20534
2026-03-27 10:35:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0847d0>
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_75929170ba6cc24a431114aff2717f0d.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_75929170ba6cc24a431114aff2717f0d.jpg saved to cache
2026-03-27 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 008cc6e2-55c5-5480-8821-9f7a501d47fe
2026-03-27 10:35:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be292150>
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_64c5286e5c10196d4726327d17ed6445.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_64c5286e5c10196d4726327d17ed6445.jpg saved to cache
2026-03-27 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6529c2c3-46b8-5cc7-9a3d-02451a5be90b
2026-03-27 10:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15c9de2b-0765-5940-928a-adab1f8b7fb2 with identifier: HK20534
2026-03-27 10:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15c9de2b-0765-5940-928a-adab1f8b7fb2 with identifier: HK20534
2026-03-27 10:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15c9de2b-0765-5940-928a-adab1f8b7fb2 with identifier: HK20534 to the API
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_736f034210e314b10e97fe74a5b5bdb3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 160,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 258,
'expiration_date': '2026-03-28T16:26:59Z',
'fuel_type': 'diesel',
'id': '15c9de2b-0765-5940-928a-adab1f8b7fb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK20534',
'listing': 'auction',
'location': 'DE, Ibbenbüren',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 328635,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_f1997ef84a0dd6ee7cfb25b3929bf941.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2457252,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_736f034210e314b10e97fe74a5b5bdb3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2183680,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_c0286b593898ae71a6d5b22bd1d1d1ce.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2301673,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_e1a02e8acb9179ff7f0175e7b76a4072.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_b3927087f613b16e5c92e8e72f73fd92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2289908,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_ec1b9bbc40e9ae933f63738826b23cc4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2278834,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_11a1d3012e3ccc4c63a869391641da0a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94136,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_859c9492b209b634e7551579b65e68d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2495749,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_e7a65c8c6713c2206226415096b4df93.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c9de2b-0765-5940-928a-adab1f8b7fb2/15c9de2b-0765-5940-928a-adab1f8b7fb2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76076,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/04/3b0493c1d2ff6ea18f310acf24655b6f/pa/HK20534_d8e676b8e629730f4182b97e235e29f5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-11-20',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 CDI T 4Matic BlueTEC Avantgarde',
'transmission': 'automatic',
'trim': 'T 4Matic BlueTEC Avantgarde',
'year': 2014}
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK20534%27 HTTP/1.1" 200 None
2026-03-27 10:35:47 [auto1.de] INFO: Saving data for HK20534: {'created_time': 1774607747.831296, 'last_price_update_time': 1774607747.831308, 'auction_closing_time': 1774715219.0}
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK20534') HTTP/1.1" 204 0
2026-03-27 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_4104e72b8e1beffe297125f9d599fd32.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_50714bdd94df1fbcabd11db4b2fbef8d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY87564> (referer: https://www.auto1.com/v1/car-details-view/WY87564/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL90187/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT57416/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_7a604d2bb2e305d95a7d1994ef5a6d13.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5898d0>
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_4104e72b8e1beffe297125f9d599fd32.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_4104e72b8e1beffe297125f9d599fd32.jpg saved to cache
2026-03-27 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 008cc6e2-55c5-5480-8821-9f7a501d47fe
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be13a7d0>
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_50714bdd94df1fbcabd11db4b2fbef8d.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_50714bdd94df1fbcabd11db4b2fbef8d.jpg saved to cache
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4
2026-03-27 10:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b with identifier: WY87564
2026-03-27 10:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b with scrape type 1
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_79dc9c3f364ed2826db3dd57a6c5d244.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_79dc9c3f364ed2826db3dd57a6c5d244.jpg not downloaded yet
2026-03-27 10:35:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf33d50>
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F86%252Fa186174a7fb561eb73702e7f2896ecca%252Fpa%252FSJ46577_7a604d2bb2e305d95a7d1994ef5a6d13.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_7a604d2bb2e305d95a7d1994ef5a6d13.jpg saved to cache
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6529c2c3-46b8-5cc7-9a3d-02451a5be90b
2026-03-27 10:35:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6529c2c3-46b8-5cc7-9a3d-02451a5be90b, skipping ID generation
2026-03-27 10:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6529c2c3-46b8-5cc7-9a3d-02451a5be90b with scrape type 1
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6529c2c3-46b8-5cc7-9a3d-02451a5be90b sending to next pipeline
2026-03-27 10:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6529c2c3-46b8-5cc7-9a3d-02451a5be90b, identifier: SJ46577
2026-03-27 10:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6529c2c3-46b8-5cc7-9a3d-02451a5be90b with identifier: SJ46577
2026-03-27 10:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6529c2c3-46b8-5cc7-9a3d-02451a5be90b with identifier: SJ46577
2026-03-27 10:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6529c2c3-46b8-5cc7-9a3d-02451a5be90b with identifier: SJ46577 to the API
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_7a604d2bb2e305d95a7d1994ef5a6d13.jpg>
{'auction_title': '',
'c_o_2_emission_value': 174,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:28:28Z',
'fuel_type': 'diesel',
'id': '6529c2c3-46b8-5cc7-9a3d-02451a5be90b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ46577',
'listing': 'auction',
'location': 'DE, Neustadt an der Weinstraße',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 101770,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2735756,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_7a604d2bb2e305d95a7d1994ef5a6d13.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2740356,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_64c5286e5c10196d4726327d17ed6445.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2820258,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_8f0ae59d68cbd9caa6f748acd1e5e344.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_5664fd5ab600e2fb31080b5cbc5ceaa6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70614,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_bf443b86ddae92950c099ce5c1b3e9fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2857190,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_c880b248ddafadab64bc5cae7f423bc5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2853777,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_d724501dae91e5af629ff5ae39c47102.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2841509,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_7736c1dc41fa3fa63380caac788f09c3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78348,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_3d117c4ce135f3367a92034e0ac119f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6529c2c3-46b8-5cc7-9a3d-02451a5be90b/6529c2c3-46b8-5cc7-9a3d-02451a5be90b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/86/a186174a7fb561eb73702e7f2896ecca/pa/SJ46577_c35345e592f5c94678e7597c82c6caa8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Sportline 4x4',
'transmission': 'automatic',
'trim': 'Sportline 4x4',
'year': 2023}
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ46577%27 HTTP/1.1" 200 None
2026-03-27 10:35:48 [auto1.de] INFO: Saving data for SJ46577: {'created_time': 1774607748.706452, 'last_price_update_time': 1774607748.706469, 'auction_closing_time': 1774715308.0}
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ46577') HTTP/1.1" 204 0
2026-03-27 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_6cf369c0da9d9789a2ac5d18d8127952.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_675c04f49a94f0ca5364f562be076f83.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_675c04f49a94f0ca5364f562be076f83.jpg not downloaded yet
2026-03-27 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF03511> (referer: https://www.auto1.com/v1/car-details-view/LF03511/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EX64550/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM57013> (referer: https://www.auto1.com/v1/car-details-view/YM57013/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_51936f050ae0741b6bc818c81d159f72.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_51936f050ae0741b6bc818c81d159f72.jpg not downloaded yet
2026-03-27 10:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_07a172696a4ac56d9a6272e43ea79739.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_07a172696a4ac56d9a6272e43ea79739.jpg not downloaded yet
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_5cbdea91213a348f1581dd18ce84f05c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_5cbdea91213a348f1581dd18ce84f05c.jpg not downloaded yet
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_c0b5201c439f9d18f2d06f219ad32981.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_c0b5201c439f9d18f2d06f219ad32981.jpg not downloaded yet
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_8c8b98f0a9c8b0090d1b44f42e5e5e08.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_8c8b98f0a9c8b0090d1b44f42e5e5e08.jpg not downloaded yet
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be160890>
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_6cf369c0da9d9789a2ac5d18d8127952.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_6cf369c0da9d9789a2ac5d18d8127952.jpg saved to cache
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 008cc6e2-55c5-5480-8821-9f7a501d47fe
2026-03-27 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_675c04f49a94f0ca5364f562be076f83.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_8a63f6070985b0a3a854866a24576135.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_8a63f6070985b0a3a854866a24576135.jpg not downloaded yet
2026-03-27 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_79dc9c3f364ed2826db3dd57a6c5d244.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_752739324bb12b7ffa1e31ed9db1c732.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_752739324bb12b7ffa1e31ed9db1c732.jpg not downloaded yet
2026-03-27 10:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a758a659-716e-5297-8a6b-9aeaccb932cf with identifier: LF03511
2026-03-27 10:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a758a659-716e-5297-8a6b-9aeaccb932cf with scrape type 1
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a758a659-716e-5297-8a6b-9aeaccb932cf
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F26%252F59261937c27b9b5f4da53d0bc02018c1%252Fpa%252FLF03511_05d0dcfaa5ecb13be6c58eaa01fbf3c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_05d0dcfaa5ecb13be6c58eaa01fbf3c5.jpg not downloaded yet
2026-03-27 10:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5964004e-ccba-5eb3-b356-c02efb1ccb3c with identifier: YM57013
2026-03-27 10:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5964004e-ccba-5eb3-b356-c02efb1ccb3c with scrape type 1
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5964004e-ccba-5eb3-b356-c02efb1ccb3c
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_c99487bf31a2fb2d60c62729f3b7bd1e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_c99487bf31a2fb2d60c62729f3b7bd1e.jpg not downloaded yet
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_cfbac3de07726c2c93695e28f5e73a47.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_cfbac3de07726c2c93695e28f5e73a47.jpg not downloaded yet
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F26%252F59261937c27b9b5f4da53d0bc02018c1%252Fpa%252FLF03511_05b6b80a5bf6aa252c401f6ad50d95b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_05b6b80a5bf6aa252c401f6ad50d95b6.jpg not downloaded yet
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_e543ecba9ac2c900194900c1379a79f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_e543ecba9ac2c900194900c1379a79f5.jpg not downloaded yet
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F26%252F59261937c27b9b5f4da53d0bc02018c1%252Fpa%252FLF03511_76f202ebb300a0c707851380d08910eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_76f202ebb300a0c707851380d08910eb.jpg not downloaded yet
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_06cf1cc3cd551efb4d2935ee031fa7b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_06cf1cc3cd551efb4d2935ee031fa7b4.jpg not downloaded yet
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0ccd50>
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_675c04f49a94f0ca5364f562be076f83.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_675c04f49a94f0ca5364f562be076f83.jpg saved to cache
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be255590>
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_79dc9c3f364ed2826db3dd57a6c5d244.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_79dc9c3f364ed2826db3dd57a6c5d244.jpg saved to cache
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F26%252F59261937c27b9b5f4da53d0bc02018c1%252Fpa%252FLF03511_cc073757be53a89da1525a18941022d9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_cc073757be53a89da1525a18941022d9.jpg not downloaded yet
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_e8f5bf4b1ca39348c5df92546a2379ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_e8f5bf4b1ca39348c5df92546a2379ba.jpg not downloaded yet
2026-03-27 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_8c8b98f0a9c8b0090d1b44f42e5e5e08.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F26%252F59261937c27b9b5f4da53d0bc02018c1%252Fpa%252FLF03511_612cd536ca86dab77e2629b2f9cefac8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_612cd536ca86dab77e2629b2f9cefac8.jpg not downloaded yet
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_1e8a00121e675a419128a13ae74ae6ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_1e8a00121e675a419128a13ae74ae6ae.jpg not downloaded yet
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_f0be32dd29c3fd4d2376ce58331a80ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_f0be32dd29c3fd4d2376ce58331a80ca.jpg not downloaded yet
2026-03-27 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_45eafe435a8e205ac388de980c015e15.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_b34dd64aae1a991f934f8c18fd674c81.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_b34dd64aae1a991f934f8c18fd674c81.jpg not downloaded yet
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_dab7f07c66e9e262069b8e4e6101fd45.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_dab7f07c66e9e262069b8e4e6101fd45.jpg not downloaded yet
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_d43330be9defe57a8c088395ce53f09f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_d43330be9defe57a8c088395ce53f09f.jpg not downloaded yet
2026-03-27 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_bab6d0a5d4fffcfc9d6d8e1fd624e89e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_866c0cee2fc10f3118a507287d3e3f2b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_866c0cee2fc10f3118a507287d3e3f2b.jpg not downloaded yet
2026-03-27 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_78cef2912ae2c7d755083a9fb608e499.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be115210>
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_8c8b98f0a9c8b0090d1b44f42e5e5e08.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_8c8b98f0a9c8b0090d1b44f42e5e5e08.jpg saved to cache
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b
2026-03-27 10:35:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c42547d0>
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_45eafe435a8e205ac388de980c015e15.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_45eafe435a8e205ac388de980c015e15.jpg saved to cache
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 008cc6e2-55c5-5480-8821-9f7a501d47fe
2026-03-27 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC10304/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf39e5d0>
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_bab6d0a5d4fffcfc9d6d8e1fd624e89e.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_bab6d0a5d4fffcfc9d6d8e1fd624e89e.jpg saved to cache
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0207ab47-9552-5274-a98e-1707cca2d7f1
2026-03-27 10:35:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be00bbd0>
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_78cef2912ae2c7d755083a9fb608e499.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_78cef2912ae2c7d755083a9fb608e499.jpg saved to cache
2026-03-27 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0207ab47-9552-5274-a98e-1707cca2d7f1
2026-03-27 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_06cf1cc3cd551efb4d2935ee031fa7b4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF38507> (referer: https://www.auto1.com/v1/car-details-view/DF38507/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML20845/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FZ93202/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_8a63f6070985b0a3a854866a24576135.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_1e8a00121e675a419128a13ae74ae6ae.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be00ab10>
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_06cf1cc3cd551efb4d2935ee031fa7b4.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_06cf1cc3cd551efb4d2935ee031fa7b4.jpg saved to cache
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5964004e-ccba-5eb3-b356-c02efb1ccb3c
2026-03-27 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF83806/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 with identifier: DF38507
2026-03-27 10:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 with scrape type 1
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60c9b00d-ce8a-59ae-aa80-3bbe06e03799
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_103344f571ff17d824e39924f2ae34c6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_103344f571ff17d824e39924f2ae34c6.jpg not downloaded yet
2026-03-27 10:35:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be085d90>
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_8a63f6070985b0a3a854866a24576135.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_8a63f6070985b0a3a854866a24576135.jpg saved to cache
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b
2026-03-27 10:35:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf407550>
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_1e8a00121e675a419128a13ae74ae6ae.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_1e8a00121e675a419128a13ae74ae6ae.jpg saved to cache
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5964004e-ccba-5eb3-b356-c02efb1ccb3c
2026-03-27 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_d43330be9defe57a8c088395ce53f09f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_51c5172076bd8159ce260a2ffd160d00.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_51c5172076bd8159ce260a2ffd160d00.jpg not downloaded yet
2026-03-27 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_866c0cee2fc10f3118a507287d3e3f2b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_612cd536ca86dab77e2629b2f9cefac8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_f0c3ca1d5d965ed83047dba0d634a511.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_f0c3ca1d5d965ed83047dba0d634a511.jpg not downloaded yet
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_8c5c2cc314aa78b6f3b3883949219360.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_8c5c2cc314aa78b6f3b3883949219360.jpg not downloaded yet
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_e54ae016417b6eeaa760ba9d8473813f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_e54ae016417b6eeaa760ba9d8473813f.jpg not downloaded yet
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_a807289ef16266754b3ccfbd1e950b5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_a807289ef16266754b3ccfbd1e950b5b.jpg not downloaded yet
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_ac3d8bae77e5550d47dd277a8b4e26fb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_ac3d8bae77e5550d47dd277a8b4e26fb.jpg not downloaded yet
2026-03-27 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_103344f571ff17d824e39924f2ae34c6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_570ed59b125440ec1648a48e9b460c38.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_570ed59b125440ec1648a48e9b460c38.jpg not downloaded yet
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be017590>
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_d43330be9defe57a8c088395ce53f09f.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_d43330be9defe57a8c088395ce53f09f.jpg saved to cache
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5964004e-ccba-5eb3-b356-c02efb1ccb3c
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_6c979ff15d68cbcfb4129655f9439136.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_6c979ff15d68cbcfb4129655f9439136.jpg not downloaded yet
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2ea110>
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_866c0cee2fc10f3118a507287d3e3f2b.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_866c0cee2fc10f3118a507287d3e3f2b.jpg saved to cache
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5964004e-ccba-5eb3-b356-c02efb1ccb3c
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5358150>
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a758a659-716e-5297-8a6b-9aeaccb932cf/a758a659-716e-5297-8a6b-9aeaccb932cf_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F26%252F59261937c27b9b5f4da53d0bc02018c1%252Fpa%252FLF03511_612cd536ca86dab77e2629b2f9cefac8.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_612cd536ca86dab77e2629b2f9cefac8.jpg saved to cache
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a758a659-716e-5297-8a6b-9aeaccb932cf
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_c67f7a15890a47c5f612b03cd594cf2e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_c67f7a15890a47c5f612b03cd594cf2e.jpg not downloaded yet
2026-03-27 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_cc073757be53a89da1525a18941022d9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_76f202ebb300a0c707851380d08910eb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5395a90>
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_103344f571ff17d824e39924f2ae34c6.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_103344f571ff17d824e39924f2ae34c6.jpg saved to cache
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60c9b00d-ce8a-59ae-aa80-3bbe06e03799
2026-03-27 10:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_ac3d8bae77e5550d47dd277a8b4e26fb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1693d0>
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a758a659-716e-5297-8a6b-9aeaccb932cf/a758a659-716e-5297-8a6b-9aeaccb932cf_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F26%252F59261937c27b9b5f4da53d0bc02018c1%252Fpa%252FLF03511_cc073757be53a89da1525a18941022d9.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_cc073757be53a89da1525a18941022d9.jpg saved to cache
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a758a659-716e-5297-8a6b-9aeaccb932cf
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0cdd50>
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a758a659-716e-5297-8a6b-9aeaccb932cf/a758a659-716e-5297-8a6b-9aeaccb932cf_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F26%252F59261937c27b9b5f4da53d0bc02018c1%252Fpa%252FLF03511_76f202ebb300a0c707851380d08910eb.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_76f202ebb300a0c707851380d08910eb.jpg saved to cache
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a758a659-716e-5297-8a6b-9aeaccb932cf
2026-03-27 10:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT57416> (referer: https://www.auto1.com/v1/car-details-view/GT57416/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1f9d50>
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_ac3d8bae77e5550d47dd277a8b4e26fb.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_ac3d8bae77e5550d47dd277a8b4e26fb.jpg saved to cache
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60c9b00d-ce8a-59ae-aa80-3bbe06e03799
2026-03-27 10:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_e8f5bf4b1ca39348c5df92546a2379ba.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_b34dd64aae1a991f934f8c18fd674c81.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_dab7f07c66e9e262069b8e4e6101fd45.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_f0be32dd29c3fd4d2376ce58331a80ca.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_c67f7a15890a47c5f612b03cd594cf2e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 586c1eaf-1f2e-59cf-8176-275edac29733 with identifier: GT57416
2026-03-27 10:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 586c1eaf-1f2e-59cf-8176-275edac29733 with scrape type 1
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 586c1eaf-1f2e-59cf-8176-275edac29733
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_8f5ebd4fb5a4007e69b7d8e952927a59.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_8f5ebd4fb5a4007e69b7d8e952927a59.jpg not downloaded yet
2026-03-27 10:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_6c979ff15d68cbcfb4129655f9439136.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_d2a3ce611ec68929316b7ca684868c6c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_d2a3ce611ec68929316b7ca684868c6c.jpg not downloaded yet
2026-03-27 10:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_570ed59b125440ec1648a48e9b460c38.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_2b92783d203b8c9518ba1f6a95b469ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_2b92783d203b8c9518ba1f6a95b469ae.jpg not downloaded yet
2026-03-27 10:35:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3cfbd0>
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_e8f5bf4b1ca39348c5df92546a2379ba.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_e8f5bf4b1ca39348c5df92546a2379ba.jpg saved to cache
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5964004e-ccba-5eb3-b356-c02efb1ccb3c
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_a125fc940f03d9302f31a83c6eef3f5d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_a125fc940f03d9302f31a83c6eef3f5d.jpg not downloaded yet
2026-03-27 10:35:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be25e050>
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_b34dd64aae1a991f934f8c18fd674c81.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_b34dd64aae1a991f934f8c18fd674c81.jpg saved to cache
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5964004e-ccba-5eb3-b356-c02efb1ccb3c
2026-03-27 10:35:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be025350>
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_dab7f07c66e9e262069b8e4e6101fd45.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_dab7f07c66e9e262069b8e4e6101fd45.jpg saved to cache
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5964004e-ccba-5eb3-b356-c02efb1ccb3c
2026-03-27 10:35:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5fba90>
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_f0be32dd29c3fd4d2376ce58331a80ca.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_f0be32dd29c3fd4d2376ce58331a80ca.jpg saved to cache
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5964004e-ccba-5eb3-b356-c02efb1ccb3c
2026-03-27 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_a807289ef16266754b3ccfbd1e950b5b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_e54ae016417b6eeaa760ba9d8473813f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_51bee5d6516471bcd701572a0286015c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_51bee5d6516471bcd701572a0286015c.jpg not downloaded yet
2026-03-27 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL90187> (referer: https://www.auto1.com/v1/car-details-view/FL90187/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_74cce6f241b8ff4bcdbcb7c12eb1696c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_74cce6f241b8ff4bcdbcb7c12eb1696c.jpg not downloaded yet
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1b9990>
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_c67f7a15890a47c5f612b03cd594cf2e.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_c67f7a15890a47c5f612b03cd594cf2e.jpg saved to cache
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60c9b00d-ce8a-59ae-aa80-3bbe06e03799
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2de3d0>
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_6c979ff15d68cbcfb4129655f9439136.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_6c979ff15d68cbcfb4129655f9439136.jpg saved to cache
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60c9b00d-ce8a-59ae-aa80-3bbe06e03799
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0b0910>
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_570ed59b125440ec1648a48e9b460c38.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_570ed59b125440ec1648a48e9b460c38.jpg saved to cache
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60c9b00d-ce8a-59ae-aa80-3bbe06e03799
2026-03-27 10:35:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_c2f5b49e646265334cd7df9d96a201f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_c2f5b49e646265334cd7df9d96a201f2.jpg not downloaded yet
2026-03-27 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC10304> (referer: https://www.auto1.com/v1/car-details-view/SC10304/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be034810>
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_a807289ef16266754b3ccfbd1e950b5b.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_a807289ef16266754b3ccfbd1e950b5b.jpg saved to cache
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60c9b00d-ce8a-59ae-aa80-3bbe06e03799
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1145d0>
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_e54ae016417b6eeaa760ba9d8473813f.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_e54ae016417b6eeaa760ba9d8473813f.jpg saved to cache
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60c9b00d-ce8a-59ae-aa80-3bbe06e03799
2026-03-27 10:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea48d560-4562-5752-a0ac-fde215f74872 with identifier: FL90187
2026-03-27 10:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea48d560-4562-5752-a0ac-fde215f74872 with scrape type 1
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea48d560-4562-5752-a0ac-fde215f74872
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_f2d2533691e92d085d3c4e9eecec6163.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_f2d2533691e92d085d3c4e9eecec6163.jpg not downloaded yet
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_158324d7d382bfd7c8fbfe7a365042a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_158324d7d382bfd7c8fbfe7a365042a6.jpg not downloaded yet
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_aedcb83c4da2380fba9be92ce6c2a09d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_aedcb83c4da2380fba9be92ce6c2a09d.jpg not downloaded yet
2026-03-27 10:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_8f5ebd4fb5a4007e69b7d8e952927a59.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_57a19b7427d55131ff0e54d2ee252c96.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_57a19b7427d55131ff0e54d2ee252c96.jpg not downloaded yet
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_010abdd798ad53c448af144468e63e89.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_010abdd798ad53c448af144468e63e89.jpg not downloaded yet
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_ccbd85c33da5ed40d84c12bbc9689db8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_ccbd85c33da5ed40d84c12bbc9689db8.jpg not downloaded yet
2026-03-27 10:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9cb1bfe-f731-5341-8703-533cfdf0ce58 with identifier: SC10304
2026-03-27 10:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9cb1bfe-f731-5341-8703-533cfdf0ce58 with scrape type 1
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9cb1bfe-f731-5341-8703-533cfdf0ce58
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F57%252F35571740c1e4ca65b78394885ccf7d37%252Fpa%252FSC10304_91bfb67eb4418badec13efd1a7247094.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_91bfb67eb4418badec13efd1a7247094.jpg already downloaded
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F57%252F35571740c1e4ca65b78394885ccf7d37%252Fpa%252FSC10304_dd12343af633a2e6453bcd9d12b3ff99.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_dd12343af633a2e6453bcd9d12b3ff99.jpg already downloaded
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F57%252F35571740c1e4ca65b78394885ccf7d37%252Fpa%252FSC10304_20cdd4076cc069c32467d1d325172e7e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_20cdd4076cc069c32467d1d325172e7e.jpg already downloaded
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F57%252F35571740c1e4ca65b78394885ccf7d37%252Fpa%252FSC10304_8d2c9e64ed57fd000ffd290dec8ed2e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_8d2c9e64ed57fd000ffd290dec8ed2e6.jpg already downloaded
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F57%252F35571740c1e4ca65b78394885ccf7d37%252Fpa%252FSC10304_564294dac73a8a6d7ee40c1bb7d98b4c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_564294dac73a8a6d7ee40c1bb7d98b4c.jpg already downloaded
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F57%252F35571740c1e4ca65b78394885ccf7d37%252Fpa%252FSC10304_be97d42e6088e4db77d2ddb04e66b5ee.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_be97d42e6088e4db77d2ddb04e66b5ee.jpg already downloaded
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F57%252F35571740c1e4ca65b78394885ccf7d37%252Fpa%252FSC10304_578557bf8c21c85f14ea218cce296410.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_578557bf8c21c85f14ea218cce296410.jpg already downloaded
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F57%252F35571740c1e4ca65b78394885ccf7d37%252Fpa%252FSC10304_caddd89d956fde1ab574d30b985e37ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_caddd89d956fde1ab574d30b985e37ce.jpg already downloaded
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F57%252F35571740c1e4ca65b78394885ccf7d37%252Fpa%252FSC10304_88e54ad599b27f95173e01f82cb764ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_88e54ad599b27f95173e01f82cb764ce.jpg already downloaded
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F57%252F35571740c1e4ca65b78394885ccf7d37%252Fpa%252FSC10304_2f13293a3b6fd9bb43392818e77bec6f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_2f13293a3b6fd9bb43392818e77bec6f.jpg already downloaded
2026-03-27 10:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9cb1bfe-f731-5341-8703-533cfdf0ce58, identifier: SC10304
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_e2ea3a4c7636018c8a9b9477d438ba2f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_e2ea3a4c7636018c8a9b9477d438ba2f.jpg not downloaded yet
2026-03-27 10:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9cb1bfe-f731-5341-8703-533cfdf0ce58 with identifier: SC10304
2026-03-27 10:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9cb1bfe-f731-5341-8703-533cfdf0ce58 with identifier: SC10304
2026-03-27 10:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9cb1bfe-f731-5341-8703-533cfdf0ce58 with identifier: SC10304 to the API
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SC10304>
{'auction_title': '',
'c_o_2_emission_value': 187,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:37:54Z',
'fuel_type': 'petrol',
'id': 'e9cb1bfe-f731-5341-8703-533cfdf0ce58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC10304',
'listing': 'auction',
'location': 'DE, Ellerau',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 41600,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_91bfb67eb4418badec13efd1a7247094.jpg',
'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_dd12343af633a2e6453bcd9d12b3ff99.jpg',
'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_20cdd4076cc069c32467d1d325172e7e.jpg',
'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_8d2c9e64ed57fd000ffd290dec8ed2e6.jpg',
'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_564294dac73a8a6d7ee40c1bb7d98b4c.jpg',
'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_be97d42e6088e4db77d2ddb04e66b5ee.jpg',
'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_578557bf8c21c85f14ea218cce296410.jpg',
'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_caddd89d956fde1ab574d30b985e37ce.jpg',
'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_88e54ad599b27f95173e01f82cb764ce.jpg',
'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_2f13293a3b6fd9bb43392818e77bec6f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9cb1bfe-f731-5341-8703-533cfdf0ce58/e9cb1bfe-f731-5341-8703-533cfdf0ce58_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2989917,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_91bfb67eb4418badec13efd1a7247094.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9cb1bfe-f731-5341-8703-533cfdf0ce58/e9cb1bfe-f731-5341-8703-533cfdf0ce58_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77143,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_dd12343af633a2e6453bcd9d12b3ff99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9cb1bfe-f731-5341-8703-533cfdf0ce58/e9cb1bfe-f731-5341-8703-533cfdf0ce58_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82434,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_20cdd4076cc069c32467d1d325172e7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9cb1bfe-f731-5341-8703-533cfdf0ce58/e9cb1bfe-f731-5341-8703-533cfdf0ce58_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3023337,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_8d2c9e64ed57fd000ffd290dec8ed2e6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9cb1bfe-f731-5341-8703-533cfdf0ce58/e9cb1bfe-f731-5341-8703-533cfdf0ce58_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_564294dac73a8a6d7ee40c1bb7d98b4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9cb1bfe-f731-5341-8703-533cfdf0ce58/e9cb1bfe-f731-5341-8703-533cfdf0ce58_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_be97d42e6088e4db77d2ddb04e66b5ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9cb1bfe-f731-5341-8703-533cfdf0ce58/e9cb1bfe-f731-5341-8703-533cfdf0ce58_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_578557bf8c21c85f14ea218cce296410.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9cb1bfe-f731-5341-8703-533cfdf0ce58/e9cb1bfe-f731-5341-8703-533cfdf0ce58_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_caddd89d956fde1ab574d30b985e37ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9cb1bfe-f731-5341-8703-533cfdf0ce58/e9cb1bfe-f731-5341-8703-533cfdf0ce58_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76150,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_88e54ad599b27f95173e01f82cb764ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9cb1bfe-f731-5341-8703-533cfdf0ce58/e9cb1bfe-f731-5341-8703-533cfdf0ce58_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/57/35571740c1e4ca65b78394885ccf7d37/pa/SC10304_2f13293a3b6fd9bb43392818e77bec6f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-09',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 220 4Matic Urban',
'transmission': 'automatic',
'trim': '4Matic Urban',
'year': 2018}
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC10304%27 HTTP/1.1" 200 None
2026-03-27 10:35:53 [auto1.de] INFO: Saving data for SC10304: {'created_time': 1774607753.585845, 'last_price_update_time': 1774607753.585857, 'auction_closing_time': 1774715874.0}
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC10304') HTTP/1.1" 204 0
2026-03-27 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_51c5172076bd8159ce260a2ffd160d00.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_8c5c2cc314aa78b6f3b3883949219360.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_f0c3ca1d5d965ed83047dba0d634a511.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_74cce6f241b8ff4bcdbcb7c12eb1696c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_a9d1e5c0ddb706a929e787d37a0cdc8c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_a9d1e5c0ddb706a929e787d37a0cdc8c.jpg not downloaded yet
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be032410>
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_8f5ebd4fb5a4007e69b7d8e952927a59.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_8f5ebd4fb5a4007e69b7d8e952927a59.jpg saved to cache
2026-03-27 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 586c1eaf-1f2e-59cf-8176-275edac29733
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_222c8a3e7b1df294729388c0daa250cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_222c8a3e7b1df294729388c0daa250cc.jpg not downloaded yet
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_41030b1590c686c44ed3f4544a59a2e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_41030b1590c686c44ed3f4544a59a2e2.jpg not downloaded yet
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_7fb370bb92079eda994d6332396c4c52.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_7fb370bb92079eda994d6332396c4c52.jpg not downloaded yet
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2248d0>
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_51c5172076bd8159ce260a2ffd160d00.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_51c5172076bd8159ce260a2ffd160d00.jpg saved to cache
2026-03-27 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60c9b00d-ce8a-59ae-aa80-3bbe06e03799
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf406810>
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_8c5c2cc314aa78b6f3b3883949219360.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_8c5c2cc314aa78b6f3b3883949219360.jpg saved to cache
2026-03-27 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60c9b00d-ce8a-59ae-aa80-3bbe06e03799
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3730d0>
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F4e%252F3f4e6ad381116f6775c393a08f4683ca%252Fpa%252FDF38507_f0c3ca1d5d965ed83047dba0d634a511.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_f0c3ca1d5d965ed83047dba0d634a511.jpg saved to cache
2026-03-27 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60c9b00d-ce8a-59ae-aa80-3bbe06e03799
2026-03-27 10:35:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60c9b00d-ce8a-59ae-aa80-3bbe06e03799, skipping ID generation
2026-03-27 10:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 with scrape type 1
2026-03-27 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 sending to next pipeline
2026-03-27 10:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60c9b00d-ce8a-59ae-aa80-3bbe06e03799, identifier: DF38507
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4e0dd0>
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_74cce6f241b8ff4bcdbcb7c12eb1696c.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_74cce6f241b8ff4bcdbcb7c12eb1696c.jpg saved to cache
2026-03-27 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 586c1eaf-1f2e-59cf-8176-275edac29733
2026-03-27 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_e2ea3a4c7636018c8a9b9477d438ba2f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_010abdd798ad53c448af144468e63e89.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_e996ebd23e83ab8387341160a7e5b899.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_e996ebd23e83ab8387341160a7e5b899.jpg not downloaded yet
2026-03-27 10:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 with identifier: DF38507
2026-03-27 10:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 with identifier: DF38507
2026-03-27 10:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60c9b00d-ce8a-59ae-aa80-3bbe06e03799 with identifier: DF38507 to the API
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_f0c3ca1d5d965ed83047dba0d634a511.jpg>
{'auction_title': '',
'c_o_2_emission_value': 175,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:27:42Z',
'fuel_type': 'petrol',
'id': '60c9b00d-ce8a-59ae-aa80-3bbe06e03799',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF38507',
'listing': 'auction',
'location': 'DE, München',
'make': 'Kia',
'model': 'Sportage',
'odometer': 40183,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110178,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_103344f571ff17d824e39924f2ae34c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_51c5172076bd8159ce260a2ffd160d00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97499,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_f0c3ca1d5d965ed83047dba0d634a511.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74325,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_8c5c2cc314aa78b6f3b3883949219360.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_e54ae016417b6eeaa760ba9d8473813f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96608,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_a807289ef16266754b3ccfbd1e950b5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_ac3d8bae77e5550d47dd277a8b4e26fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95307,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_570ed59b125440ec1648a48e9b460c38.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_6c979ff15d68cbcfb4129655f9439136.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c9b00d-ce8a-59ae-aa80-3bbe06e03799/60c9b00d-ce8a-59ae-aa80-3bbe06e03799_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/4e/3f4e6ad381116f6775c393a08f4683ca/pa/DF38507_c67f7a15890a47c5f612b03cd594cf2e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-03-21',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Sportage 1.6 TGDI GT Line 4WD',
'transmission': 'automatic',
'trim': 'GT Line 4WD',
'year': 2016}
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF38507%27 HTTP/1.1" 200 None
2026-03-27 10:35:54 [auto1.de] INFO: Saving data for DF38507: {'created_time': 1774607754.534934, 'last_price_update_time': 1774607754.534945, 'auction_closing_time': 1774715262.0}
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF38507') HTTP/1.1" 204 0
2026-03-27 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_ccbd85c33da5ed40d84c12bbc9689db8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_3a7f483b67ab02032fcdf8ab29259781.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_3a7f483b67ab02032fcdf8ab29259781.jpg not downloaded yet
2026-03-27 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf30690>
2026-03-27 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_e2ea3a4c7636018c8a9b9477d438ba2f.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_e2ea3a4c7636018c8a9b9477d438ba2f.jpg saved to cache
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea48d560-4562-5752-a0ac-fde215f74872
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3c7950>
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_010abdd798ad53c448af144468e63e89.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_010abdd798ad53c448af144468e63e89.jpg saved to cache
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea48d560-4562-5752-a0ac-fde215f74872
2026-03-27 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_41030b1590c686c44ed3f4544a59a2e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_7fb370bb92079eda994d6332396c4c52.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_57a19b7427d55131ff0e54d2ee252c96.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML20845> (referer: https://www.auto1.com/v1/car-details-view/ML20845/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0921d0>
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_ccbd85c33da5ed40d84c12bbc9689db8.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_ccbd85c33da5ed40d84c12bbc9689db8.jpg saved to cache
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 586c1eaf-1f2e-59cf-8176-275edac29733
2026-03-27 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_e996ebd23e83ab8387341160a7e5b899.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_2b92783d203b8c9518ba1f6a95b469ae.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_51bee5d6516471bcd701572a0286015c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_a125fc940f03d9302f31a83c6eef3f5d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_d2a3ce611ec68929316b7ca684868c6c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_158324d7d382bfd7c8fbfe7a365042a6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be093d10>
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_41030b1590c686c44ed3f4544a59a2e2.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_41030b1590c686c44ed3f4544a59a2e2.jpg saved to cache
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea48d560-4562-5752-a0ac-fde215f74872
2026-03-27 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_a9d1e5c0ddb706a929e787d37a0cdc8c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_222c8a3e7b1df294729388c0daa250cc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_3a7f483b67ab02032fcdf8ab29259781.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be260b50>
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_7fb370bb92079eda994d6332396c4c52.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_7fb370bb92079eda994d6332396c4c52.jpg saved to cache
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea48d560-4562-5752-a0ac-fde215f74872
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be262050>
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_57a19b7427d55131ff0e54d2ee252c96.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_57a19b7427d55131ff0e54d2ee252c96.jpg saved to cache
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 586c1eaf-1f2e-59cf-8176-275edac29733
2026-03-27 10:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f2868b7-433f-50d8-ac6a-a958a1d92063 with identifier: ML20845
2026-03-27 10:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f2868b7-433f-50d8-ac6a-a958a1d92063 with scrape type 1
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3f2868b7-433f-50d8-ac6a-a958a1d92063
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F57%252F4b5730a5cc575190ee92746bf1af77ca%252Fpa%252FML20845_1f6c7cf2432add706a674b7fbe082783.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_1f6c7cf2432add706a674b7fbe082783.jpg not downloaded yet
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be024990>
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_e996ebd23e83ab8387341160a7e5b899.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_e996ebd23e83ab8387341160a7e5b899.jpg saved to cache
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea48d560-4562-5752-a0ac-fde215f74872
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F57%252F4b5730a5cc575190ee92746bf1af77ca%252Fpa%252FML20845_c0aa2bccbb59cc468e275bcd5d025e49.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_c0aa2bccbb59cc468e275bcd5d025e49.jpg not downloaded yet
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F57%252F4b5730a5cc575190ee92746bf1af77ca%252Fpa%252FML20845_83b034229ed74101143dd0f116ba92b7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_83b034229ed74101143dd0f116ba92b7.jpg not downloaded yet
2026-03-27 10:35:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1e4650>
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_2b92783d203b8c9518ba1f6a95b469ae.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_2b92783d203b8c9518ba1f6a95b469ae.jpg saved to cache
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 586c1eaf-1f2e-59cf-8176-275edac29733
2026-03-27 10:35:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3d71d0>
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_51bee5d6516471bcd701572a0286015c.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_51bee5d6516471bcd701572a0286015c.jpg saved to cache
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 586c1eaf-1f2e-59cf-8176-275edac29733
2026-03-27 10:35:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf41d350>
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_a125fc940f03d9302f31a83c6eef3f5d.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_a125fc940f03d9302f31a83c6eef3f5d.jpg saved to cache
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 586c1eaf-1f2e-59cf-8176-275edac29733
2026-03-27 10:35:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf569e10>
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_d2a3ce611ec68929316b7ca684868c6c.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_d2a3ce611ec68929316b7ca684868c6c.jpg saved to cache
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 586c1eaf-1f2e-59cf-8176-275edac29733
2026-03-27 10:35:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf41eb10>
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_158324d7d382bfd7c8fbfe7a365042a6.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_158324d7d382bfd7c8fbfe7a365042a6.jpg saved to cache
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 586c1eaf-1f2e-59cf-8176-275edac29733
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be288810>
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_a9d1e5c0ddb706a929e787d37a0cdc8c.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_a9d1e5c0ddb706a929e787d37a0cdc8c.jpg saved to cache
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea48d560-4562-5752-a0ac-fde215f74872
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5b2c90>
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_222c8a3e7b1df294729388c0daa250cc.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_222c8a3e7b1df294729388c0daa250cc.jpg saved to cache
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea48d560-4562-5752-a0ac-fde215f74872
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf41cb50>
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_3a7f483b67ab02032fcdf8ab29259781.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_3a7f483b67ab02032fcdf8ab29259781.jpg saved to cache
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea48d560-4562-5752-a0ac-fde215f74872
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F57%252F4b5730a5cc575190ee92746bf1af77ca%252Fpa%252FML20845_c2c63bd02c6a81712825f1ad6097d94e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_c2c63bd02c6a81712825f1ad6097d94e.jpg not downloaded yet
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F57%252F4b5730a5cc575190ee92746bf1af77ca%252Fpa%252FML20845_5527d0fc74c48df38c692def2171e6a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_5527d0fc74c48df38c692def2171e6a7.jpg not downloaded yet
2026-03-27 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_f2d2533691e92d085d3c4e9eecec6163.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_aedcb83c4da2380fba9be92ce6c2a09d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_1f6c7cf2432add706a674b7fbe082783.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_c0aa2bccbb59cc468e275bcd5d025e49.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_83b034229ed74101143dd0f116ba92b7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_cfbac3de07726c2c93695e28f5e73a47.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_c2c63bd02c6a81712825f1ad6097d94e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be16b9d0>
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_f2d2533691e92d085d3c4e9eecec6163.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_f2d2533691e92d085d3c4e9eecec6163.jpg saved to cache
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea48d560-4562-5752-a0ac-fde215f74872
2026-03-27 10:35:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be168ad0>
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcc%252F37cc5b5225a5d6c3da251dceff9eac77%252Fpa%252FFL90187_aedcb83c4da2380fba9be92ce6c2a09d.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_aedcb83c4da2380fba9be92ce6c2a09d.jpg saved to cache
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea48d560-4562-5752-a0ac-fde215f74872
2026-03-27 10:35:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea48d560-4562-5752-a0ac-fde215f74872, skipping ID generation
2026-03-27 10:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea48d560-4562-5752-a0ac-fde215f74872 with scrape type 1
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea48d560-4562-5752-a0ac-fde215f74872 sending to next pipeline
2026-03-27 10:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea48d560-4562-5752-a0ac-fde215f74872, identifier: FL90187
2026-03-27 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_e543ecba9ac2c900194900c1379a79f5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea48d560-4562-5752-a0ac-fde215f74872 with identifier: FL90187
2026-03-27 10:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea48d560-4562-5752-a0ac-fde215f74872 with identifier: FL90187
2026-03-27 10:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea48d560-4562-5752-a0ac-fde215f74872 with identifier: FL90187 to the API
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_aedcb83c4da2380fba9be92ce6c2a09d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 85,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 141,
'expiration_date': '2026-03-28T16:17:56Z',
'fuel_type': 'hybrid',
'id': 'ea48d560-4562-5752-a0ac-fde215f74872',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL90187',
'listing': 'auction',
'location': 'DE, Esslingen am Neckar',
'make': 'Hyundai',
'model': 'IONIQ',
'odometer': 129751,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2874044,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_f2d2533691e92d085d3c4e9eecec6163.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2959515,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_aedcb83c4da2380fba9be92ce6c2a09d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_010abdd798ad53c448af144468e63e89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_e2ea3a4c7636018c8a9b9477d438ba2f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64075,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_a9d1e5c0ddb706a929e787d37a0cdc8c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_222c8a3e7b1df294729388c0daa250cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60442,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_41030b1590c686c44ed3f4544a59a2e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_7fb370bb92079eda994d6332396c4c52.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_e996ebd23e83ab8387341160a7e5b899.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea48d560-4562-5752-a0ac-fde215f74872/ea48d560-4562-5752-a0ac-fde215f74872_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/cc/37cc5b5225a5d6c3da251dceff9eac77/pa/FL90187_3a7f483b67ab02032fcdf8ab29259781.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai IONIQ 1.6 Hybrid Premium',
'transmission': 'automatic',
'trim': 'Premium',
'year': 2019}
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL90187%27 HTTP/1.1" 200 None
2026-03-27 10:35:57 [auto1.de] INFO: Saving data for FL90187: {'created_time': 1774607757.700651, 'last_price_update_time': 1774607757.700664, 'auction_closing_time': 1774714676.0}
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL90187') HTTP/1.1" 204 0
2026-03-27 10:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_c2f5b49e646265334cd7df9d96a201f2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be164ed0>
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f2868b7-433f-50d8-ac6a-a958a1d92063/3f2868b7-433f-50d8-ac6a-a958a1d92063_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F57%252F4b5730a5cc575190ee92746bf1af77ca%252Fpa%252FML20845_1f6c7cf2432add706a674b7fbe082783.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_1f6c7cf2432add706a674b7fbe082783.jpg saved to cache
2026-03-27 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f2868b7-433f-50d8-ac6a-a958a1d92063
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be263a10>
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f2868b7-433f-50d8-ac6a-a958a1d92063/3f2868b7-433f-50d8-ac6a-a958a1d92063_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F57%252F4b5730a5cc575190ee92746bf1af77ca%252Fpa%252FML20845_c0aa2bccbb59cc468e275bcd5d025e49.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_c0aa2bccbb59cc468e275bcd5d025e49.jpg saved to cache
2026-03-27 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f2868b7-433f-50d8-ac6a-a958a1d92063
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1bae10>
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f2868b7-433f-50d8-ac6a-a958a1d92063/3f2868b7-433f-50d8-ac6a-a958a1d92063_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F57%252F4b5730a5cc575190ee92746bf1af77ca%252Fpa%252FML20845_83b034229ed74101143dd0f116ba92b7.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_83b034229ed74101143dd0f116ba92b7.jpg saved to cache
2026-03-27 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f2868b7-433f-50d8-ac6a-a958a1d92063
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2ea410>
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_cfbac3de07726c2c93695e28f5e73a47.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_cfbac3de07726c2c93695e28f5e73a47.jpg saved to cache
2026-03-27 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf569290>
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f2868b7-433f-50d8-ac6a-a958a1d92063/3f2868b7-433f-50d8-ac6a-a958a1d92063_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F57%252F4b5730a5cc575190ee92746bf1af77ca%252Fpa%252FML20845_c2c63bd02c6a81712825f1ad6097d94e.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_c2c63bd02c6a81712825f1ad6097d94e.jpg saved to cache
2026-03-27 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f2868b7-433f-50d8-ac6a-a958a1d92063
2026-03-27 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_05b6b80a5bf6aa252c401f6ad50d95b6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF83806> (referer: https://www.auto1.com/v1/car-details-view/VF83806/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be12ed10>
2026-03-27 10:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_e543ecba9ac2c900194900c1379a79f5.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_e543ecba9ac2c900194900c1379a79f5.jpg saved to cache
2026-03-27 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5964004e-ccba-5eb3-b356-c02efb1ccb3c
2026-03-27 10:35:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be114690>
2026-03-27 10:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ff1%252Fb3f19f9d65e2854db966150b50e10e7c%252Fpa%252FGT57416_c2f5b49e646265334cd7df9d96a201f2.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_c2f5b49e646265334cd7df9d96a201f2.jpg saved to cache
2026-03-27 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 586c1eaf-1f2e-59cf-8176-275edac29733
2026-03-27 10:35:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 586c1eaf-1f2e-59cf-8176-275edac29733, skipping ID generation
2026-03-27 10:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 586c1eaf-1f2e-59cf-8176-275edac29733 with scrape type 1
2026-03-27 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 586c1eaf-1f2e-59cf-8176-275edac29733 sending to next pipeline
2026-03-27 10:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 586c1eaf-1f2e-59cf-8176-275edac29733, identifier: GT57416
2026-03-27 10:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 586c1eaf-1f2e-59cf-8176-275edac29733 with identifier: GT57416
2026-03-27 10:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 586c1eaf-1f2e-59cf-8176-275edac29733 with identifier: GT57416
2026-03-27 10:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 586c1eaf-1f2e-59cf-8176-275edac29733 with identifier: GT57416 to the API
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_c2f5b49e646265334cd7df9d96a201f2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:06:03Z',
'fuel_type': 'diesel',
'id': '586c1eaf-1f2e-59cf-8176-275edac29733',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT57416',
'listing': 'auction',
'location': 'DE, Aschaffenburg',
'make': 'Hyundai',
'model': 'i30',
'odometer': 170364,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_8f5ebd4fb5a4007e69b7d8e952927a59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3030590,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_d2a3ce611ec68929316b7ca684868c6c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2970157,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_2b92783d203b8c9518ba1f6a95b469ae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2952850,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_a125fc940f03d9302f31a83c6eef3f5d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2954934,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_51bee5d6516471bcd701572a0286015c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82978,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_74cce6f241b8ff4bcdbcb7c12eb1696c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72041,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_c2f5b49e646265334cd7df9d96a201f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2916135,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_158324d7d382bfd7c8fbfe7a365042a6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_57a19b7427d55131ff0e54d2ee252c96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586c1eaf-1f2e-59cf-8176-275edac29733/586c1eaf-1f2e-59cf-8176-275edac29733_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90111,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/f1/b3f19f9d65e2854db966150b50e10e7c/pa/GT57416_ccbd85c33da5ed40d84c12bbc9689db8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-09-03',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai i30 1.6 CRDi YES!',
'transmission': 'manual',
'trim': 'YES!',
'year': 2015}
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT57416%27 HTTP/1.1" 200 None
2026-03-27 10:35:58 [auto1.de] INFO: Saving data for GT57416: {'created_time': 1774607758.615614, 'last_price_update_time': 1774607758.615626, 'auction_closing_time': 1774713963.0}
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT57416') HTTP/1.1" 204 0
2026-03-27 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_05d0dcfaa5ecb13be6c58eaa01fbf3c5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_c0b5201c439f9d18f2d06f219ad32981.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_51936f050ae0741b6bc818c81d159f72.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_5cbdea91213a348f1581dd18ce84f05c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_07a172696a4ac56d9a6272e43ea79739.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf475510>
2026-03-27 10:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a758a659-716e-5297-8a6b-9aeaccb932cf/a758a659-716e-5297-8a6b-9aeaccb932cf_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F26%252F59261937c27b9b5f4da53d0bc02018c1%252Fpa%252FLF03511_05b6b80a5bf6aa252c401f6ad50d95b6.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_05b6b80a5bf6aa252c401f6ad50d95b6.jpg saved to cache
2026-03-27 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a758a659-716e-5297-8a6b-9aeaccb932cf
2026-03-27 10:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe0ab5d1-9d66-5491-a417-b1c4ee15209c with identifier: VF83806
2026-03-27 10:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe0ab5d1-9d66-5491-a417-b1c4ee15209c with scrape type 1
2026-03-27 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item fe0ab5d1-9d66-5491-a417-b1c4ee15209c
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Ffe%252F2afed71757616399bc9e4db400132c98%252Fpa%252FVF83806_54654d19561c3468630abac91bcc4fe8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_54654d19561c3468630abac91bcc4fe8.jpg not downloaded yet
2026-03-27 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_5527d0fc74c48df38c692def2171e6a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Ffe%252F2afed71757616399bc9e4db400132c98%252Fpa%252FVF83806_1783d3e7b587f984713f02f75f946ea5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_1783d3e7b587f984713f02f75f946ea5.jpg not downloaded yet
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2f1b50>
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a758a659-716e-5297-8a6b-9aeaccb932cf/a758a659-716e-5297-8a6b-9aeaccb932cf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F26%252F59261937c27b9b5f4da53d0bc02018c1%252Fpa%252FLF03511_05d0dcfaa5ecb13be6c58eaa01fbf3c5.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_05d0dcfaa5ecb13be6c58eaa01fbf3c5.jpg saved to cache
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a758a659-716e-5297-8a6b-9aeaccb932cf
2026-03-27 10:35:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a758a659-716e-5297-8a6b-9aeaccb932cf, skipping ID generation
2026-03-27 10:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a758a659-716e-5297-8a6b-9aeaccb932cf with scrape type 1
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a758a659-716e-5297-8a6b-9aeaccb932cf sending to next pipeline
2026-03-27 10:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a758a659-716e-5297-8a6b-9aeaccb932cf, identifier: LF03511
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3df750>
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_c0b5201c439f9d18f2d06f219ad32981.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_c0b5201c439f9d18f2d06f219ad32981.jpg saved to cache
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1fbd10>
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_51936f050ae0741b6bc818c81d159f72.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_51936f050ae0741b6bc818c81d159f72.jpg saved to cache
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4e3250>
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_5cbdea91213a348f1581dd18ce84f05c.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_5cbdea91213a348f1581dd18ce84f05c.jpg saved to cache
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1ea610>
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_07a172696a4ac56d9a6272e43ea79739.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_07a172696a4ac56d9a6272e43ea79739.jpg saved to cache
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Ffe%252F2afed71757616399bc9e4db400132c98%252Fpa%252FVF83806_305d4e19e6ee43c227ef6e04161f41cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_305d4e19e6ee43c227ef6e04161f41cf.jpg not downloaded yet
2026-03-27 10:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a758a659-716e-5297-8a6b-9aeaccb932cf with identifier: LF03511
2026-03-27 10:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a758a659-716e-5297-8a6b-9aeaccb932cf with identifier: LF03511
2026-03-27 10:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a758a659-716e-5297-8a6b-9aeaccb932cf with identifier: LF03511 to the API
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_05d0dcfaa5ecb13be6c58eaa01fbf3c5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:17:38Z',
'fuel_type': 'diesel',
'id': 'a758a659-716e-5297-8a6b-9aeaccb932cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF03511',
'listing': 'auction',
'location': 'DE, Montabaur',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 383480,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a758a659-716e-5297-8a6b-9aeaccb932cf/a758a659-716e-5297-8a6b-9aeaccb932cf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_05d0dcfaa5ecb13be6c58eaa01fbf3c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a758a659-716e-5297-8a6b-9aeaccb932cf/a758a659-716e-5297-8a6b-9aeaccb932cf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74338,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_05b6b80a5bf6aa252c401f6ad50d95b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a758a659-716e-5297-8a6b-9aeaccb932cf/a758a659-716e-5297-8a6b-9aeaccb932cf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_76f202ebb300a0c707851380d08910eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a758a659-716e-5297-8a6b-9aeaccb932cf/a758a659-716e-5297-8a6b-9aeaccb932cf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_cc073757be53a89da1525a18941022d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a758a659-716e-5297-8a6b-9aeaccb932cf/a758a659-716e-5297-8a6b-9aeaccb932cf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/26/59261937c27b9b5f4da53d0bc02018c1/pa/LF03511_612cd536ca86dab77e2629b2f9cefac8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.6 TDI Team BlueMotion',
'transmission': 'manual',
'trim': 'Team BlueMotion',
'year': 2011}
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF03511%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [auto1.de] INFO: Saving data for LF03511: {'created_time': 1774607759.881561, 'last_price_update_time': 1774607759.881573, 'auction_closing_time': 1774714658.0}
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF03511') HTTP/1.1" 204 0
2026-03-27 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_46a9aafee079d910853a6e355f1b71ab.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Ffe%252F2afed71757616399bc9e4db400132c98%252Fpa%252FVF83806_e24164cc78a16e01d709d8be15184f6a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_e24164cc78a16e01d709d8be15184f6a.jpg not downloaded yet
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be010490>
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f2868b7-433f-50d8-ac6a-a958a1d92063/3f2868b7-433f-50d8-ac6a-a958a1d92063_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F57%252F4b5730a5cc575190ee92746bf1af77ca%252Fpa%252FML20845_5527d0fc74c48df38c692def2171e6a7.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_5527d0fc74c48df38c692def2171e6a7.jpg saved to cache
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f2868b7-433f-50d8-ac6a-a958a1d92063
2026-03-27 10:35:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f2868b7-433f-50d8-ac6a-a958a1d92063, skipping ID generation
2026-03-27 10:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f2868b7-433f-50d8-ac6a-a958a1d92063 with scrape type 1
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f2868b7-433f-50d8-ac6a-a958a1d92063 sending to next pipeline
2026-03-27 10:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f2868b7-433f-50d8-ac6a-a958a1d92063, identifier: ML20845
2026-03-27 10:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f2868b7-433f-50d8-ac6a-a958a1d92063 with identifier: ML20845
2026-03-27 10:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f2868b7-433f-50d8-ac6a-a958a1d92063 with identifier: ML20845
2026-03-27 10:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f2868b7-433f-50d8-ac6a-a958a1d92063 with identifier: ML20845 to the API
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_5527d0fc74c48df38c692def2171e6a7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 172,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:59:10Z',
'fuel_type': 'petrol',
'id': '3f2868b7-433f-50d8-ac6a-a958a1d92063',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML20845',
'listing': 'auction',
'location': 'DE, Wuppertal',
'make': 'Mazda',
'model': '3',
'odometer': 177919,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2868b7-433f-50d8-ac6a-a958a1d92063/3f2868b7-433f-50d8-ac6a-a958a1d92063_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_1f6c7cf2432add706a674b7fbe082783.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2868b7-433f-50d8-ac6a-a958a1d92063/3f2868b7-433f-50d8-ac6a-a958a1d92063_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_c0aa2bccbb59cc468e275bcd5d025e49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2868b7-433f-50d8-ac6a-a958a1d92063/3f2868b7-433f-50d8-ac6a-a958a1d92063_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_83b034229ed74101143dd0f116ba92b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2868b7-433f-50d8-ac6a-a958a1d92063/3f2868b7-433f-50d8-ac6a-a958a1d92063_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78786,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_c2c63bd02c6a81712825f1ad6097d94e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2868b7-433f-50d8-ac6a-a958a1d92063/3f2868b7-433f-50d8-ac6a-a958a1d92063_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/57/4b5730a5cc575190ee92746bf1af77ca/pa/ML20845_5527d0fc74c48df38c692def2171e6a7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2005-09-06',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda 3 1.6 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2005}
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML20845%27 HTTP/1.1" 200 None
2026-03-27 10:36:00 [auto1.de] INFO: Saving data for ML20845: {'created_time': 1774607760.561515, 'last_price_update_time': 1774607760.561527, 'auction_closing_time': 1774717150.0}
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML20845') HTTP/1.1" 204 0
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Ffe%252F2afed71757616399bc9e4db400132c98%252Fpa%252FVF83806_2c1ba883d04f17a2132cc6629be9b7d9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_2c1ba883d04f17a2132cc6629be9b7d9.jpg not downloaded yet
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf497190>
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F16%252F4c16947b3a1af7b588232616dcb89e1a%252Fpa%252FVP53971_46a9aafee079d910853a6e355f1b71ab.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_46a9aafee079d910853a6e355f1b71ab.jpg saved to cache
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4
2026-03-27 10:36:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4, skipping ID generation
2026-03-27 10:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4 with scrape type 1
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4 sending to next pipeline
2026-03-27 10:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4, identifier: VP53971
2026-03-27 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_305d4e19e6ee43c227ef6e04161f41cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4 with identifier: VP53971
2026-03-27 10:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4 with identifier: VP53971
2026-03-27 10:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 510f7c3b-f861-5e6a-8d56-af1e5fde3ed4 with identifier: VP53971 to the API
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_46a9aafee079d910853a6e355f1b71ab.jpg>
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 73,
'expiration_date': '2026-03-28T16:25:00Z',
'fuel_type': 'petrol',
'id': '510f7c3b-f861-5e6a-8d56-af1e5fde3ed4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP53971',
'listing': 'auction',
'location': 'DE, Zörbig',
'make': 'Nissan',
'model': 'Micra',
'odometer': 168031,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79992,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_46a9aafee079d910853a6e355f1b71ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64626,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_72ef8cfada6f3607c106623c57382f19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81142,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_a29ce574a3360f49b9c0821d3940ffeb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60855,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_888d1c9446121fe8797aa298c83a486c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78084,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_478427d402ef59abbacdb9d353dc98b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_2082cd9518d0dd2fe69253757769f66f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58051,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_ddc82641f585772470877deabd9d8629.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76258,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_50714bdd94df1fbcabd11db4b2fbef8d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_9c7b858b51bd9679eca4c48b537f8e1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510f7c3b-f861-5e6a-8d56-af1e5fde3ed4/510f7c3b-f861-5e6a-8d56-af1e5fde3ed4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/16/4c16947b3a1af7b588232616dcb89e1a/pa/VP53971_8a6bd098f8d27ccc2eee0c1b49e81d3c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-06-13',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Micra 1.0 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2018}
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP53971%27 HTTP/1.1" 200 None
2026-03-27 10:36:01 [auto1.de] INFO: Saving data for VP53971: {'created_time': 1774607761.313211, 'last_price_update_time': 1774607761.313225, 'auction_closing_time': 1774715100.0}
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP53971') HTTP/1.1" 204 0
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP37345/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT08525/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN78852/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN18911/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf484990>
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe0ab5d1-9d66-5491-a417-b1c4ee15209c/fe0ab5d1-9d66-5491-a417-b1c4ee15209c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Ffe%252F2afed71757616399bc9e4db400132c98%252Fpa%252FVF83806_305d4e19e6ee43c227ef6e04161f41cf.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_305d4e19e6ee43c227ef6e04161f41cf.jpg saved to cache
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe0ab5d1-9d66-5491-a417-b1c4ee15209c
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_2c1ba883d04f17a2132cc6629be9b7d9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_752739324bb12b7ffa1e31ed9db1c732.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_d79b80bcba23b048d2c342abbf868c62.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_c99487bf31a2fb2d60c62729f3b7bd1e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_df6f41ee4ead0f711354f0a306672cc4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_54654d19561c3468630abac91bcc4fe8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_e24164cc78a16e01d709d8be15184f6a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_1783d3e7b587f984713f02f75f946ea5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf572bd0>
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe0ab5d1-9d66-5491-a417-b1c4ee15209c/fe0ab5d1-9d66-5491-a417-b1c4ee15209c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Ffe%252F2afed71757616399bc9e4db400132c98%252Fpa%252FVF83806_2c1ba883d04f17a2132cc6629be9b7d9.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_2c1ba883d04f17a2132cc6629be9b7d9.jpg saved to cache
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe0ab5d1-9d66-5491-a417-b1c4ee15209c
2026-03-27 10:36:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2ef750>
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F23%252Fdc236ada368dd2595cddd5acc7504c2e%252Fpa%252FWY87564_752739324bb12b7ffa1e31ed9db1c732.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_752739324bb12b7ffa1e31ed9db1c732.jpg saved to cache
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b
2026-03-27 10:36:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b, skipping ID generation
2026-03-27 10:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b with scrape type 1
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b sending to next pipeline
2026-03-27 10:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b, identifier: WY87564
2026-03-27 10:36:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c57edd50>
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F9c%252F709c0ef7078166c8d9c621f72c045701%252Fpa%252FMJ13308_d79b80bcba23b048d2c342abbf868c62.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_d79b80bcba23b048d2c342abbf868c62.jpg saved to cache
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 008cc6e2-55c5-5480-8821-9f7a501d47fe
2026-03-27 10:36:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 008cc6e2-55c5-5480-8821-9f7a501d47fe, skipping ID generation
2026-03-27 10:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 008cc6e2-55c5-5480-8821-9f7a501d47fe with scrape type 1
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 008cc6e2-55c5-5480-8821-9f7a501d47fe sending to next pipeline
2026-03-27 10:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 008cc6e2-55c5-5480-8821-9f7a501d47fe, identifier: MJ13308
2026-03-27 10:36:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1b8b90>
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fbf%252Fb5bf9994d40f43d7d005c06053383117%252Fpa%252FYM57013_c99487bf31a2fb2d60c62729f3b7bd1e.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_c99487bf31a2fb2d60c62729f3b7bd1e.jpg saved to cache
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5964004e-ccba-5eb3-b356-c02efb1ccb3c
2026-03-27 10:36:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5964004e-ccba-5eb3-b356-c02efb1ccb3c, skipping ID generation
2026-03-27 10:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5964004e-ccba-5eb3-b356-c02efb1ccb3c with scrape type 1
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5964004e-ccba-5eb3-b356-c02efb1ccb3c sending to next pipeline
2026-03-27 10:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5964004e-ccba-5eb3-b356-c02efb1ccb3c, identifier: YM57013
2026-03-27 10:36:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf36d150>
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F86%252F8b86642263c27913a47e156778ac94c1%252Fpa%252FKZ23226_df6f41ee4ead0f711354f0a306672cc4.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_df6f41ee4ead0f711354f0a306672cc4.jpg saved to cache
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0207ab47-9552-5274-a98e-1707cca2d7f1
2026-03-27 10:36:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0207ab47-9552-5274-a98e-1707cca2d7f1, skipping ID generation
2026-03-27 10:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0207ab47-9552-5274-a98e-1707cca2d7f1 with scrape type 1
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0207ab47-9552-5274-a98e-1707cca2d7f1 sending to next pipeline
2026-03-27 10:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0207ab47-9552-5274-a98e-1707cca2d7f1, identifier: KZ23226
2026-03-27 10:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b with identifier: WY87564
2026-03-27 10:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b with identifier: WY87564
2026-03-27 10:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b with identifier: WY87564 to the API
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_752739324bb12b7ffa1e31ed9db1c732.jpg>
{'auction_title': '',
'c_o_2_emission_value': 185,
'category': 'Rental',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '1.8L',
'engine_horse_power': 155,
'expiration_date': '2026-03-28T16:19:13Z',
'fuel_type': 'petrol',
'id': 'b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY87564',
'listing': 'auction',
'location': 'DE, Osnabrück',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 161857,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80831,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_79dc9c3f364ed2826db3dd57a6c5d244.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_675c04f49a94f0ca5364f562be076f83.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69149,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_51936f050ae0741b6bc818c81d159f72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68811,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_07a172696a4ac56d9a6272e43ea79739.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_5cbdea91213a348f1581dd18ce84f05c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_c0b5201c439f9d18f2d06f219ad32981.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_8c8b98f0a9c8b0090d1b44f42e5e5e08.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2801507,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_8a63f6070985b0a3a854866a24576135.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2823689,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_752739324bb12b7ffa1e31ed9db1c732.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b/b8bf8f2d-5cf9-5a6e-88ba-91d62afb887b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80169,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/23/dc236ada368dd2595cddd5acc7504c2e/pa/WY87564_cfbac3de07726c2c93695e28f5e73a47.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-11-12',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2008}
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY87564%27 HTTP/1.1" 200 None
2026-03-27 10:36:03 [auto1.de] INFO: Saving data for WY87564: {'created_time': 1774607763.032955, 'last_price_update_time': 1774607763.032968, 'auction_closing_time': 1774714753.0}
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY87564') HTTP/1.1" 204 0
2026-03-27 10:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 008cc6e2-55c5-5480-8821-9f7a501d47fe with identifier: MJ13308
2026-03-27 10:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 008cc6e2-55c5-5480-8821-9f7a501d47fe with identifier: MJ13308
2026-03-27 10:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 008cc6e2-55c5-5480-8821-9f7a501d47fe with identifier: MJ13308 to the API
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_d79b80bcba23b048d2c342abbf868c62.jpg>
{'auction_title': '',
'c_o_2_emission_value': 178,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.2L',
'engine_horse_power': 197,
'expiration_date': '2026-03-28T16:07:07Z',
'fuel_type': 'diesel',
'id': '008cc6e2-55c5-5480-8821-9f7a501d47fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ13308',
'listing': 'auction',
'location': 'DE, Pforzheim',
'make': 'Kia',
'model': 'Sorento',
'odometer': 206699,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2408661,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_d79b80bcba23b048d2c342abbf868c62.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2424518,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_a9a3d8479be7ffa75779e88f71d83996.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58103,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_4ed6991dcb8a6390507983199d3cc80b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41392,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_6cf369c0da9d9789a2ac5d18d8127952.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55873,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_2103804fd24f8e24cc5b85be9f98f8cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_bd14ebf5330e9f3858c59ee50cbdd094.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2169535,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_45eafe435a8e205ac388de980c015e15.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_4104e72b8e1beffe297125f9d599fd32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2308510,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_75929170ba6cc24a431114aff2717f0d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_008cc6e2-55c5-5480-8821-9f7a501d47fe/008cc6e2-55c5-5480-8821-9f7a501d47fe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/9c/709c0ef7078166c8d9c621f72c045701/pa/MJ13308_23c26123b56da18689d671fdebc7b596.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-01-05',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
'transmission': 'automatic',
'trim': 'Platinum Edition 4WD',
'year': 2015}
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ13308%27 HTTP/1.1" 200 None
2026-03-27 10:36:03 [auto1.de] INFO: Saving data for MJ13308: {'created_time': 1774607763.846868, 'last_price_update_time': 1774607763.846879, 'auction_closing_time': 1774714027.0}
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ13308') HTTP/1.1" 204 0
2026-03-27 10:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5964004e-ccba-5eb3-b356-c02efb1ccb3c with identifier: YM57013
2026-03-27 10:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5964004e-ccba-5eb3-b356-c02efb1ccb3c with identifier: YM57013
2026-03-27 10:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5964004e-ccba-5eb3-b356-c02efb1ccb3c with identifier: YM57013 to the API
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_c99487bf31a2fb2d60c62729f3b7bd1e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:09:31Z',
'fuel_type': 'diesel',
'id': '5964004e-ccba-5eb3-b356-c02efb1ccb3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM57013',
'listing': 'auction',
'location': 'DE, Brühl',
'make': 'Mercedes-Benz',
'model': 'Citan',
'odometer': 211087,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3056569,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_c99487bf31a2fb2d60c62729f3b7bd1e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69136,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_e543ecba9ac2c900194900c1379a79f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78963,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_06cf1cc3cd551efb4d2935ee031fa7b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2920442,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_e8f5bf4b1ca39348c5df92546a2379ba.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2980890,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_1e8a00121e675a419128a13ae74ae6ae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2961488,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_f0be32dd29c3fd4d2376ce58331a80ca.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2923702,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_b34dd64aae1a991f934f8c18fd674c81.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2923292,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_dab7f07c66e9e262069b8e4e6101fd45.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_d43330be9defe57a8c088395ce53f09f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5964004e-ccba-5eb3-b356-c02efb1ccb3c/5964004e-ccba-5eb3-b356-c02efb1ccb3c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90120,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/bf/b5bf9994d40f43d7d005c06053383117/pa/YM57013_866c0cee2fc10f3118a507287d3e3f2b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-04-26',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz Citan 111 CDI lang Tourer Edition',
'transmission': 'manual',
'trim': 'lang Tourer Edition',
'year': 2017}
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM57013%27 HTTP/1.1" 200 None
2026-03-27 10:36:04 [auto1.de] INFO: Saving data for YM57013: {'created_time': 1774607764.271107, 'last_price_update_time': 1774607764.271123, 'auction_closing_time': 1774714171.0}
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM57013') HTTP/1.1" 204 0
2026-03-27 10:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0207ab47-9552-5274-a98e-1707cca2d7f1 with identifier: KZ23226
2026-03-27 10:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0207ab47-9552-5274-a98e-1707cca2d7f1 with identifier: KZ23226
2026-03-27 10:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0207ab47-9552-5274-a98e-1707cca2d7f1 with identifier: KZ23226 to the API
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_df6f41ee4ead0f711354f0a306672cc4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:59:58Z',
'fuel_type': 'diesel',
'id': '0207ab47-9552-5274-a98e-1707cca2d7f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ23226',
'listing': 'auction',
'location': 'DE, Greifswald',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 391269,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_fa17c131f70adc323191eb4677807a3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2830715,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_7c365458c919bd6edf38b236c1430c1d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_382c0487c1dd6056f6123b43a25b1b0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_761e72865feb52bb9eb882835c692921.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2714927,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_df6f41ee4ead0f711354f0a306672cc4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2636526,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_78cef2912ae2c7d755083a9fb608e499.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63128,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_92025e51a72c2ed23774cec7d50e8ba4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2725442,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_bab6d0a5d4fffcfc9d6d8e1fd624e89e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77647,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_d7a7156ce8fafd7ee0d8ac730a16cde0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0207ab47-9552-5274-a98e-1707cca2d7f1/0207ab47-9552-5274-a98e-1707cca2d7f1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/86/8b86642263c27913a47e156778ac94c1/pa/KZ23226_825b1fae5c52a8d8f49793c7608cc010.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-05-19',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2016}
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ23226%27 HTTP/1.1" 200 None
2026-03-27 10:36:04 [auto1.de] INFO: Saving data for KZ23226: {'created_time': 1774607764.75031, 'last_price_update_time': 1774607764.750321, 'auction_closing_time': 1774717198.0}
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ23226') HTTP/1.1" 204 0
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3d7bd0>
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe0ab5d1-9d66-5491-a417-b1c4ee15209c/fe0ab5d1-9d66-5491-a417-b1c4ee15209c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Ffe%252F2afed71757616399bc9e4db400132c98%252Fpa%252FVF83806_54654d19561c3468630abac91bcc4fe8.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_54654d19561c3468630abac91bcc4fe8.jpg saved to cache
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe0ab5d1-9d66-5491-a417-b1c4ee15209c
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be084410>
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe0ab5d1-9d66-5491-a417-b1c4ee15209c/fe0ab5d1-9d66-5491-a417-b1c4ee15209c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Ffe%252F2afed71757616399bc9e4db400132c98%252Fpa%252FVF83806_e24164cc78a16e01d709d8be15184f6a.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_e24164cc78a16e01d709d8be15184f6a.jpg saved to cache
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe0ab5d1-9d66-5491-a417-b1c4ee15209c
2026-03-27 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC05156/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA14502/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL08327/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC15219> (referer: https://www.auto1.com/v1/car-details-view/VC15219/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be288590>
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe0ab5d1-9d66-5491-a417-b1c4ee15209c/fe0ab5d1-9d66-5491-a417-b1c4ee15209c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Ffe%252F2afed71757616399bc9e4db400132c98%252Fpa%252FVF83806_1783d3e7b587f984713f02f75f946ea5.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_1783d3e7b587f984713f02f75f946ea5.jpg saved to cache
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe0ab5d1-9d66-5491-a417-b1c4ee15209c
2026-03-27 10:36:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe0ab5d1-9d66-5491-a417-b1c4ee15209c, skipping ID generation
2026-03-27 10:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe0ab5d1-9d66-5491-a417-b1c4ee15209c with scrape type 1
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe0ab5d1-9d66-5491-a417-b1c4ee15209c sending to next pipeline
2026-03-27 10:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe0ab5d1-9d66-5491-a417-b1c4ee15209c, identifier: VF83806
2026-03-27 10:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe0ab5d1-9d66-5491-a417-b1c4ee15209c with identifier: VF83806
2026-03-27 10:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe0ab5d1-9d66-5491-a417-b1c4ee15209c with identifier: VF83806
2026-03-27 10:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe0ab5d1-9d66-5491-a417-b1c4ee15209c with identifier: VF83806 to the API
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_1783d3e7b587f984713f02f75f946ea5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:47:44Z',
'fuel_type': 'diesel',
'id': 'fe0ab5d1-9d66-5491-a417-b1c4ee15209c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF83806',
'listing': 'auction',
'location': 'DE, Elmshorn',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 178140,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0ab5d1-9d66-5491-a417-b1c4ee15209c/fe0ab5d1-9d66-5491-a417-b1c4ee15209c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_54654d19561c3468630abac91bcc4fe8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0ab5d1-9d66-5491-a417-b1c4ee15209c/fe0ab5d1-9d66-5491-a417-b1c4ee15209c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_1783d3e7b587f984713f02f75f946ea5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0ab5d1-9d66-5491-a417-b1c4ee15209c/fe0ab5d1-9d66-5491-a417-b1c4ee15209c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75878,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_305d4e19e6ee43c227ef6e04161f41cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0ab5d1-9d66-5491-a417-b1c4ee15209c/fe0ab5d1-9d66-5491-a417-b1c4ee15209c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_e24164cc78a16e01d709d8be15184f6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0ab5d1-9d66-5491-a417-b1c4ee15209c/fe0ab5d1-9d66-5491-a417-b1c4ee15209c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100558,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/fe/2afed71757616399bc9e4db400132c98/pa/VF83806_2c1ba883d04f17a2132cc6629be9b7d9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-05-10',
'seats_number': 2,
'seller_name': None,
'title': 'Volkswagen Caddy 1.6 TDI Kasten',
'transmission': 'manual',
'trim': 'Kasten',
'year': 2011}
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF83806%27 HTTP/1.1" 200 None
2026-03-27 10:36:05 [auto1.de] INFO: Saving data for VF83806: {'created_time': 1774607765.447724, 'last_price_update_time': 1774607765.447736, 'auction_closing_time': 1774716464.0}
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF83806') HTTP/1.1" 204 0
2026-03-27 10:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 176b6796-b315-5892-8a1f-c59c040a9398 with identifier: VC15219
2026-03-27 10:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 176b6796-b315-5892-8a1f-c59c040a9398 with scrape type 1
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 176b6796-b315-5892-8a1f-c59c040a9398
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_4db35900f060f9f6e17a058929304741.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_4db35900f060f9f6e17a058929304741.jpg not downloaded yet
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_14bb5d0b7e03a5896b3125a1d65df9c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_14bb5d0b7e03a5896b3125a1d65df9c0.jpg not downloaded yet
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_78d33f245ca3056bda1d460cd376ab22.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_78d33f245ca3056bda1d460cd376ab22.jpg not downloaded yet
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_524207f424a735cdafd09c77d6bbb159.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_524207f424a735cdafd09c77d6bbb159.jpg not downloaded yet
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_eb7dc858d61f43fe34586c053d71eb25.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_eb7dc858d61f43fe34586c053d71eb25.jpg not downloaded yet
2026-03-27 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_a5f26a84f349e0cbf3db925f42429f55.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_5689b33e7b11d7dde99e29ee7a1beab4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_5689b33e7b11d7dde99e29ee7a1beab4.jpg not downloaded yet
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_ef9e2712d77f1825765559fa4cfd4e6a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_ef9e2712d77f1825765559fa4cfd4e6a.jpg not downloaded yet
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_eb9cbc135d3283d7935bf78d8a627dc3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_eb9cbc135d3283d7935bf78d8a627dc3.jpg not downloaded yet
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_f9305222e9075d5ee214c74dc9dde3fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_f9305222e9075d5ee214c74dc9dde3fa.jpg not downloaded yet
2026-03-27 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_9de636dbaef46f1aaaa02369d6dafc57.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_c41c031d2ef42528343c028b4b0a9201.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_c41c031d2ef42528343c028b4b0a9201.jpg not downloaded yet
2026-03-27 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_eb7dc858d61f43fe34586c053d71eb25.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2ab310>
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_a5f26a84f349e0cbf3db925f42429f55.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_a5f26a84f349e0cbf3db925f42429f55.jpg saved to cache
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3fb4b2bf-cac9-5128-a161-31ade47b4930
2026-03-27 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_f934f161dc4d1bf16134a4632135e7f4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_09b71d89fdfe984f05676ae5ce93130b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c53c7850>
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_9de636dbaef46f1aaaa02369d6dafc57.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_9de636dbaef46f1aaaa02369d6dafc57.jpg saved to cache
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3fb4b2bf-cac9-5128-a161-31ade47b4930
2026-03-27 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_c41c031d2ef42528343c028b4b0a9201.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2f3d90>
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_eb7dc858d61f43fe34586c053d71eb25.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_eb7dc858d61f43fe34586c053d71eb25.jpg saved to cache
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 176b6796-b315-5892-8a1f-c59c040a9398
2026-03-27 10:36:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2aa990>
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_f934f161dc4d1bf16134a4632135e7f4.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_f934f161dc4d1bf16134a4632135e7f4.jpg saved to cache
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4875374d-89bd-5a6f-bca6-da0fbda33735
2026-03-27 10:36:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be090650>
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_09b71d89fdfe984f05676ae5ce93130b.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_09b71d89fdfe984f05676ae5ce93130b.jpg saved to cache
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4875374d-89bd-5a6f-bca6-da0fbda33735
2026-03-27 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_f9305222e9075d5ee214c74dc9dde3fa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_eb9cbc135d3283d7935bf78d8a627dc3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56d1b717d0>
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_c41c031d2ef42528343c028b4b0a9201.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_c41c031d2ef42528343c028b4b0a9201.jpg saved to cache
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 176b6796-b315-5892-8a1f-c59c040a9398
2026-03-27 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YF78558/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN21638/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_14bb5d0b7e03a5896b3125a1d65df9c0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_78d33f245ca3056bda1d460cd376ab22.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5c41110>
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_f9305222e9075d5ee214c74dc9dde3fa.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_f9305222e9075d5ee214c74dc9dde3fa.jpg saved to cache
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 176b6796-b315-5892-8a1f-c59c040a9398
2026-03-27 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_4db35900f060f9f6e17a058929304741.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_524207f424a735cdafd09c77d6bbb159.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be169390>
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_eb9cbc135d3283d7935bf78d8a627dc3.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_eb9cbc135d3283d7935bf78d8a627dc3.jpg saved to cache
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 176b6796-b315-5892-8a1f-c59c040a9398
2026-03-27 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_ef9e2712d77f1825765559fa4cfd4e6a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN78852> (referer: https://www.auto1.com/v1/car-details-view/BN78852/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be13bf90>
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_14bb5d0b7e03a5896b3125a1d65df9c0.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_14bb5d0b7e03a5896b3125a1d65df9c0.jpg saved to cache
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 176b6796-b315-5892-8a1f-c59c040a9398
2026-03-27 10:36:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT08525> (referer: https://www.auto1.com/v1/car-details-view/XT08525/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2f2110>
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_78d33f245ca3056bda1d460cd376ab22.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_78d33f245ca3056bda1d460cd376ab22.jpg saved to cache
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 176b6796-b315-5892-8a1f-c59c040a9398
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf386210>
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_4db35900f060f9f6e17a058929304741.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_4db35900f060f9f6e17a058929304741.jpg saved to cache
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 176b6796-b315-5892-8a1f-c59c040a9398
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2ee590>
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_524207f424a735cdafd09c77d6bbb159.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_524207f424a735cdafd09c77d6bbb159.jpg saved to cache
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 176b6796-b315-5892-8a1f-c59c040a9398
2026-03-27 10:36:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_5689b33e7b11d7dde99e29ee7a1beab4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_b2441d873a8e32edbfd3e3e12cf70160.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN18911> (referer: https://www.auto1.com/v1/car-details-view/RN18911/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be10fc90>
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_ef9e2712d77f1825765559fa4cfd4e6a.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_ef9e2712d77f1825765559fa4cfd4e6a.jpg saved to cache
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 176b6796-b315-5892-8a1f-c59c040a9398
2026-03-27 10:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ef4403a-87cf-5d9e-aad1-dc958444df3d with identifier: BN78852
2026-03-27 10:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ef4403a-87cf-5d9e-aad1-dc958444df3d with scrape type 1
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9ef4403a-87cf-5d9e-aad1-dc958444df3d
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_a1d2145810da6dd1da80db501ae4be2e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_a1d2145810da6dd1da80db501ae4be2e.jpg not downloaded yet
2026-03-27 10:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7 with identifier: XT08525
2026-03-27 10:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7 with scrape type 1
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e648d298a63c6e88572148a1b3cf%252Fpa%252FXT08525_07836a1e1ec89817d5a3834ec5611748.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_07836a1e1ec89817d5a3834ec5611748.jpg already downloaded
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e648d298a63c6e88572148a1b3cf%252Fpa%252FXT08525_fdf43ebba0090a8f20047d8dfd4b22f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_fdf43ebba0090a8f20047d8dfd4b22f2.jpg already downloaded
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e648d298a63c6e88572148a1b3cf%252Fpa%252FXT08525_bf06ec1075475a8d6180cba4643fbf10.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_bf06ec1075475a8d6180cba4643fbf10.jpg already downloaded
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e648d298a63c6e88572148a1b3cf%252Fpa%252FXT08525_4a71fed61af51671a1568916defba901.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_4a71fed61af51671a1568916defba901.jpg already downloaded
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e648d298a63c6e88572148a1b3cf%252Fpa%252FXT08525_1426d024cd877b0f8be7219aad7e2e46.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_1426d024cd877b0f8be7219aad7e2e46.jpg already downloaded
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e648d298a63c6e88572148a1b3cf%252Fpa%252FXT08525_fd617339d74e71555651b7d49a0264e9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_fd617339d74e71555651b7d49a0264e9.jpg already downloaded
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e648d298a63c6e88572148a1b3cf%252Fpa%252FXT08525_7220a53294124c8ea9011de87d26ff56.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_7220a53294124c8ea9011de87d26ff56.jpg already downloaded
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e648d298a63c6e88572148a1b3cf%252Fpa%252FXT08525_5931ee81e9096bf98de1a1491eefa344.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_5931ee81e9096bf98de1a1491eefa344.jpg already downloaded
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e648d298a63c6e88572148a1b3cf%252Fpa%252FXT08525_7fefdd0c7f0cb7bbacc5ce33189beaa5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_7fefdd0c7f0cb7bbacc5ce33189beaa5.jpg already downloaded
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e648d298a63c6e88572148a1b3cf%252Fpa%252FXT08525_aec9dd067cfbf05819ae8e89e8493151.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_aec9dd067cfbf05819ae8e89e8493151.jpg already downloaded
2026-03-27 10:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7, identifier: XT08525
2026-03-27 10:36:07 [scrapy.extensions.logstats] INFO: Crawled 248 pages (at 73 pages/min), scraped 149 items (at 49 items/min)
2026-03-27 10:36:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-27 10:36:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7 with identifier: XT08525
2026-03-27 10:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7 with identifier: XT08525
2026-03-27 10:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7 with identifier: XT08525 to the API
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XT08525>
{'auction_title': '',
'c_o_2_emission_value': 228,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '3.2L',
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:03:14Z',
'fuel_type': 'diesel',
'id': 'c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT08525',
'listing': 'auction',
'location': 'DE, Erbach',
'make': 'Ford',
'model': 'Ranger',
'odometer': 108800,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_07836a1e1ec89817d5a3834ec5611748.jpg',
'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_fdf43ebba0090a8f20047d8dfd4b22f2.jpg',
'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_bf06ec1075475a8d6180cba4643fbf10.jpg',
'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_4a71fed61af51671a1568916defba901.jpg',
'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_1426d024cd877b0f8be7219aad7e2e46.jpg',
'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_fd617339d74e71555651b7d49a0264e9.jpg',
'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_7220a53294124c8ea9011de87d26ff56.jpg',
'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_5931ee81e9096bf98de1a1491eefa344.jpg',
'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_7fefdd0c7f0cb7bbacc5ce33189beaa5.jpg',
'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_aec9dd067cfbf05819ae8e89e8493151.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7/c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78196,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_07836a1e1ec89817d5a3834ec5611748.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7/c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_fdf43ebba0090a8f20047d8dfd4b22f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7/c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_bf06ec1075475a8d6180cba4643fbf10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7/c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_4a71fed61af51671a1568916defba901.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7/c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68344,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_1426d024cd877b0f8be7219aad7e2e46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7/c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69324,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_fd617339d74e71555651b7d49a0264e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7/c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_7220a53294124c8ea9011de87d26ff56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7/c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72856,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_5931ee81e9096bf98de1a1491eefa344.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7/c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_7fefdd0c7f0cb7bbacc5ce33189beaa5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7/c4d2eef6-7a64-5ac7-92fb-5c8aa27eb6f7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e648d298a63c6e88572148a1b3cf/pa/XT08525_aec9dd067cfbf05819ae8e89e8493151.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-13',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Ranger 3.2 TDCi Doppelkabine 4x4 Wildtrak',
'transmission': 'automatic',
'trim': 'Doppelkabine 4x4 Wildtrak',
'year': 2019}
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT08525%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [auto1.de] INFO: Saving data for XT08525: {'created_time': 1774607767.534763, 'last_price_update_time': 1774607767.534778, 'auction_closing_time': 1774713794.0}
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT08525') HTTP/1.1" 204 0
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_7770825fb12abc920384807987cb05b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_7770825fb12abc920384807987cb05b2.jpg not downloaded yet
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf3c750>
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F66%252F4b66473b025a96e3b8e850025ad84003%252Fpa%252FVC15219_5689b33e7b11d7dde99e29ee7a1beab4.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_5689b33e7b11d7dde99e29ee7a1beab4.jpg saved to cache
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 176b6796-b315-5892-8a1f-c59c040a9398
2026-03-27 10:36:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 176b6796-b315-5892-8a1f-c59c040a9398, skipping ID generation
2026-03-27 10:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 176b6796-b315-5892-8a1f-c59c040a9398 with scrape type 1
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 176b6796-b315-5892-8a1f-c59c040a9398 sending to next pipeline
2026-03-27 10:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 176b6796-b315-5892-8a1f-c59c040a9398, identifier: VC15219
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be017d50>
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F74%252Feb7411235d31489f89e9d7963a9b4fc5%252Fpa%252FSE52893_b2441d873a8e32edbfd3e3e12cf70160.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_b2441d873a8e32edbfd3e3e12cf70160.jpg saved to cache
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3fb4b2bf-cac9-5128-a161-31ade47b4930
2026-03-27 10:36:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3fb4b2bf-cac9-5128-a161-31ade47b4930, skipping ID generation
2026-03-27 10:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fb4b2bf-cac9-5128-a161-31ade47b4930 with scrape type 1
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fb4b2bf-cac9-5128-a161-31ade47b4930 sending to next pipeline
2026-03-27 10:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3fb4b2bf-cac9-5128-a161-31ade47b4930, identifier: SE52893
2026-03-27 10:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae062b62-3809-5d5f-af3d-9fdbc9a3fa07 with identifier: RN18911
2026-03-27 10:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae062b62-3809-5d5f-af3d-9fdbc9a3fa07 with scrape type 1
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae062b62-3809-5d5f-af3d-9fdbc9a3fa07
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F07%252F950714926e5692b8d19bf33c0d618a11%252Fpa%252FRN18911_4a042c59d7029fd1b94f2725dfaa5789.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_4a042c59d7029fd1b94f2725dfaa5789.jpg already downloaded
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F07%252F950714926e5692b8d19bf33c0d618a11%252Fpa%252FRN18911_26a7d91d3011fb7f23380d7ce467eb05.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_26a7d91d3011fb7f23380d7ce467eb05.jpg already downloaded
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F07%252F950714926e5692b8d19bf33c0d618a11%252Fpa%252FRN18911_4e99f97a07dcb6edb755212b02eac79f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_4e99f97a07dcb6edb755212b02eac79f.jpg already downloaded
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F07%252F950714926e5692b8d19bf33c0d618a11%252Fpa%252FRN18911_b5e8bc95b4cbf3940f0c3424aa862310.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_b5e8bc95b4cbf3940f0c3424aa862310.jpg already downloaded
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F07%252F950714926e5692b8d19bf33c0d618a11%252Fpa%252FRN18911_9158502ea6b8785bf55d2a50919a7ca7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_9158502ea6b8785bf55d2a50919a7ca7.jpg already downloaded
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F07%252F950714926e5692b8d19bf33c0d618a11%252Fpa%252FRN18911_969daab96c9afdfda409831256d823e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_969daab96c9afdfda409831256d823e6.jpg already downloaded
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F07%252F950714926e5692b8d19bf33c0d618a11%252Fpa%252FRN18911_68c2bdb9d3b2a3101005d51f4accf0a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_68c2bdb9d3b2a3101005d51f4accf0a0.jpg already downloaded
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F07%252F950714926e5692b8d19bf33c0d618a11%252Fpa%252FRN18911_8511c1f8465fe0d5f9b3f2f4eca7855a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_8511c1f8465fe0d5f9b3f2f4eca7855a.jpg already downloaded
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F07%252F950714926e5692b8d19bf33c0d618a11%252Fpa%252FRN18911_7051ddf18523dc4b791aaa74d55209c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_7051ddf18523dc4b791aaa74d55209c8.jpg already downloaded
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F07%252F950714926e5692b8d19bf33c0d618a11%252Fpa%252FRN18911_79f8de36fd4e78573fe06378367f3728.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_79f8de36fd4e78573fe06378367f3728.jpg already downloaded
2026-03-27 10:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae062b62-3809-5d5f-af3d-9fdbc9a3fa07, identifier: RN18911
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_b467a03affe31aa0f4e60ed74aab1d90.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_b467a03affe31aa0f4e60ed74aab1d90.jpg not downloaded yet
2026-03-27 10:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 176b6796-b315-5892-8a1f-c59c040a9398 with identifier: VC15219
2026-03-27 10:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 176b6796-b315-5892-8a1f-c59c040a9398 with identifier: VC15219
2026-03-27 10:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 176b6796-b315-5892-8a1f-c59c040a9398 with identifier: VC15219 to the API
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_5689b33e7b11d7dde99e29ee7a1beab4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 210,
'expiration_date': '2026-03-28T16:11:01Z',
'fuel_type': 'petrol',
'id': '176b6796-b315-5892-8a1f-c59c040a9398',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC15219',
'listing': 'auction',
'location': 'DE',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 204619,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90677,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_4db35900f060f9f6e17a058929304741.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_14bb5d0b7e03a5896b3125a1d65df9c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100771,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_78d33f245ca3056bda1d460cd376ab22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_524207f424a735cdafd09c77d6bbb159.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101782,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_eb7dc858d61f43fe34586c053d71eb25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_5689b33e7b11d7dde99e29ee7a1beab4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128404,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_ef9e2712d77f1825765559fa4cfd4e6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_eb9cbc135d3283d7935bf78d8a627dc3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_f9305222e9075d5ee214c74dc9dde3fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_176b6796-b315-5892-8a1f-c59c040a9398/176b6796-b315-5892-8a1f-c59c040a9398_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/66/4b66473b025a96e3b8e850025ad84003/pa/VC15219_c41c031d2ef42528343c028b4b0a9201.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-08-29',
'seats_number': 4,
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 250 CGI',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC15219%27 HTTP/1.1" 200 None
2026-03-27 10:36:08 [auto1.de] INFO: Saving data for VC15219: {'created_time': 1774607768.588551, 'last_price_update_time': 1774607768.588563, 'auction_closing_time': 1774714261.0}
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC15219') HTTP/1.1" 204 0
2026-03-27 10:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3fb4b2bf-cac9-5128-a161-31ade47b4930 with identifier: SE52893
2026-03-27 10:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3fb4b2bf-cac9-5128-a161-31ade47b4930 with identifier: SE52893
2026-03-27 10:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3fb4b2bf-cac9-5128-a161-31ade47b4930 with identifier: SE52893 to the API
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_b2441d873a8e32edbfd3e3e12cf70160.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:15:10Z',
'fuel_type': 'petrol',
'id': '3fb4b2bf-cac9-5128-a161-31ade47b4930',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE52893',
'listing': 'auction',
'location': 'DE',
'make': 'Dacia',
'model': 'Duster',
'odometer': 152075,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104717,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_b5e2e66ed7c569fec2d4b67b5650276b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_b2441d873a8e32edbfd3e3e12cf70160.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_a5f26a84f349e0cbf3db925f42429f55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_5fbbb174b2b0d631e1d0f39ac9353ab8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97854,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_9de636dbaef46f1aaaa02369d6dafc57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_cdcd9ab5e6b23305811e5356ed4a719b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88077,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_243be1a76f7e845b3edfb3d287ae0084.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65855,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_c1777c169558386f29fd90a6f5d29882.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80628,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_78810a509b651d414e46e88cf01bb5bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fb4b2bf-cac9-5128-a161-31ade47b4930/3fb4b2bf-cac9-5128-a161-31ade47b4930_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73974,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/74/eb7411235d31489f89e9d7963a9b4fc5/pa/SE52893_02e87f12dcef21484f44cca800ff18b3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-20',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.3 TCe Celebration',
'transmission': 'manual',
'trim': 'Celebration',
'year': 2020}
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE52893%27 HTTP/1.1" 200 None
2026-03-27 10:36:09 [auto1.de] INFO: Saving data for SE52893: {'created_time': 1774607769.152934, 'last_price_update_time': 1774607769.152946, 'auction_closing_time': 1774714510.0}
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE52893') HTTP/1.1" 204 0
2026-03-27 10:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae062b62-3809-5d5f-af3d-9fdbc9a3fa07 with identifier: RN18911
2026-03-27 10:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae062b62-3809-5d5f-af3d-9fdbc9a3fa07 with identifier: RN18911
2026-03-27 10:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae062b62-3809-5d5f-af3d-9fdbc9a3fa07 with identifier: RN18911 to the API
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RN18911>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:47:07Z',
'fuel_type': 'petrol',
'id': 'ae062b62-3809-5d5f-af3d-9fdbc9a3fa07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN18911',
'listing': 'auction',
'location': 'DE, Ellerau',
'make': 'Honda',
'model': 'CR-V',
'odometer': 187175,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_4a042c59d7029fd1b94f2725dfaa5789.jpg',
'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_26a7d91d3011fb7f23380d7ce467eb05.jpg',
'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_4e99f97a07dcb6edb755212b02eac79f.jpg',
'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_b5e8bc95b4cbf3940f0c3424aa862310.jpg',
'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_9158502ea6b8785bf55d2a50919a7ca7.jpg',
'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_969daab96c9afdfda409831256d823e6.jpg',
'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_68c2bdb9d3b2a3101005d51f4accf0a0.jpg',
'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_8511c1f8465fe0d5f9b3f2f4eca7855a.jpg',
'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_7051ddf18523dc4b791aaa74d55209c8.jpg',
'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_79f8de36fd4e78573fe06378367f3728.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae062b62-3809-5d5f-af3d-9fdbc9a3fa07/ae062b62-3809-5d5f-af3d-9fdbc9a3fa07_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_4a042c59d7029fd1b94f2725dfaa5789.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae062b62-3809-5d5f-af3d-9fdbc9a3fa07/ae062b62-3809-5d5f-af3d-9fdbc9a3fa07_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_26a7d91d3011fb7f23380d7ce467eb05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae062b62-3809-5d5f-af3d-9fdbc9a3fa07/ae062b62-3809-5d5f-af3d-9fdbc9a3fa07_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2767381,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_4e99f97a07dcb6edb755212b02eac79f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae062b62-3809-5d5f-af3d-9fdbc9a3fa07/ae062b62-3809-5d5f-af3d-9fdbc9a3fa07_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69595,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_b5e8bc95b4cbf3940f0c3424aa862310.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae062b62-3809-5d5f-af3d-9fdbc9a3fa07/ae062b62-3809-5d5f-af3d-9fdbc9a3fa07_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67941,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_9158502ea6b8785bf55d2a50919a7ca7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae062b62-3809-5d5f-af3d-9fdbc9a3fa07/ae062b62-3809-5d5f-af3d-9fdbc9a3fa07_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83155,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_969daab96c9afdfda409831256d823e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae062b62-3809-5d5f-af3d-9fdbc9a3fa07/ae062b62-3809-5d5f-af3d-9fdbc9a3fa07_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_68c2bdb9d3b2a3101005d51f4accf0a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae062b62-3809-5d5f-af3d-9fdbc9a3fa07/ae062b62-3809-5d5f-af3d-9fdbc9a3fa07_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2765862,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_8511c1f8465fe0d5f9b3f2f4eca7855a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae062b62-3809-5d5f-af3d-9fdbc9a3fa07/ae062b62-3809-5d5f-af3d-9fdbc9a3fa07_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_7051ddf18523dc4b791aaa74d55209c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae062b62-3809-5d5f-af3d-9fdbc9a3fa07/ae062b62-3809-5d5f-af3d-9fdbc9a3fa07_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70019,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/07/950714926e5692b8d19bf33c0d618a11/pa/RN18911_79f8de36fd4e78573fe06378367f3728.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-10-25',
'seats_number': 5,
'seller_name': None,
'title': 'Honda CR-V 2.0 VTEC Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2009}
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN18911%27 HTTP/1.1" 200 None
2026-03-27 10:36:09 [auto1.de] INFO: Saving data for RN18911: {'created_time': 1774607769.543703, 'last_price_update_time': 1774607769.543715, 'auction_closing_time': 1774716427.0}
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN18911') HTTP/1.1" 204 0
2026-03-27 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_2eddd9406f07b7d5d824f90333056448.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_5545862c0f9390b5abee1fa27154b75c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_5545862c0f9390b5abee1fa27154b75c.jpg not downloaded yet
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_4b51cb9c52a5325ffbaf8920052ed6ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_4b51cb9c52a5325ffbaf8920052ed6ed.jpg not downloaded yet
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_58222bc217f5f0ca2ab42073891f7beb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_58222bc217f5f0ca2ab42073891f7beb.jpg not downloaded yet
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_3ddd8279efb706ba68e949090ec321ff.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_3ddd8279efb706ba68e949090ec321ff.jpg not downloaded yet
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_8841279afddb9a021257f9c67b2b90d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_8841279afddb9a021257f9c67b2b90d7.jpg not downloaded yet
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_26547df748cc15dbd762edbadff676be.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_26547df748cc15dbd762edbadff676be.jpg not downloaded yet
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_e57aa6cc26b35134a6e275415e6bb066.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_e57aa6cc26b35134a6e275415e6bb066.jpg not downloaded yet
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf474510>
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_2eddd9406f07b7d5d824f90333056448.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_2eddd9406f07b7d5d824f90333056448.jpg saved to cache
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4875374d-89bd-5a6f-bca6-da0fbda33735
2026-03-27 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_b467a03affe31aa0f4e60ed74aab1d90.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4660d0>
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_b467a03affe31aa0f4e60ed74aab1d90.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_b467a03affe31aa0f4e60ed74aab1d90.jpg saved to cache
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9ef4403a-87cf-5d9e-aad1-dc958444df3d
2026-03-27 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_e57aa6cc26b35134a6e275415e6bb066.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be085ad0>
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_e57aa6cc26b35134a6e275415e6bb066.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_e57aa6cc26b35134a6e275415e6bb066.jpg saved to cache
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9ef4403a-87cf-5d9e-aad1-dc958444df3d
2026-03-27 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_26547df748cc15dbd762edbadff676be.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf598ed0>
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_26547df748cc15dbd762edbadff676be.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_26547df748cc15dbd762edbadff676be.jpg saved to cache
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9ef4403a-87cf-5d9e-aad1-dc958444df3d
2026-03-27 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ37067/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_8841279afddb9a021257f9c67b2b90d7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be160190>
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_8841279afddb9a021257f9c67b2b90d7.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_8841279afddb9a021257f9c67b2b90d7.jpg saved to cache
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9ef4403a-87cf-5d9e-aad1-dc958444df3d
2026-03-27 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_3ddd8279efb706ba68e949090ec321ff.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EX64550> (referer: https://www.auto1.com/v1/car-details-view/EX64550/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR92717/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_58222bc217f5f0ca2ab42073891f7beb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be024d10>
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_3ddd8279efb706ba68e949090ec321ff.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_3ddd8279efb706ba68e949090ec321ff.jpg saved to cache
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9ef4403a-87cf-5d9e-aad1-dc958444df3d
2026-03-27 10:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a96bf7bc-b654-5b67-ae8d-f2637c251d53 with identifier: EX64550
2026-03-27 10:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a96bf7bc-b654-5b67-ae8d-f2637c251d53 with scrape type 1
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a96bf7bc-b654-5b67-ae8d-f2637c251d53
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_3713f879fb314211287d782b3d8cc468.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_3713f879fb314211287d782b3d8cc468.jpg not downloaded yet
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_7330ac36bd2b65025e6902c4d4be2a33.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_7330ac36bd2b65025e6902c4d4be2a33.jpg not downloaded yet
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_fc1825b581caa726d4f1ead770196cb7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_fc1825b581caa726d4f1ead770196cb7.jpg not downloaded yet
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_e2128685242efaaaad91bd87ba5a1575.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_e2128685242efaaaad91bd87ba5a1575.jpg not downloaded yet
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_52349bf1c7876cb7177ffb19932316a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_52349bf1c7876cb7177ffb19932316a3.jpg not downloaded yet
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_c2a862f82efba43eb4449b5071a04a98.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_c2a862f82efba43eb4449b5071a04a98.jpg not downloaded yet
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3cda90>
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_58222bc217f5f0ca2ab42073891f7beb.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_58222bc217f5f0ca2ab42073891f7beb.jpg saved to cache
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9ef4403a-87cf-5d9e-aad1-dc958444df3d
2026-03-27 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_5545862c0f9390b5abee1fa27154b75c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_05cc10c74ae994306ab015dfceecc41b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_05cc10c74ae994306ab015dfceecc41b.jpg not downloaded yet
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_4b51cb9c52a5325ffbaf8920052ed6ed.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_4eb8314bf97d7b7b46aeef20a3aa426a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_4eb8314bf97d7b7b46aeef20a3aa426a.jpg not downloaded yet
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_fcd7e08cb5bd31a843d5054796362074.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_fcd7e08cb5bd31a843d5054796362074.jpg not downloaded yet
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_7770825fb12abc920384807987cb05b2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_0b95adfa8c2f5f493da7227a3ca47afc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_0b95adfa8c2f5f493da7227a3ca47afc.jpg not downloaded yet
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1b0910>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_5545862c0f9390b5abee1fa27154b75c.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_5545862c0f9390b5abee1fa27154b75c.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9ef4403a-87cf-5d9e-aad1-dc958444df3d
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_c2a862f82efba43eb4449b5071a04a98.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_52349bf1c7876cb7177ffb19932316a3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_fcd7e08cb5bd31a843d5054796362074.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be091750>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_4b51cb9c52a5325ffbaf8920052ed6ed.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_4b51cb9c52a5325ffbaf8920052ed6ed.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9ef4403a-87cf-5d9e-aad1-dc958444df3d
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be114c90>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_7770825fb12abc920384807987cb05b2.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_7770825fb12abc920384807987cb05b2.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9ef4403a-87cf-5d9e-aad1-dc958444df3d
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_0b95adfa8c2f5f493da7227a3ca47afc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be085410>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_c2a862f82efba43eb4449b5071a04a98.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_c2a862f82efba43eb4449b5071a04a98.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a96bf7bc-b654-5b67-ae8d-f2637c251d53
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3ed250>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_52349bf1c7876cb7177ffb19932316a3.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_52349bf1c7876cb7177ffb19932316a3.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a96bf7bc-b654-5b67-ae8d-f2637c251d53
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c564bd90>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_fcd7e08cb5bd31a843d5054796362074.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_fcd7e08cb5bd31a843d5054796362074.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a96bf7bc-b654-5b67-ae8d-f2637c251d53
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_4eb8314bf97d7b7b46aeef20a3aa426a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf01510>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_0b95adfa8c2f5f493da7227a3ca47afc.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_0b95adfa8c2f5f493da7227a3ca47afc.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a96bf7bc-b654-5b67-ae8d-f2637c251d53
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_05cc10c74ae994306ab015dfceecc41b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL08327> (referer: https://www.auto1.com/v1/car-details-view/HL08327/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_e2128685242efaaaad91bd87ba5a1575.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_7330ac36bd2b65025e6902c4d4be2a33.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf599290>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_4eb8314bf97d7b7b46aeef20a3aa426a.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_4eb8314bf97d7b7b46aeef20a3aa426a.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a96bf7bc-b654-5b67-ae8d-f2637c251d53
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_3713f879fb314211287d782b3d8cc468.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3cda90>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_05cc10c74ae994306ab015dfceecc41b.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_05cc10c74ae994306ab015dfceecc41b.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a96bf7bc-b654-5b67-ae8d-f2637c251d53
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_a1d2145810da6dd1da80db501ae4be2e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_fc1825b581caa726d4f1ead770196cb7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 558537da-2a36-5d8b-a659-8a62a7be1bb5 with identifier: HL08327
2026-03-27 10:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 558537da-2a36-5d8b-a659-8a62a7be1bb5 with scrape type 1
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 558537da-2a36-5d8b-a659-8a62a7be1bb5
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_b6ab2846b38cfe75d9baf33ed752b29b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_b6ab2846b38cfe75d9baf33ed752b29b.jpg not downloaded yet
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be025ed0>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_e2128685242efaaaad91bd87ba5a1575.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_e2128685242efaaaad91bd87ba5a1575.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a96bf7bc-b654-5b67-ae8d-f2637c251d53
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_e0888b28aa9ff1768d1fd03de9e43cd2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_e0888b28aa9ff1768d1fd03de9e43cd2.jpg not downloaded yet
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_0118c85a27062100a3fdd211720d99ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_d42fcc4af36c69e240cd1a4f1dc56ea2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_d42fcc4af36c69e240cd1a4f1dc56ea2.jpg not downloaded yet
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be017810>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_7330ac36bd2b65025e6902c4d4be2a33.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_7330ac36bd2b65025e6902c4d4be2a33.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a96bf7bc-b654-5b67-ae8d-f2637c251d53
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3d4050>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_3713f879fb314211287d782b3d8cc468.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_3713f879fb314211287d782b3d8cc468.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a96bf7bc-b654-5b67-ae8d-f2637c251d53
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_e7bd6e3e6fad74f115a41dc22d5944d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_e7bd6e3e6fad74f115a41dc22d5944d6.jpg not downloaded yet
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0a8e50>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F36%252F0f368e459d9e70a847156223e8086296%252Fpa%252FBN78852_a1d2145810da6dd1da80db501ae4be2e.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_a1d2145810da6dd1da80db501ae4be2e.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ef4403a-87cf-5d9e-aad1-dc958444df3d
2026-03-27 10:36:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ef4403a-87cf-5d9e-aad1-dc958444df3d, skipping ID generation
2026-03-27 10:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ef4403a-87cf-5d9e-aad1-dc958444df3d with scrape type 1
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ef4403a-87cf-5d9e-aad1-dc958444df3d sending to next pipeline
2026-03-27 10:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ef4403a-87cf-5d9e-aad1-dc958444df3d, identifier: BN78852
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1119d0>
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fd8%252Ff8d888e488c716be04c51c37208c5825%252Fpa%252FEX64550_fc1825b581caa726d4f1ead770196cb7.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_fc1825b581caa726d4f1ead770196cb7.jpg saved to cache
2026-03-27 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a96bf7bc-b654-5b67-ae8d-f2637c251d53
2026-03-27 10:36:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a96bf7bc-b654-5b67-ae8d-f2637c251d53, skipping ID generation
2026-03-27 10:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a96bf7bc-b654-5b67-ae8d-f2637c251d53 with scrape type 1
2026-03-27 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a96bf7bc-b654-5b67-ae8d-f2637c251d53 sending to next pipeline
2026-03-27 10:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a96bf7bc-b654-5b67-ae8d-f2637c251d53, identifier: EX64550
2026-03-27 10:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ef4403a-87cf-5d9e-aad1-dc958444df3d with identifier: BN78852
2026-03-27 10:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ef4403a-87cf-5d9e-aad1-dc958444df3d with identifier: BN78852
2026-03-27 10:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ef4403a-87cf-5d9e-aad1-dc958444df3d with identifier: BN78852 to the API
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_a1d2145810da6dd1da80db501ae4be2e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 175,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.2L',
'engine_horse_power': 184,
'expiration_date': '2026-03-28T16:57:37Z',
'fuel_type': 'diesel',
'id': '9ef4403a-87cf-5d9e-aad1-dc958444df3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN78852',
'listing': 'auction',
'location': 'DE, Kaufbeuren',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 55493,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_a1d2145810da6dd1da80db501ae4be2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76854,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_7770825fb12abc920384807987cb05b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86077,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_b467a03affe31aa0f4e60ed74aab1d90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74556,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_5545862c0f9390b5abee1fa27154b75c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_4b51cb9c52a5325ffbaf8920052ed6ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91751,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_58222bc217f5f0ca2ab42073891f7beb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68525,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_3ddd8279efb706ba68e949090ec321ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86813,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_8841279afddb9a021257f9c67b2b90d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_26547df748cc15dbd762edbadff676be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef4403a-87cf-5d9e-aad1-dc958444df3d/9ef4403a-87cf-5d9e-aad1-dc958444df3d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/36/0f368e459d9e70a847156223e8086296/pa/BN78852_e57aa6cc26b35134a6e275415e6bb066.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-04',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
'transmission': 'manual',
'trim': 'Sports-Line AWD',
'year': 2019}
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN78852%27 HTTP/1.1" 200 None
2026-03-27 10:36:12 [auto1.de] INFO: Saving data for BN78852: {'created_time': 1774607772.607082, 'last_price_update_time': 1774607772.607098, 'auction_closing_time': 1774717057.0}
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN78852') HTTP/1.1" 204 0
2026-03-27 10:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a96bf7bc-b654-5b67-ae8d-f2637c251d53 with identifier: EX64550
2026-03-27 10:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a96bf7bc-b654-5b67-ae8d-f2637c251d53 with identifier: EX64550
2026-03-27 10:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a96bf7bc-b654-5b67-ae8d-f2637c251d53 with identifier: EX64550 to the API
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_fc1825b581caa726d4f1ead770196cb7.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.8L',
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:18:38Z',
'fuel_type': 'petrol',
'id': 'a96bf7bc-b654-5b67-ae8d-f2637c251d53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX64550',
'listing': 'auction',
'location': 'DE',
'make': 'Opel',
'model': 'Meriva',
'odometer': 123211,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_3713f879fb314211287d782b3d8cc468.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_7330ac36bd2b65025e6902c4d4be2a33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104726,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_fc1825b581caa726d4f1ead770196cb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90655,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_e2128685242efaaaad91bd87ba5a1575.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102149,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_52349bf1c7876cb7177ffb19932316a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84544,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_c2a862f82efba43eb4449b5071a04a98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78744,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_05cc10c74ae994306ab015dfceecc41b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93914,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_4eb8314bf97d7b7b46aeef20a3aa426a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70182,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_fcd7e08cb5bd31a843d5054796362074.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a96bf7bc-b654-5b67-ae8d-f2637c251d53/a96bf7bc-b654-5b67-ae8d-f2637c251d53_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/d8/f8d888e488c716be04c51c37208c5825/pa/EX64550_0b95adfa8c2f5f493da7227a3ca47afc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2003-10-28',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Meriva 1.8 Cosmo',
'transmission': 'automatic',
'trim': 'Cosmo',
'year': 2003}
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX64550%27 HTTP/1.1" 200 None
2026-03-27 10:36:13 [auto1.de] INFO: Saving data for EX64550: {'created_time': 1774607773.03843, 'last_price_update_time': 1774607773.038441, 'auction_closing_time': 1774714718.0}
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX64550') HTTP/1.1" 204 0
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_ed8bcd905844892c00d206dc3be8c852.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_ed8bcd905844892c00d206dc3be8c852.jpg not downloaded yet
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5ef190>
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_0118c85a27062100a3fdd211720d99ac.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_0118c85a27062100a3fdd211720d99ac.jpg saved to cache
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fbdd0925-1030-5135-b202-7815fa866981
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_b6ab2846b38cfe75d9baf33ed752b29b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_03628d60f92d321db53a0cc29b0eaec6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_03628d60f92d321db53a0cc29b0eaec6.jpg not downloaded yet
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_76b671615d019b0fd5f3ccd5f45ce5f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_76b671615d019b0fd5f3ccd5f45ce5f0.jpg not downloaded yet
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_49a1c8ae82c665f9ef078ba514ac746c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_49a1c8ae82c665f9ef078ba514ac746c.jpg not downloaded yet
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_a5cc003e7f7d04261a2cf8fca4638ac4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_a5cc003e7f7d04261a2cf8fca4638ac4.jpg not downloaded yet
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_1f9bff3f9e17a14aeceadc53de59a709.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_1f9bff3f9e17a14aeceadc53de59a709.jpg not downloaded yet
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf58ad0>
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_b6ab2846b38cfe75d9baf33ed752b29b.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_b6ab2846b38cfe75d9baf33ed752b29b.jpg saved to cache
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 558537da-2a36-5d8b-a659-8a62a7be1bb5
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_0813dd3b360d46e87e03c4ccca43599d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_1f9bff3f9e17a14aeceadc53de59a709.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_ed8bcd905844892c00d206dc3be8c852.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1603d0>
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_0813dd3b360d46e87e03c4ccca43599d.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_0813dd3b360d46e87e03c4ccca43599d.jpg saved to cache
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4875374d-89bd-5a6f-bca6-da0fbda33735
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_a5cc003e7f7d04261a2cf8fca4638ac4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf36f790>
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_1f9bff3f9e17a14aeceadc53de59a709.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_1f9bff3f9e17a14aeceadc53de59a709.jpg saved to cache
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 558537da-2a36-5d8b-a659-8a62a7be1bb5
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be092f90>
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_ed8bcd905844892c00d206dc3be8c852.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_ed8bcd905844892c00d206dc3be8c852.jpg saved to cache
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 558537da-2a36-5d8b-a659-8a62a7be1bb5
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_49a1c8ae82c665f9ef078ba514ac746c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be23d3d0>
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_a5cc003e7f7d04261a2cf8fca4638ac4.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_a5cc003e7f7d04261a2cf8fca4638ac4.jpg saved to cache
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 558537da-2a36-5d8b-a659-8a62a7be1bb5
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1eb050>
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_49a1c8ae82c665f9ef078ba514ac746c.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_49a1c8ae82c665f9ef078ba514ac746c.jpg saved to cache
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 558537da-2a36-5d8b-a659-8a62a7be1bb5
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC05156> (referer: https://www.auto1.com/v1/car-details-view/GC05156/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_76b671615d019b0fd5f3ccd5f45ce5f0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_03628d60f92d321db53a0cc29b0eaec6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cdaedf7-0126-5c15-bf32-b3c3de23f139 with identifier: GC05156
2026-03-27 10:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cdaedf7-0126-5c15-bf32-b3c3de23f139 with scrape type 1
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5cdaedf7-0126-5c15-bf32-b3c3de23f139
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_b1719fb7a86755a4f96004c3a0c07440.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_b1719fb7a86755a4f96004c3a0c07440.jpg not downloaded yet
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_d37a1206f43338b5685229cf0e981623.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_d37a1206f43338b5685229cf0e981623.jpg not downloaded yet
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_7bb72a6c1ff0b18a00c95ce720f1afe4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_7bb72a6c1ff0b18a00c95ce720f1afe4.jpg not downloaded yet
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5423d0>
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_76b671615d019b0fd5f3ccd5f45ce5f0.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_76b671615d019b0fd5f3ccd5f45ce5f0.jpg saved to cache
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 558537da-2a36-5d8b-a659-8a62a7be1bb5
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3194d0>
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_03628d60f92d321db53a0cc29b0eaec6.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_03628d60f92d321db53a0cc29b0eaec6.jpg saved to cache
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 558537da-2a36-5d8b-a659-8a62a7be1bb5
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_e4ecc79faf44451a55ce6f1274b8ddd2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_e4ecc79faf44451a55ce6f1274b8ddd2.jpg not downloaded yet
2026-03-27 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_e7bd6e3e6fad74f115a41dc22d5944d6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_e0888b28aa9ff1768d1fd03de9e43cd2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_d42fcc4af36c69e240cd1a4f1dc56ea2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_57c663f294344b5f98a674603adf84c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_57c663f294344b5f98a674603adf84c0.jpg not downloaded yet
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_e5aca881363404a78d45fdc15c991d2a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_e5aca881363404a78d45fdc15c991d2a.jpg not downloaded yet
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_b31c569b214c7a1d755e4306a035216a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_b31c569b214c7a1d755e4306a035216a.jpg not downloaded yet
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_72e17c444782688a866f38ed618a1cb1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_72e17c444782688a866f38ed618a1cb1.jpg not downloaded yet
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_ebb38b81092ba9a036d3c01e6b05c02f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_ebb38b81092ba9a036d3c01e6b05c02f.jpg not downloaded yet
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_1b7f8ffc8f091991cf2473febbf8d8a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_1b7f8ffc8f091991cf2473febbf8d8a9.jpg not downloaded yet
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0fa8d0>
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_e7bd6e3e6fad74f115a41dc22d5944d6.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_e7bd6e3e6fad74f115a41dc22d5944d6.jpg saved to cache
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 558537da-2a36-5d8b-a659-8a62a7be1bb5
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c53c5890>
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_e0888b28aa9ff1768d1fd03de9e43cd2.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_e0888b28aa9ff1768d1fd03de9e43cd2.jpg saved to cache
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 558537da-2a36-5d8b-a659-8a62a7be1bb5
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0fbc90>
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F8b%252Fac8bbaa8a1ce52f5af84339b89aaf5f9%252Fpa%252FHL08327_d42fcc4af36c69e240cd1a4f1dc56ea2.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_d42fcc4af36c69e240cd1a4f1dc56ea2.jpg saved to cache
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 558537da-2a36-5d8b-a659-8a62a7be1bb5
2026-03-27 10:36:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 558537da-2a36-5d8b-a659-8a62a7be1bb5, skipping ID generation
2026-03-27 10:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 558537da-2a36-5d8b-a659-8a62a7be1bb5 with scrape type 1
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 558537da-2a36-5d8b-a659-8a62a7be1bb5 sending to next pipeline
2026-03-27 10:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 558537da-2a36-5d8b-a659-8a62a7be1bb5, identifier: HL08327
2026-03-27 10:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 558537da-2a36-5d8b-a659-8a62a7be1bb5 with identifier: HL08327
2026-03-27 10:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 558537da-2a36-5d8b-a659-8a62a7be1bb5 with identifier: HL08327
2026-03-27 10:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 558537da-2a36-5d8b-a659-8a62a7be1bb5 with identifier: HL08327 to the API
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_d42fcc4af36c69e240cd1a4f1dc56ea2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:16:15Z',
'fuel_type': 'petrol',
'id': '558537da-2a36-5d8b-a659-8a62a7be1bb5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL08327',
'listing': 'auction',
'location': 'DE, Mainz-Kastel (Wiesbaden)',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 96175,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123948,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_b6ab2846b38cfe75d9baf33ed752b29b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_e0888b28aa9ff1768d1fd03de9e43cd2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92465,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_d42fcc4af36c69e240cd1a4f1dc56ea2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92112,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_e7bd6e3e6fad74f115a41dc22d5944d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_ed8bcd905844892c00d206dc3be8c852.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97370,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_03628d60f92d321db53a0cc29b0eaec6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98142,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_76b671615d019b0fd5f3ccd5f45ce5f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_49a1c8ae82c665f9ef078ba514ac746c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_a5cc003e7f7d04261a2cf8fca4638ac4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_558537da-2a36-5d8b-a659-8a62a7be1bb5/558537da-2a36-5d8b-a659-8a62a7be1bb5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97518,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/8b/ac8bbaa8a1ce52f5af84339b89aaf5f9/pa/HL08327_1f9bff3f9e17a14aeceadc53de59a709.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-04-19',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Passat 1.4 TSI ACT Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2018}
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL08327%27 HTTP/1.1" 200 None
2026-03-27 10:36:15 [auto1.de] INFO: Saving data for HL08327: {'created_time': 1774607775.052663, 'last_price_update_time': 1774607775.052672, 'auction_closing_time': 1774714575.0}
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL08327') HTTP/1.1" 204 0
2026-03-27 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_e4ecc79faf44451a55ce6f1274b8ddd2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_d37a1206f43338b5685229cf0e981623.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_7bb72a6c1ff0b18a00c95ce720f1afe4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1bbbd0>
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_e4ecc79faf44451a55ce6f1274b8ddd2.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_e4ecc79faf44451a55ce6f1274b8ddd2.jpg saved to cache
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5cdaedf7-0126-5c15-bf32-b3c3de23f139
2026-03-27 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_ebb38b81092ba9a036d3c01e6b05c02f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf552010>
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_d37a1206f43338b5685229cf0e981623.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_d37a1206f43338b5685229cf0e981623.jpg saved to cache
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5cdaedf7-0126-5c15-bf32-b3c3de23f139
2026-03-27 10:36:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf32cc50>
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_7bb72a6c1ff0b18a00c95ce720f1afe4.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_7bb72a6c1ff0b18a00c95ce720f1afe4.jpg saved to cache
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5cdaedf7-0126-5c15-bf32-b3c3de23f139
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be163390>
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_ebb38b81092ba9a036d3c01e6b05c02f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_ebb38b81092ba9a036d3c01e6b05c02f.jpg saved to cache
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5cdaedf7-0126-5c15-bf32-b3c3de23f139
2026-03-27 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_1b7f8ffc8f091991cf2473febbf8d8a9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3a6810>
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_1b7f8ffc8f091991cf2473febbf8d8a9.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_1b7f8ffc8f091991cf2473febbf8d8a9.jpg saved to cache
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5cdaedf7-0126-5c15-bf32-b3c3de23f139
2026-03-27 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_72e17c444782688a866f38ed618a1cb1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_b31c569b214c7a1d755e4306a035216a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_e5aca881363404a78d45fdc15c991d2a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf573e10>
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_72e17c444782688a866f38ed618a1cb1.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_72e17c444782688a866f38ed618a1cb1.jpg saved to cache
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5cdaedf7-0126-5c15-bf32-b3c3de23f139
2026-03-27 10:36:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2dead0>
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_b31c569b214c7a1d755e4306a035216a.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_b31c569b214c7a1d755e4306a035216a.jpg saved to cache
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5cdaedf7-0126-5c15-bf32-b3c3de23f139
2026-03-27 10:36:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf318e10>
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_e5aca881363404a78d45fdc15c991d2a.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_e5aca881363404a78d45fdc15c991d2a.jpg saved to cache
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5cdaedf7-0126-5c15-bf32-b3c3de23f139
2026-03-27 10:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_57c663f294344b5f98a674603adf84c0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF20593> (referer: https://www.auto1.com/v1/car-details-view/UF20593/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_b1719fb7a86755a4f96004c3a0c07440.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_0f84355d21197f322f37257f7368c4ad.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf306ad0>
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_57c663f294344b5f98a674603adf84c0.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_57c663f294344b5f98a674603adf84c0.jpg saved to cache
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5cdaedf7-0126-5c15-bf32-b3c3de23f139
2026-03-27 10:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 747d5343-6e46-554a-bfe8-ba2ab88bd2d0 with identifier: UF20593
2026-03-27 10:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747d5343-6e46-554a-bfe8-ba2ab88bd2d0 with scrape type 1
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 747d5343-6e46-554a-bfe8-ba2ab88bd2d0
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_e09399ea124273cf0e47ac112a4f182f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_e09399ea124273cf0e47ac112a4f182f.jpg not downloaded yet
2026-03-27 10:36:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1bba50>
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ffc%252Fabfcbd1561541fa452ecc1212f0675b6%252Fpa%252FGC05156_b1719fb7a86755a4f96004c3a0c07440.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_b1719fb7a86755a4f96004c3a0c07440.jpg saved to cache
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5cdaedf7-0126-5c15-bf32-b3c3de23f139
2026-03-27 10:36:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5cdaedf7-0126-5c15-bf32-b3c3de23f139, skipping ID generation
2026-03-27 10:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cdaedf7-0126-5c15-bf32-b3c3de23f139 with scrape type 1
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5cdaedf7-0126-5c15-bf32-b3c3de23f139 sending to next pipeline
2026-03-27 10:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cdaedf7-0126-5c15-bf32-b3c3de23f139, identifier: GC05156
2026-03-27 10:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cdaedf7-0126-5c15-bf32-b3c3de23f139 with identifier: GC05156
2026-03-27 10:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cdaedf7-0126-5c15-bf32-b3c3de23f139 with identifier: GC05156
2026-03-27 10:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cdaedf7-0126-5c15-bf32-b3c3de23f139 with identifier: GC05156 to the API
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_b1719fb7a86755a4f96004c3a0c07440.jpg>
{'auction_title': '',
'c_o_2_emission_value': 200,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:00:49Z',
'fuel_type': 'diesel',
'id': '5cdaedf7-0126-5c15-bf32-b3c3de23f139',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC05156',
'listing': 'auction',
'location': 'DE, Kumhausen',
'make': 'Jeep',
'model': 'Cherokee',
'odometer': 32485,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2849451,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_b1719fb7a86755a4f96004c3a0c07440.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2529757,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_d37a1206f43338b5685229cf0e981623.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2604697,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_7bb72a6c1ff0b18a00c95ce720f1afe4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_e4ecc79faf44451a55ce6f1274b8ddd2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_57c663f294344b5f98a674603adf84c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2794021,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_e5aca881363404a78d45fdc15c991d2a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2409371,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_b31c569b214c7a1d755e4306a035216a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69836,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_72e17c444782688a866f38ed618a1cb1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91344,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_ebb38b81092ba9a036d3c01e6b05c02f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cdaedf7-0126-5c15-bf32-b3c3de23f139/5cdaedf7-0126-5c15-bf32-b3c3de23f139_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2933084,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/fc/abfcbd1561541fa452ecc1212f0675b6/pa/GC05156_1b7f8ffc8f091991cf2473febbf8d8a9.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Cherokee 2.2 M-Jet Limited 4WD',
'transmission': 'automatic',
'trim': 'Limited 4WD',
'year': 2019}
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC05156%27 HTTP/1.1" 200 None
2026-03-27 10:36:17 [auto1.de] INFO: Saving data for GC05156: {'created_time': 1774607777.330793, 'last_price_update_time': 1774607777.330805, 'auction_closing_time': 1774713649.0}
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC05156') HTTP/1.1" 204 0
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_892b231476e8cceb6b4ea9181efa2271.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_892b231476e8cceb6b4ea9181efa2271.jpg not downloaded yet
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_564f26458bc5f3db0362fe28a3a464e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_564f26458bc5f3db0362fe28a3a464e3.jpg not downloaded yet
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be112490>
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_0f84355d21197f322f37257f7368c4ad.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_0f84355d21197f322f37257f7368c4ad.jpg saved to cache
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fbdd0925-1030-5135-b202-7815fa866981
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_34ceb182cd0b5e6ee668394fea07f632.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_34ceb182cd0b5e6ee668394fea07f632.jpg not downloaded yet
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_d57b2e3b1c21d9678d20d31c8fca852a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_d57b2e3b1c21d9678d20d31c8fca852a.jpg not downloaded yet
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_7fae9bbcc4723388de3e21e5bc33f746.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_7fae9bbcc4723388de3e21e5bc33f746.jpg not downloaded yet
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_8ad3960532b8efecbe574333d4e66436.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_8ad3960532b8efecbe574333d4e66436.jpg not downloaded yet
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_07935b0ab423954942a396dc82fc5ba0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_07935b0ab423954942a396dc82fc5ba0.jpg not downloaded yet
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_c15578c743a652a9eb41adc60100ef90.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_c15578c743a652a9eb41adc60100ef90.jpg not downloaded yet
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_74a5438396f744a3ad4d3f7877cb1c89.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_74a5438396f744a3ad4d3f7877cb1c89.jpg not downloaded yet
2026-03-27 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_3921af10622390a5a8382eed4a030385.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_cb7caa25fd782c733efd9862e2686aea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP37345> (referer: https://www.auto1.com/v1/car-details-view/YP37345/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be077590>
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa6%252F29a6018e528bc716379d92ab196f0162%252Fpa%252FFB09525_3921af10622390a5a8382eed4a030385.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_3921af10622390a5a8382eed4a030385.jpg saved to cache
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4875374d-89bd-5a6f-bca6-da0fbda33735
2026-03-27 10:36:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4875374d-89bd-5a6f-bca6-da0fbda33735, skipping ID generation
2026-03-27 10:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4875374d-89bd-5a6f-bca6-da0fbda33735 with scrape type 1
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4875374d-89bd-5a6f-bca6-da0fbda33735 sending to next pipeline
2026-03-27 10:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4875374d-89bd-5a6f-bca6-da0fbda33735, identifier: FB09525
2026-03-27 10:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4875374d-89bd-5a6f-bca6-da0fbda33735 with identifier: FB09525
2026-03-27 10:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4875374d-89bd-5a6f-bca6-da0fbda33735 with identifier: FB09525
2026-03-27 10:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4875374d-89bd-5a6f-bca6-da0fbda33735 with identifier: FB09525 to the API
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_3921af10622390a5a8382eed4a030385.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:16:37Z',
'fuel_type': 'diesel',
'id': '4875374d-89bd-5a6f-bca6-da0fbda33735',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB09525',
'listing': 'auction',
'location': 'DE, Schwerin',
'make': 'Peugeot',
'model': '308',
'odometer': 157208,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2793930,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_3921af10622390a5a8382eed4a030385.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80820,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_4d18243d7ae0715203751fbf7d214dfe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_b5e5d2ef5047e88ce6b2327292212d80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2627156,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_0f168bfd3f2ac31d4bec10d008ab8cf8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2804960,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_0813dd3b360d46e87e03c4ccca43599d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_2eddd9406f07b7d5d824f90333056448.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_2ae3a6f57316811e2abccb032b394048.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2816017,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_f934f161dc4d1bf16134a4632135e7f4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2621320,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_09b71d89fdfe984f05676ae5ce93130b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4875374d-89bd-5a6f-bca6-da0fbda33735/4875374d-89bd-5a6f-bca6-da0fbda33735_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78868,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/a6/29a6018e528bc716379d92ab196f0162/pa/FB09525_63a98f65c48bb0ac203169d90fbcf075.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-04-19',
'seats_number': 4,
'seller_name': None,
'title': 'Peugeot 308 2.0 HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2012}
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB09525%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [auto1.de] INFO: Saving data for FB09525: {'created_time': 1774607778.314263, 'last_price_update_time': 1774607778.314278, 'auction_closing_time': 1774714597.0}
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB09525') HTTP/1.1" 204 0
2026-03-27 10:36:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0f9a90>
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_cb7caa25fd782c733efd9862e2686aea.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_cb7caa25fd782c733efd9862e2686aea.jpg saved to cache
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fbdd0925-1030-5135-b202-7815fa866981
2026-03-27 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_74a5438396f744a3ad4d3f7877cb1c89.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA14502> (referer: https://www.auto1.com/v1/car-details-view/LA14502/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e5d84cc-3980-51be-8873-f9077341de52 with identifier: YP37345
2026-03-27 10:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e5d84cc-3980-51be-8873-f9077341de52 with scrape type 1
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e5d84cc-3980-51be-8873-f9077341de52
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_97cb4d14f86960b018e7281372724cb9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_97cb4d14f86960b018e7281372724cb9.jpg not downloaded yet
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_26de40c5d312731e5ea241bef0d62cbd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_26de40c5d312731e5ea241bef0d62cbd.jpg not downloaded yet
2026-03-27 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN21638> (referer: https://www.auto1.com/v1/car-details-view/JN21638/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_943c1a4009fbf2742ae75e4fa491ecd5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_943c1a4009fbf2742ae75e4fa491ecd5.jpg not downloaded yet
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_4e1bd5deb93ce2efbcdf5a4ff667e54c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_4e1bd5deb93ce2efbcdf5a4ff667e54c.jpg not downloaded yet
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_b6d28fbafd011e20ef557d61a9c4b13a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_b6d28fbafd011e20ef557d61a9c4b13a.jpg not downloaded yet
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_3b2309c93df69020230cb73338b65b61.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_3b2309c93df69020230cb73338b65b61.jpg not downloaded yet
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3d6950>
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_74a5438396f744a3ad4d3f7877cb1c89.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_74a5438396f744a3ad4d3f7877cb1c89.jpg saved to cache
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 747d5343-6e46-554a-bfe8-ba2ab88bd2d0
2026-03-27 10:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Duplicate ID generated for item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: LA14502, dropping item
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_1551fed716de7933a6b671546193dd5e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_1551fed716de7933a6b671546193dd5e.jpg not downloaded yet
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_678557c06aca87478bf2144757b9f390.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_678557c06aca87478bf2144757b9f390.jpg not downloaded yet
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_ef82b6add544f12a3f30f637b06eedbe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_ef82b6add544f12a3f30f637b06eedbe.jpg not downloaded yet
2026-03-27 10:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5919942e-8741-5202-9d95-746fcf93fc13 with identifier: JN21638
2026-03-27 10:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5919942e-8741-5202-9d95-746fcf93fc13 with scrape type 1
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5919942e-8741-5202-9d95-746fcf93fc13
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_443d9eccb75a61ad22b3056e174aeb1e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_443d9eccb75a61ad22b3056e174aeb1e.jpg not downloaded yet
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_08bad138dd80716d161f1e8007538f76.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_08bad138dd80716d161f1e8007538f76.jpg not downloaded yet
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_3b28d461e5437aea32980fe66fc9420f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_3b28d461e5437aea32980fe66fc9420f.jpg not downloaded yet
2026-03-27 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_8ad3960532b8efecbe574333d4e66436.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_79d3f46830226ae751e4977aa297f6af.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_79d3f46830226ae751e4977aa297f6af.jpg not downloaded yet
2026-03-27 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_26de40c5d312731e5ea241bef0d62cbd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_6ae155107cff97285737b517a6364381.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_6ae155107cff97285737b517a6364381.jpg not downloaded yet
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_b995facbb652bebcb9da772ab8639eb1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_b995facbb652bebcb9da772ab8639eb1.jpg not downloaded yet
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_625211e19906c341524f81d5b8e2f486.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_625211e19906c341524f81d5b8e2f486.jpg not downloaded yet
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_64d69ee820edc76d9a042dc142e2b9eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_64d69ee820edc76d9a042dc142e2b9eb.jpg not downloaded yet
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_13985416bbb823767a7f1889d55a7e07.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_13985416bbb823767a7f1889d55a7e07.jpg not downloaded yet
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_2359416a33e01440ba875bc722031bb7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_2359416a33e01440ba875bc722031bb7.jpg not downloaded yet
2026-03-27 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_3b28d461e5437aea32980fe66fc9420f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5e1a50>
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_8ad3960532b8efecbe574333d4e66436.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_8ad3960532b8efecbe574333d4e66436.jpg saved to cache
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 747d5343-6e46-554a-bfe8-ba2ab88bd2d0
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_82c3cfebd61a9716075e0b52a09fbf07.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_82c3cfebd61a9716075e0b52a09fbf07.jpg not downloaded yet
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be214b90>
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_26de40c5d312731e5ea241bef0d62cbd.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_26de40c5d312731e5ea241bef0d62cbd.jpg saved to cache
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e5d84cc-3980-51be-8873-f9077341de52
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be215590>
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_3b28d461e5437aea32980fe66fc9420f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_3b28d461e5437aea32980fe66fc9420f.jpg saved to cache
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5919942e-8741-5202-9d95-746fcf93fc13
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_c15578c743a652a9eb41adc60100ef90.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_07935b0ab423954942a396dc82fc5ba0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_08bad138dd80716d161f1e8007538f76.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_7fae9bbcc4723388de3e21e5bc33f746.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_13985416bbb823767a7f1889d55a7e07.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf358f50>
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_c15578c743a652a9eb41adc60100ef90.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_c15578c743a652a9eb41adc60100ef90.jpg saved to cache
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 747d5343-6e46-554a-bfe8-ba2ab88bd2d0
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_82c3cfebd61a9716075e0b52a09fbf07.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be035d10>
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_07935b0ab423954942a396dc82fc5ba0.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_07935b0ab423954942a396dc82fc5ba0.jpg saved to cache
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 747d5343-6e46-554a-bfe8-ba2ab88bd2d0
2026-03-27 10:36:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3dc350>
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_08bad138dd80716d161f1e8007538f76.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_08bad138dd80716d161f1e8007538f76.jpg saved to cache
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0e5d84cc-3980-51be-8873-f9077341de52
2026-03-27 10:36:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2ee950>
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_7fae9bbcc4723388de3e21e5bc33f746.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_7fae9bbcc4723388de3e21e5bc33f746.jpg saved to cache
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 747d5343-6e46-554a-bfe8-ba2ab88bd2d0
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3dc050>
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_13985416bbb823767a7f1889d55a7e07.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_13985416bbb823767a7f1889d55a7e07.jpg saved to cache
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5919942e-8741-5202-9d95-746fcf93fc13
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf477350>
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_82c3cfebd61a9716075e0b52a09fbf07.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_82c3cfebd61a9716075e0b52a09fbf07.jpg saved to cache
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5919942e-8741-5202-9d95-746fcf93fc13
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_6ae155107cff97285737b517a6364381.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_64d69ee820edc76d9a042dc142e2b9eb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_625211e19906c341524f81d5b8e2f486.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_b995facbb652bebcb9da772ab8639eb1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_443d9eccb75a61ad22b3056e174aeb1e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_79d3f46830226ae751e4977aa297f6af.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c55112d0>
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_6ae155107cff97285737b517a6364381.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_6ae155107cff97285737b517a6364381.jpg saved to cache
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5919942e-8741-5202-9d95-746fcf93fc13
2026-03-27 10:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_2359416a33e01440ba875bc722031bb7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3a7f50>
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_64d69ee820edc76d9a042dc142e2b9eb.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_64d69ee820edc76d9a042dc142e2b9eb.jpg saved to cache
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5919942e-8741-5202-9d95-746fcf93fc13
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3dce10>
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_625211e19906c341524f81d5b8e2f486.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_625211e19906c341524f81d5b8e2f486.jpg saved to cache
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5919942e-8741-5202-9d95-746fcf93fc13
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf553b10>
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_b995facbb652bebcb9da772ab8639eb1.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_b995facbb652bebcb9da772ab8639eb1.jpg saved to cache
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5919942e-8741-5202-9d95-746fcf93fc13
2026-03-27 10:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_ef82b6add544f12a3f30f637b06eedbe.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3dec10>
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_443d9eccb75a61ad22b3056e174aeb1e.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_443d9eccb75a61ad22b3056e174aeb1e.jpg saved to cache
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5919942e-8741-5202-9d95-746fcf93fc13
2026-03-27 10:36:20 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 10499 | hits on page: 40
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf54a490>
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_79d3f46830226ae751e4977aa297f6af.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_79d3f46830226ae751e4977aa297f6af.jpg saved to cache
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5919942e-8741-5202-9d95-746fcf93fc13
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf386750>
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff7%252F14f7e8d138cde8e502ec05ebe5f7d965%252Fpa%252FJN21638_2359416a33e01440ba875bc722031bb7.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_2359416a33e01440ba875bc722031bb7.jpg saved to cache
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5919942e-8741-5202-9d95-746fcf93fc13
2026-03-27 10:36:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5919942e-8741-5202-9d95-746fcf93fc13, skipping ID generation
2026-03-27 10:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5919942e-8741-5202-9d95-746fcf93fc13 with scrape type 1
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5919942e-8741-5202-9d95-746fcf93fc13 sending to next pipeline
2026-03-27 10:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5919942e-8741-5202-9d95-746fcf93fc13, identifier: JN21638
2026-03-27 10:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5919942e-8741-5202-9d95-746fcf93fc13 with identifier: JN21638
2026-03-27 10:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5919942e-8741-5202-9d95-746fcf93fc13 with identifier: JN21638
2026-03-27 10:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5919942e-8741-5202-9d95-746fcf93fc13 with identifier: JN21638 to the API
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_2359416a33e01440ba875bc722031bb7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:45:36Z',
'fuel_type': 'petrol',
'id': '5919942e-8741-5202-9d95-746fcf93fc13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN21638',
'listing': 'auction',
'location': 'DE',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 101794,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_443d9eccb75a61ad22b3056e174aeb1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98926,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_3b28d461e5437aea32980fe66fc9420f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89434,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_79d3f46830226ae751e4977aa297f6af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_6ae155107cff97285737b517a6364381.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_b995facbb652bebcb9da772ab8639eb1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_625211e19906c341524f81d5b8e2f486.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_64d69ee820edc76d9a042dc142e2b9eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_13985416bbb823767a7f1889d55a7e07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70798,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_2359416a33e01440ba875bc722031bb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5919942e-8741-5202-9d95-746fcf93fc13/5919942e-8741-5202-9d95-746fcf93fc13_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67362,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/f7/14f7e8d138cde8e502ec05ebe5f7d965/pa/JN21638_82c3cfebd61a9716075e0b52a09fbf07.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-10-10',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.2 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2011}
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN21638%27 HTTP/1.1" 200 None
2026-03-27 10:36:20 [auto1.de] INFO: Saving data for JN21638: {'created_time': 1774607780.93747, 'last_price_update_time': 1774607780.937487, 'auction_closing_time': 1774716336.0}
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN21638') HTTP/1.1" 204 0
2026-03-27 10:36:20 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-27 10:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_4e1bd5deb93ce2efbcdf5a4ff667e54c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:20 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-27 10:36:20 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-27 10:36:20 [auto1.de] INFO: Found listing with ID: ML20845
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML20845%27 HTTP/1.1" 200 None
2026-03-27 10:36:20 [auto1.de] INFO: Scrape type for ML20845: 0
2026-03-27 10:36:20 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN78852%27 HTTP/1.1" 200 None
2026-03-27 10:36:20 [auto1.de] INFO: Scrape type for BN78852: 0
2026-03-27 10:36:20 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT20326%27 HTTP/1.1" 200 None
2026-03-27 10:36:21 [auto1.de] INFO: Scrape type for ZT20326: 0
2026-03-27 10:36:21 [auto1.de] INFO: Found listing with ID: VG97349
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG97349%27 HTTP/1.1" 200 None
2026-03-27 10:36:21 [auto1.de] INFO: Scrape type for VG97349: 1
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c564ab90>
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_ef82b6add544f12a3f30f637b06eedbe.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_ef82b6add544f12a3f30f637b06eedbe.jpg saved to cache
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0e5d84cc-3980-51be-8873-f9077341de52
2026-03-27 10:36:21 [auto1.de] INFO: Found listing with ID: BK65604
2026-03-27 10:36:21 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02654%27 HTTP/1.1" 200 None
2026-03-27 10:36:21 [auto1.de] INFO: Scrape type for WS02654: 2
2026-03-27 10:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a282c06c-f36b-50ae-b469-6f7f7bcb88a4 with identifier: WS02654
2026-03-27 10:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a282c06c-f36b-50ae-b469-6f7f7bcb88a4 with scrape type 2
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a282c06c-f36b-50ae-b469-6f7f7bcb88a4 with scrape type 2
2026-03-27 10:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a282c06c-f36b-50ae-b469-6f7f7bcb88a4, identifier: WS02654
2026-03-27 10:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a282c06c-f36b-50ae-b469-6f7f7bcb88a4 with identifier: WS02654
2026-03-27 10:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a282c06c-f36b-50ae-b469-6f7f7bcb88a4 with identifier: WS02654
2026-03-27 10:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a282c06c-f36b-50ae-b469-6f7f7bcb88a4 with identifier: WS02654 to the API
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 72,
'expiration_date': '2026-03-28T16:29:30Z',
'fuel_type': 'petrol',
'id': 'a282c06c-f36b-50ae-b469-6f7f7bcb88a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS02654',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 162563,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-31',
'seller_name': None,
'title': 'Toyota Aygo 1.0-VVT-i X',
'transmission': 'manual',
'trim': 'X',
'year': 2018}
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02654%27 HTTP/1.1" 200 None
2026-03-27 10:36:21 [auto1.de] INFO: Saving data for WS02654: {'auction_closing_time': 1774715370.0, 'created_time': 1773830386.763692, 'last_price_update_time': 1774607781.57613}
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS02654') HTTP/1.1" 204 0
2026-03-27 10:36:21 [auto1.de] INFO: Found listing with ID: EP70088
2026-03-27 10:36:21 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB62953%27 HTTP/1.1" 200 None
2026-03-27 10:36:21 [auto1.de] INFO: Scrape type for VB62953: 2
2026-03-27 10:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6368ec0b-2807-54e6-8004-70afefba5de6 with identifier: VB62953
2026-03-27 10:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6368ec0b-2807-54e6-8004-70afefba5de6 with scrape type 2
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6368ec0b-2807-54e6-8004-70afefba5de6 with scrape type 2
2026-03-27 10:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6368ec0b-2807-54e6-8004-70afefba5de6, identifier: VB62953
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1e8e90>
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_4e1bd5deb93ce2efbcdf5a4ff667e54c.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_4e1bd5deb93ce2efbcdf5a4ff667e54c.jpg saved to cache
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e5d84cc-3980-51be-8873-f9077341de52
2026-03-27 10:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6368ec0b-2807-54e6-8004-70afefba5de6 with identifier: VB62953
2026-03-27 10:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6368ec0b-2807-54e6-8004-70afefba5de6 with identifier: VB62953
2026-03-27 10:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6368ec0b-2807-54e6-8004-70afefba5de6 with identifier: VB62953 to the API
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:53:52Z',
'fuel_type': 'diesel',
'id': '6368ec0b-2807-54e6-8004-70afefba5de6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB62953',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 138384,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-12',
'seller_name': None,
'title': 'BMW X1 xDrive 20d Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2017}
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB62953%27 HTTP/1.1" 200 None
2026-03-27 10:36:22 [auto1.de] INFO: Saving data for VB62953: {'auction_closing_time': 1774716832.0, 'created_time': 1773304889.673313, 'last_price_update_time': 1774607782.102309}
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB62953') HTTP/1.1" 204 0
2026-03-27 10:36:22 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE21956%27 HTTP/1.1" 200 None
2026-03-27 10:36:22 [auto1.de] INFO: Scrape type for LE21956: 2
2026-03-27 10:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: accea6fc-5443-5750-909d-52739c987d57 with identifier: LE21956
2026-03-27 10:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item accea6fc-5443-5750-909d-52739c987d57 with scrape type 2
2026-03-27 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item accea6fc-5443-5750-909d-52739c987d57 with scrape type 2
2026-03-27 10:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: accea6fc-5443-5750-909d-52739c987d57, identifier: LE21956
2026-03-27 10:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: accea6fc-5443-5750-909d-52739c987d57 with identifier: LE21956
2026-03-27 10:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: accea6fc-5443-5750-909d-52739c987d57 with identifier: LE21956
2026-03-27 10:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: accea6fc-5443-5750-909d-52739c987d57 with identifier: LE21956 to the API
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:07:21Z',
'fuel_type': 'petrol',
'id': 'accea6fc-5443-5750-909d-52739c987d57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE21956',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLK-Klasse',
'odometer': 85475,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-28',
'seller_name': None,
'title': 'Mercedes-Benz SLK-Klasse SLK 200 BlueEfficiency',
'transmission': 'automatic',
'trim': 'BlueEfficiency',
'year': 2011}
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE21956%27 HTTP/1.1" 200 None
2026-03-27 10:36:22 [auto1.de] INFO: Saving data for LE21956: {'auction_closing_time': 1774714041.0, 'created_time': 1774032665.6297, 'last_price_update_time': 1774607782.589591}
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE21956') HTTP/1.1" 204 0
2026-03-27 10:36:22 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-27 10:36:22 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-27 10:36:22 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-27 10:36:22 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY23363%27 HTTP/1.1" 200 None
2026-03-27 10:36:22 [auto1.de] INFO: Scrape type for EY23363: 2
2026-03-27 10:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce794b4e-dd87-54f2-ad08-1756f787878e with identifier: EY23363
2026-03-27 10:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce794b4e-dd87-54f2-ad08-1756f787878e with scrape type 2
2026-03-27 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce794b4e-dd87-54f2-ad08-1756f787878e with scrape type 2
2026-03-27 10:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce794b4e-dd87-54f2-ad08-1756f787878e, identifier: EY23363
2026-03-27 10:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce794b4e-dd87-54f2-ad08-1756f787878e with identifier: EY23363
2026-03-27 10:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce794b4e-dd87-54f2-ad08-1756f787878e with identifier: EY23363
2026-03-27 10:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce794b4e-dd87-54f2-ad08-1756f787878e with identifier: EY23363 to the API
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-28T16:19:23Z',
'fuel_type': 'petrol',
'id': 'ce794b4e-dd87-54f2-ad08-1756f787878e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY23363',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 41202,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-29',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid T 4Matic Avantgarde',
'transmission': 'automatic',
'trim': 'T 4Matic Avantgarde',
'year': 2021}
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY23363%27 HTTP/1.1" 200 None
2026-03-27 10:36:23 [auto1.de] INFO: Saving data for EY23363: {'auction_closing_time': 1774714763.0, 'created_time': 1774292904.383755, 'last_price_update_time': 1774607783.181675}
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY23363') HTTP/1.1" 204 0
2026-03-27 10:36:23 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU47356%27 HTTP/1.1" 200 None
2026-03-27 10:36:23 [auto1.de] INFO: Scrape type for MU47356: 2
2026-03-27 10:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 413eb418-b3b2-5960-868b-079f17a54777 with identifier: MU47356
2026-03-27 10:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 413eb418-b3b2-5960-868b-079f17a54777 with scrape type 2
2026-03-27 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 413eb418-b3b2-5960-868b-079f17a54777 with scrape type 2
2026-03-27 10:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 413eb418-b3b2-5960-868b-079f17a54777, identifier: MU47356
2026-03-27 10:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 413eb418-b3b2-5960-868b-079f17a54777 with identifier: MU47356
2026-03-27 10:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 413eb418-b3b2-5960-868b-079f17a54777 with identifier: MU47356
2026-03-27 10:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 413eb418-b3b2-5960-868b-079f17a54777 with identifier: MU47356 to the API
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:20:53Z',
'fuel_type': 'diesel',
'id': '413eb418-b3b2-5960-868b-079f17a54777',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU47356',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 128572,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-22',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 250 d T BlueTEC AMG Line',
'transmission': 'automatic',
'trim': 'T BlueTEC AMG Line',
'year': 2016}
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU47356%27 HTTP/1.1" 200 None
2026-03-27 10:36:23 [auto1.de] INFO: Saving data for MU47356: {'auction_closing_time': 1774714853.0, 'created_time': 1773829837.628076, 'last_price_update_time': 1774607783.65687}
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU47356') HTTP/1.1" 204 0
2026-03-27 10:36:23 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL14438%27 HTTP/1.1" 200 None
2026-03-27 10:36:23 [auto1.de] INFO: Scrape type for FL14438: 2
2026-03-27 10:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d34bb06-5c77-5c64-be75-da7c4f38efa5 with identifier: FL14438
2026-03-27 10:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d34bb06-5c77-5c64-be75-da7c4f38efa5 with scrape type 2
2026-03-27 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d34bb06-5c77-5c64-be75-da7c4f38efa5 with scrape type 2
2026-03-27 10:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d34bb06-5c77-5c64-be75-da7c4f38efa5, identifier: FL14438
2026-03-27 10:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d34bb06-5c77-5c64-be75-da7c4f38efa5 with identifier: FL14438
2026-03-27 10:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d34bb06-5c77-5c64-be75-da7c4f38efa5 with identifier: FL14438
2026-03-27 10:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d34bb06-5c77-5c64-be75-da7c4f38efa5 with identifier: FL14438 to the API
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:03:11Z',
'fuel_type': 'diesel',
'id': '9d34bb06-5c77-5c64-be75-da7c4f38efa5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL14438',
'listing': 'auction',
'make': 'Renault',
'model': 'Fluence',
'odometer': 329503,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-02',
'seller_name': None,
'title': 'Renault Fluence 1.5 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2011}
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL14438%27 HTTP/1.1" 200 None
2026-03-27 10:36:24 [auto1.de] INFO: Saving data for FL14438: {'auction_closing_time': 1774713791.0, 'created_time': 1774330255.221785, 'last_price_update_time': 1774607784.114723}
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL14438') HTTP/1.1" 204 0
2026-03-27 10:36:24 [auto1.de] INFO: Found listing with ID: JS49483
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS49483%27 HTTP/1.1" 200 None
2026-03-27 10:36:24 [auto1.de] INFO: Scrape type for JS49483: 1
2026-03-27 10:36:24 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY44699%27 HTTP/1.1" 200 None
2026-03-27 10:36:24 [auto1.de] INFO: Scrape type for PY44699: 2
2026-03-27 10:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 474b78af-e5ba-54c8-800f-6af4b57192ec with identifier: PY44699
2026-03-27 10:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 474b78af-e5ba-54c8-800f-6af4b57192ec with scrape type 2
2026-03-27 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 474b78af-e5ba-54c8-800f-6af4b57192ec with scrape type 2
2026-03-27 10:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 474b78af-e5ba-54c8-800f-6af4b57192ec, identifier: PY44699
2026-03-27 10:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 474b78af-e5ba-54c8-800f-6af4b57192ec with identifier: PY44699
2026-03-27 10:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 474b78af-e5ba-54c8-800f-6af4b57192ec with identifier: PY44699
2026-03-27 10:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 474b78af-e5ba-54c8-800f-6af4b57192ec with identifier: PY44699 to the API
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 101,
'expiration_date': '2026-03-28T16:35:38Z',
'fuel_type': 'diesel',
'id': '474b78af-e5ba-54c8-800f-6af4b57192ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY44699',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Courier',
'odometer': 23314,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-26',
'seller_name': None,
'title': 'Ford Transit Courier 1.5 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2020}
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY44699%27 HTTP/1.1" 200 None
2026-03-27 10:36:24 [auto1.de] INFO: Saving data for PY44699: {'auction_closing_time': 1774715738.0, 'created_time': 1773341709.910902, 'last_price_update_time': 1774607784.591968}
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY44699') HTTP/1.1" 204 0
2026-03-27 10:36:24 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA69467%27 HTTP/1.1" 200 None
2026-03-27 10:36:24 [auto1.de] INFO: Scrape type for HA69467: 2
2026-03-27 10:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 845139da-8c86-582d-bffc-6ea08e9ae60d with identifier: HA69467
2026-03-27 10:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 845139da-8c86-582d-bffc-6ea08e9ae60d with scrape type 2
2026-03-27 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 845139da-8c86-582d-bffc-6ea08e9ae60d with scrape type 2
2026-03-27 10:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 845139da-8c86-582d-bffc-6ea08e9ae60d, identifier: HA69467
2026-03-27 10:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 845139da-8c86-582d-bffc-6ea08e9ae60d with identifier: HA69467
2026-03-27 10:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 845139da-8c86-582d-bffc-6ea08e9ae60d with identifier: HA69467
2026-03-27 10:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 845139da-8c86-582d-bffc-6ea08e9ae60d with identifier: HA69467 to the API
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:01:45Z',
'fuel_type': 'diesel',
'id': '845139da-8c86-582d-bffc-6ea08e9ae60d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA69467',
'listing': 'auction',
'make': 'Renault',
'model': 'Talisman',
'odometer': 184389,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-29',
'seller_name': None,
'title': 'Renault Talisman 1.6 dCi Energy Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2016}
2026-03-27 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA69467%27 HTTP/1.1" 200 None
2026-03-27 10:36:25 [auto1.de] INFO: Saving data for HA69467: {'auction_closing_time': 1774713705.0, 'created_time': 1773859427.344956, 'last_price_update_time': 1774607785.083712}
2026-03-27 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA69467') HTTP/1.1" 204 0
2026-03-27 10:36:25 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-27 10:36:25 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-27 10:36:25 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-27 10:36:25 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-27 10:36:25 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-27 10:36:25 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-27 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV33449%27 HTTP/1.1" 200 None
2026-03-27 10:36:25 [auto1.de] INFO: Scrape type for ZV33449: 1
2026-03-27 10:36:25 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-27 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA55190%27 HTTP/1.1" 200 None
2026-03-27 10:36:25 [auto1.de] INFO: Scrape type for SA55190: 2
2026-03-27 10:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ccec49b-106e-53b5-b1e6-60345b9a4557 with identifier: SA55190
2026-03-27 10:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ccec49b-106e-53b5-b1e6-60345b9a4557 with scrape type 2
2026-03-27 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ccec49b-106e-53b5-b1e6-60345b9a4557 with scrape type 2
2026-03-27 10:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ccec49b-106e-53b5-b1e6-60345b9a4557, identifier: SA55190
2026-03-27 10:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ccec49b-106e-53b5-b1e6-60345b9a4557 with identifier: SA55190
2026-03-27 10:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ccec49b-106e-53b5-b1e6-60345b9a4557 with identifier: SA55190
2026-03-27 10:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ccec49b-106e-53b5-b1e6-60345b9a4557 with identifier: SA55190 to the API
2026-03-27 10:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:25:25Z',
'fuel_type': 'petrol',
'id': '8ccec49b-106e-53b5-b1e6-60345b9a4557',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA55190',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 154146,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-31',
'seller_name': None,
'title': 'Opel Corsa 1.4 Active ecoFlex',
'transmission': 'manual',
'trim': 'Active ecoFlex',
'year': 2017}
2026-03-27 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA55190%27 HTTP/1.1" 200 None
2026-03-27 10:36:25 [auto1.de] INFO: Saving data for SA55190: {'auction_closing_time': 1774715125.0, 'created_time': 1774293887.370727, 'last_price_update_time': 1774607785.6579}
2026-03-27 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA55190') HTTP/1.1" 204 0
2026-03-27 10:36:25 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-27 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK17459%27 HTTP/1.1" 200 None
2026-03-27 10:36:25 [auto1.de] INFO: Scrape type for JK17459: 2
2026-03-27 10:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5398c5e1-fcde-5d4b-bf2f-c44038dca325 with identifier: JK17459
2026-03-27 10:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5398c5e1-fcde-5d4b-bf2f-c44038dca325 with scrape type 2
2026-03-27 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5398c5e1-fcde-5d4b-bf2f-c44038dca325 with scrape type 2
2026-03-27 10:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5398c5e1-fcde-5d4b-bf2f-c44038dca325, identifier: JK17459
2026-03-27 10:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5398c5e1-fcde-5d4b-bf2f-c44038dca325 with identifier: JK17459
2026-03-27 10:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5398c5e1-fcde-5d4b-bf2f-c44038dca325 with identifier: JK17459
2026-03-27 10:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5398c5e1-fcde-5d4b-bf2f-c44038dca325 with identifier: JK17459 to the API
2026-03-27 10:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:28:47Z',
'fuel_type': 'diesel',
'id': '5398c5e1-fcde-5d4b-bf2f-c44038dca325',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK17459',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vaneo',
'odometer': 113495,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-09-15',
'seller_name': None,
'title': 'Mercedes-Benz Vaneo 1.7 CDI Family',
'transmission': 'automatic',
'trim': 'Family',
'year': 2003}
2026-03-27 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK17459%27 HTTP/1.1" 200 None
2026-03-27 10:36:26 [auto1.de] INFO: Saving data for JK17459: {'auction_closing_time': 1774715327.0, 'created_time': 1774294742.310111, 'last_price_update_time': 1774607786.245102}
2026-03-27 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK17459') HTTP/1.1" 204 0
2026-03-27 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_678557c06aca87478bf2144757b9f390.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:26 [auto1.de] INFO: Found listing with ID: BG14243
2026-03-27 10:36:26 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-27 10:36:26 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-27 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG45518%27 HTTP/1.1" 200 None
2026-03-27 10:36:26 [auto1.de] INFO: Scrape type for HG45518: 2
2026-03-27 10:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ecdc16d-6221-593c-8b9b-82bfd63f53d5 with identifier: HG45518
2026-03-27 10:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ecdc16d-6221-593c-8b9b-82bfd63f53d5 with scrape type 2
2026-03-27 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ecdc16d-6221-593c-8b9b-82bfd63f53d5 with scrape type 2
2026-03-27 10:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ecdc16d-6221-593c-8b9b-82bfd63f53d5, identifier: HG45518
2026-03-27 10:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ecdc16d-6221-593c-8b9b-82bfd63f53d5 with identifier: HG45518
2026-03-27 10:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ecdc16d-6221-593c-8b9b-82bfd63f53d5 with identifier: HG45518
2026-03-27 10:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ecdc16d-6221-593c-8b9b-82bfd63f53d5 with identifier: HG45518 to the API
2026-03-27 10:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:50:22Z',
'fuel_type': 'petrol',
'id': '2ecdc16d-6221-593c-8b9b-82bfd63f53d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG45518',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 75207,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-20',
'seller_name': None,
'title': 'Seat Leon 1.4 TGI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2018}
2026-03-27 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG45518%27 HTTP/1.1" 200 None
2026-03-27 10:36:26 [auto1.de] INFO: Saving data for HG45518: {'auction_closing_time': 1774716622.0, 'created_time': 1773772232.947375, 'last_price_update_time': 1774607786.737508}
2026-03-27 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG45518') HTTP/1.1" 204 0
2026-03-27 10:36:26 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-27 10:36:26 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-27 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR60146%27 HTTP/1.1" 200 None
2026-03-27 10:36:26 [auto1.de] INFO: Scrape type for KR60146: 2
2026-03-27 10:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfbee945-89c8-53eb-8fb7-57c7da1b062e with identifier: KR60146
2026-03-27 10:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfbee945-89c8-53eb-8fb7-57c7da1b062e with scrape type 2
2026-03-27 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfbee945-89c8-53eb-8fb7-57c7da1b062e with scrape type 2
2026-03-27 10:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfbee945-89c8-53eb-8fb7-57c7da1b062e, identifier: KR60146
2026-03-27 10:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfbee945-89c8-53eb-8fb7-57c7da1b062e with identifier: KR60146
2026-03-27 10:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfbee945-89c8-53eb-8fb7-57c7da1b062e with identifier: KR60146
2026-03-27 10:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfbee945-89c8-53eb-8fb7-57c7da1b062e with identifier: KR60146 to the API
2026-03-27 10:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:02:25Z',
'fuel_type': 'petrol',
'id': 'cfbee945-89c8-53eb-8fb7-57c7da1b062e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR60146',
'listing': 'auction',
'make': 'Ford',
'model': 'Puma',
'odometer': 26620,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-04',
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Titanium X',
'transmission': 'manual',
'trim': 'Titanium X',
'year': 2020}
2026-03-27 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR60146%27 HTTP/1.1" 200 None
2026-03-27 10:36:27 [auto1.de] INFO: Saving data for KR60146: {'auction_closing_time': 1774713745.0, 'created_time': 1773341652.793142, 'last_price_update_time': 1774607787.445536}
2026-03-27 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR60146') HTTP/1.1" 204 0
2026-03-27 10:36:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0908d0>
2026-03-27 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_678557c06aca87478bf2144757b9f390.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_678557c06aca87478bf2144757b9f390.jpg saved to cache
2026-03-27 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e5d84cc-3980-51be-8873-f9077341de52
2026-03-27 10:36:27 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-27 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU73518%27 HTTP/1.1" 200 None
2026-03-27 10:36:27 [auto1.de] INFO: Scrape type for UU73518: 2
2026-03-27 10:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abb51e5e-6e00-5c20-9c6e-b68e2b8154a1 with identifier: UU73518
2026-03-27 10:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abb51e5e-6e00-5c20-9c6e-b68e2b8154a1 with scrape type 2
2026-03-27 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abb51e5e-6e00-5c20-9c6e-b68e2b8154a1 with scrape type 2
2026-03-27 10:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abb51e5e-6e00-5c20-9c6e-b68e2b8154a1, identifier: UU73518
2026-03-27 10:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abb51e5e-6e00-5c20-9c6e-b68e2b8154a1 with identifier: UU73518
2026-03-27 10:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abb51e5e-6e00-5c20-9c6e-b68e2b8154a1 with identifier: UU73518
2026-03-27 10:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abb51e5e-6e00-5c20-9c6e-b68e2b8154a1 with identifier: UU73518 to the API
2026-03-27 10:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:23:20Z',
'fuel_type': 'petrol',
'id': 'abb51e5e-6e00-5c20-9c6e-b68e2b8154a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU73518',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 200590,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-08',
'seller_name': None,
'title': 'Seat Ibiza 1.2 TSI Style Salsa',
'transmission': 'manual',
'trim': 'Style Salsa',
'year': 2015}
2026-03-27 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU73518%27 HTTP/1.1" 200 None
2026-03-27 10:36:28 [auto1.de] INFO: Saving data for UU73518: {'auction_closing_time': 1774715000.0, 'created_time': 1773685900.575337, 'last_price_update_time': 1774607788.089806}
2026-03-27 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UU73518') HTTP/1.1" 204 0
2026-03-27 10:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_3b2309c93df69020230cb73338b65b61.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:28 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-27 10:36:28 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-27 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ94843%27 HTTP/1.1" 200 None
2026-03-27 10:36:28 [auto1.de] INFO: Scrape type for HJ94843: 0
2026-03-27 10:36:28 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-27 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX60280%27 HTTP/1.1" 200 None
2026-03-27 10:36:28 [auto1.de] INFO: Scrape type for SX60280: 2
2026-03-27 10:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32bf8a2f-1a89-505d-b885-8a4c8cc1b004 with identifier: SX60280
2026-03-27 10:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32bf8a2f-1a89-505d-b885-8a4c8cc1b004 with scrape type 2
2026-03-27 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32bf8a2f-1a89-505d-b885-8a4c8cc1b004 with scrape type 2
2026-03-27 10:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32bf8a2f-1a89-505d-b885-8a4c8cc1b004, identifier: SX60280
2026-03-27 10:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32bf8a2f-1a89-505d-b885-8a4c8cc1b004 with identifier: SX60280
2026-03-27 10:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32bf8a2f-1a89-505d-b885-8a4c8cc1b004 with identifier: SX60280
2026-03-27 10:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32bf8a2f-1a89-505d-b885-8a4c8cc1b004 with identifier: SX60280 to the API
2026-03-27 10:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:29:57Z',
'fuel_type': 'diesel',
'id': '32bf8a2f-1a89-505d-b885-8a4c8cc1b004',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX60280',
'listing': 'auction',
'make': 'Nissan',
'model': 'NV200 Evalia',
'odometer': 161650,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-25',
'seller_name': None,
'title': 'Nissan NV200 Evalia 1.5 dCi Evalia Tekna',
'transmission': 'manual',
'trim': 'Evalia Tekna',
'year': 2013}
2026-03-27 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX60280%27 HTTP/1.1" 200 None
2026-03-27 10:36:28 [auto1.de] INFO: Saving data for SX60280: {'auction_closing_time': 1774715397.0, 'created_time': 1773426936.082551, 'last_price_update_time': 1774607788.608507}
2026-03-27 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX60280') HTTP/1.1" 204 0
2026-03-27 10:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_1551fed716de7933a6b671546193dd5e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:28 [auto1.de] INFO: Found listing with ID: CA31330
2026-03-27 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA31330%27 HTTP/1.1" 200 None
2026-03-27 10:36:28 [auto1.de] INFO: Scrape type for CA31330: 2
2026-03-27 10:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de4112cf-cd3d-5ee8-aab4-809ff0869882 with identifier: CA31330
2026-03-27 10:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de4112cf-cd3d-5ee8-aab4-809ff0869882 with scrape type 2
2026-03-27 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de4112cf-cd3d-5ee8-aab4-809ff0869882 with scrape type 2
2026-03-27 10:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de4112cf-cd3d-5ee8-aab4-809ff0869882, identifier: CA31330
2026-03-27 10:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de4112cf-cd3d-5ee8-aab4-809ff0869882 with identifier: CA31330
2026-03-27 10:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de4112cf-cd3d-5ee8-aab4-809ff0869882 with identifier: CA31330
2026-03-27 10:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de4112cf-cd3d-5ee8-aab4-809ff0869882 with identifier: CA31330 to the API
2026-03-27 10:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:10:36Z',
'fuel_type': 'diesel',
'id': 'de4112cf-cd3d-5ee8-aab4-809ff0869882',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA31330',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Cactus',
'odometer': 112392,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-18',
'seller_name': None,
'title': 'Citroen C4 Cactus 1.6 Blue-HDi Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2019}
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA31330%27 HTTP/1.1" 200 None
2026-03-27 10:36:29 [auto1.de] INFO: Saving data for CA31330: {'auction_closing_time': 1774714236.0, 'created_time': 1774292887.303277, 'last_price_update_time': 1774607789.150198}
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA31330') HTTP/1.1" 204 0
2026-03-27 10:36:29 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-27 10:36:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0ad110>
2026-03-27 10:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_3b2309c93df69020230cb73338b65b61.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_3b2309c93df69020230cb73338b65b61.jpg saved to cache
2026-03-27 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e5d84cc-3980-51be-8873-f9077341de52
2026-03-27 10:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE41412> (referer: https://www.auto1.com/v1/car-details-view/VE41412/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_b6d28fbafd011e20ef557d61a9c4b13a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3ce510>
2026-03-27 10:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_1551fed716de7933a6b671546193dd5e.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_1551fed716de7933a6b671546193dd5e.jpg saved to cache
2026-03-27 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e5d84cc-3980-51be-8873-f9077341de52
2026-03-27 10:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_943c1a4009fbf2742ae75e4fa491ecd5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d825d06b-b474-5bb7-b5ab-33cee45e9e0a with identifier: VE41412
2026-03-27 10:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d825d06b-b474-5bb7-b5ab-33cee45e9e0a with scrape type 1
2026-03-27 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d825d06b-b474-5bb7-b5ab-33cee45e9e0a
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7fd1ffb655b46e7be4d5abcd25b028%252Fpa%252FVE41412_6f13714532578c2149f331f413ff92d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_6f13714532578c2149f331f413ff92d5.jpg not downloaded yet
2026-03-27 10:36:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2632d0>
2026-03-27 10:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_b6d28fbafd011e20ef557d61a9c4b13a.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_b6d28fbafd011e20ef557d61a9c4b13a.jpg saved to cache
2026-03-27 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e5d84cc-3980-51be-8873-f9077341de52
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7fd1ffb655b46e7be4d5abcd25b028%252Fpa%252FVE41412_1bc697d291c34eec780c55931f09fdbc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_1bc697d291c34eec780c55931f09fdbc.jpg not downloaded yet
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7fd1ffb655b46e7be4d5abcd25b028%252Fpa%252FVE41412_cb272a0eb5f31f076259c4cee11adecb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_cb272a0eb5f31f076259c4cee11adecb.jpg not downloaded yet
2026-03-27 10:36:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2ea690>
2026-03-27 10:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_943c1a4009fbf2742ae75e4fa491ecd5.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_943c1a4009fbf2742ae75e4fa491ecd5.jpg saved to cache
2026-03-27 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e5d84cc-3980-51be-8873-f9077341de52
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7fd1ffb655b46e7be4d5abcd25b028%252Fpa%252FVE41412_1faa936635d32151b4babe89745d58e0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_1faa936635d32151b4babe89745d58e0.jpg not downloaded yet
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7fd1ffb655b46e7be4d5abcd25b028%252Fpa%252FVE41412_04a075f5af982ca46d7c9b778752f098.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_04a075f5af982ca46d7c9b778752f098.jpg not downloaded yet
2026-03-27 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_97cb4d14f86960b018e7281372724cb9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_6f13714532578c2149f331f413ff92d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_1faa936635d32151b4babe89745d58e0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf358310>
2026-03-27 10:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F42%252F1042bb8bee2d3e1b9fe27529b74d6ff6%252Fpa%252FYP37345_97cb4d14f86960b018e7281372724cb9.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_97cb4d14f86960b018e7281372724cb9.jpg saved to cache
2026-03-27 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e5d84cc-3980-51be-8873-f9077341de52
2026-03-27 10:36:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e5d84cc-3980-51be-8873-f9077341de52, skipping ID generation
2026-03-27 10:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e5d84cc-3980-51be-8873-f9077341de52 with scrape type 1
2026-03-27 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e5d84cc-3980-51be-8873-f9077341de52 sending to next pipeline
2026-03-27 10:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e5d84cc-3980-51be-8873-f9077341de52, identifier: YP37345
2026-03-27 10:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e5d84cc-3980-51be-8873-f9077341de52 with identifier: YP37345
2026-03-27 10:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e5d84cc-3980-51be-8873-f9077341de52 with identifier: YP37345
2026-03-27 10:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e5d84cc-3980-51be-8873-f9077341de52 with identifier: YP37345 to the API
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_97cb4d14f86960b018e7281372724cb9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:19:51Z',
'fuel_type': 'petrol',
'id': '0e5d84cc-3980-51be-8873-f9077341de52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP37345',
'listing': 'auction',
'location': 'DE, Bremen',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 175874,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_97cb4d14f86960b018e7281372724cb9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87137,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_26de40c5d312731e5ea241bef0d62cbd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2835947,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_943c1a4009fbf2742ae75e4fa491ecd5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73900,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_4e1bd5deb93ce2efbcdf5a4ff667e54c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2994531,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_b6d28fbafd011e20ef557d61a9c4b13a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2521621,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_3b2309c93df69020230cb73338b65b61.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2737782,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_1551fed716de7933a6b671546193dd5e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2725705,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_678557c06aca87478bf2144757b9f390.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_ef82b6add544f12a3f30f637b06eedbe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e5d84cc-3980-51be-8873-f9077341de52/0e5d84cc-3980-51be-8873-f9077341de52_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3037703,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img10/42/1042bb8bee2d3e1b9fe27529b74d6ff6/pa/YP37345_08bad138dd80716d161f1e8007538f76.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-12-02',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2013}
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP37345%27 HTTP/1.1" 200 None
2026-03-27 10:36:30 [auto1.de] INFO: Saving data for YP37345: {'created_time': 1774607790.957486, 'last_price_update_time': 1774607790.957496, 'auction_closing_time': 1774714791.0}
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP37345') HTTP/1.1" 204 0
2026-03-27 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_04a075f5af982ca46d7c9b778752f098.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_d57b2e3b1c21d9678d20d31c8fca852a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_cb272a0eb5f31f076259c4cee11adecb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1d3550>
2026-03-27 10:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d825d06b-b474-5bb7-b5ab-33cee45e9e0a/d825d06b-b474-5bb7-b5ab-33cee45e9e0a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7fd1ffb655b46e7be4d5abcd25b028%252Fpa%252FVE41412_6f13714532578c2149f331f413ff92d5.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_6f13714532578c2149f331f413ff92d5.jpg saved to cache
2026-03-27 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d825d06b-b474-5bb7-b5ab-33cee45e9e0a
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3061d0>
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d825d06b-b474-5bb7-b5ab-33cee45e9e0a/d825d06b-b474-5bb7-b5ab-33cee45e9e0a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7fd1ffb655b46e7be4d5abcd25b028%252Fpa%252FVE41412_1faa936635d32151b4babe89745d58e0.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_1faa936635d32151b4babe89745d58e0.jpg saved to cache
2026-03-27 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d825d06b-b474-5bb7-b5ab-33cee45e9e0a
2026-03-27 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC63339> (referer: https://www.auto1.com/v1/car-details-view/WC63339/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf306310>
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d825d06b-b474-5bb7-b5ab-33cee45e9e0a/d825d06b-b474-5bb7-b5ab-33cee45e9e0a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7fd1ffb655b46e7be4d5abcd25b028%252Fpa%252FVE41412_04a075f5af982ca46d7c9b778752f098.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_04a075f5af982ca46d7c9b778752f098.jpg saved to cache
2026-03-27 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d825d06b-b474-5bb7-b5ab-33cee45e9e0a
2026-03-27 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_1bc697d291c34eec780c55931f09fdbc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0213d0>
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_d57b2e3b1c21d9678d20d31c8fca852a.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_d57b2e3b1c21d9678d20d31c8fca852a.jpg saved to cache
2026-03-27 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 747d5343-6e46-554a-bfe8-ba2ab88bd2d0
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be160250>
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d825d06b-b474-5bb7-b5ab-33cee45e9e0a/d825d06b-b474-5bb7-b5ab-33cee45e9e0a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7fd1ffb655b46e7be4d5abcd25b028%252Fpa%252FVE41412_cb272a0eb5f31f076259c4cee11adecb.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_cb272a0eb5f31f076259c4cee11adecb.jpg saved to cache
2026-03-27 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d825d06b-b474-5bb7-b5ab-33cee45e9e0a
2026-03-27 10:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d797935d-6332-5bd1-b9eb-fdcde16c6582 with identifier: WC63339
2026-03-27 10:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d797935d-6332-5bd1-b9eb-fdcde16c6582 with scrape type 1
2026-03-27 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d797935d-6332-5bd1-b9eb-fdcde16c6582
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_e4fc660c7003a052d471ed6df621731f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_e4fc660c7003a052d471ed6df621731f.jpg not downloaded yet
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3d6c50>
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d825d06b-b474-5bb7-b5ab-33cee45e9e0a/d825d06b-b474-5bb7-b5ab-33cee45e9e0a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7fd1ffb655b46e7be4d5abcd25b028%252Fpa%252FVE41412_1bc697d291c34eec780c55931f09fdbc.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_1bc697d291c34eec780c55931f09fdbc.jpg saved to cache
2026-03-27 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d825d06b-b474-5bb7-b5ab-33cee45e9e0a
2026-03-27 10:36:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d825d06b-b474-5bb7-b5ab-33cee45e9e0a, skipping ID generation
2026-03-27 10:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d825d06b-b474-5bb7-b5ab-33cee45e9e0a with scrape type 1
2026-03-27 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d825d06b-b474-5bb7-b5ab-33cee45e9e0a sending to next pipeline
2026-03-27 10:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d825d06b-b474-5bb7-b5ab-33cee45e9e0a, identifier: VE41412
2026-03-27 10:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d825d06b-b474-5bb7-b5ab-33cee45e9e0a with identifier: VE41412
2026-03-27 10:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d825d06b-b474-5bb7-b5ab-33cee45e9e0a with identifier: VE41412
2026-03-27 10:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d825d06b-b474-5bb7-b5ab-33cee45e9e0a with identifier: VE41412 to the API
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_1bc697d291c34eec780c55931f09fdbc.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:04:56Z',
'fuel_type': 'petrol',
'id': 'd825d06b-b474-5bb7-b5ab-33cee45e9e0a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE41412',
'listing': 'auction',
'location': 'DE, Erding',
'make': 'Renault',
'model': 'Megane',
'odometer': 133740,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d825d06b-b474-5bb7-b5ab-33cee45e9e0a/d825d06b-b474-5bb7-b5ab-33cee45e9e0a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_6f13714532578c2149f331f413ff92d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d825d06b-b474-5bb7-b5ab-33cee45e9e0a/d825d06b-b474-5bb7-b5ab-33cee45e9e0a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123748,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_1bc697d291c34eec780c55931f09fdbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d825d06b-b474-5bb7-b5ab-33cee45e9e0a/d825d06b-b474-5bb7-b5ab-33cee45e9e0a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95493,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_cb272a0eb5f31f076259c4cee11adecb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d825d06b-b474-5bb7-b5ab-33cee45e9e0a/d825d06b-b474-5bb7-b5ab-33cee45e9e0a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89470,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_1faa936635d32151b4babe89745d58e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d825d06b-b474-5bb7-b5ab-33cee45e9e0a/d825d06b-b474-5bb7-b5ab-33cee45e9e0a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100647,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7fd1ffb655b46e7be4d5abcd25b028/pa/VE41412_04a075f5af982ca46d7c9b778752f098.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.6 TomTom Edition',
'transmission': 'manual',
'trim': 'TomTom Edition',
'year': 2011}
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41412%27 HTTP/1.1" 200 None
2026-03-27 10:36:31 [auto1.de] INFO: Saving data for VE41412: {'created_time': 1774607791.994961, 'last_price_update_time': 1774607791.994974, 'auction_closing_time': 1774713896.0}
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE41412') HTTP/1.1" 204 0
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_5fdcc84647c0fa7c1166ac3ee8afa134.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_5fdcc84647c0fa7c1166ac3ee8afa134.jpg not downloaded yet
2026-03-27 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_892b231476e8cceb6b4ea9181efa2271.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_564f26458bc5f3db0362fe28a3a464e3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_8b4731852def186f6ae1aaf4195afb14.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_8b4731852def186f6ae1aaf4195afb14.jpg not downloaded yet
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_622601c067f0cbddf57b7a72febea093.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_622601c067f0cbddf57b7a72febea093.jpg not downloaded yet
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_941caae8949e5ece54dca741f0229a86.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_941caae8949e5ece54dca741f0229a86.jpg not downloaded yet
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_b145c5aeb316bd5588897c096eb50484.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_b145c5aeb316bd5588897c096eb50484.jpg not downloaded yet
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_0abc6b64f0d7c2845591d0b1aad26bd5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_0abc6b64f0d7c2845591d0b1aad26bd5.jpg not downloaded yet
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_e4094a1ceadc2274f1f4d8faaff6513a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_e4094a1ceadc2274f1f4d8faaff6513a.jpg not downloaded yet
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_5b00d29fc567965e8b413c1533572313.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_5b00d29fc567965e8b413c1533572313.jpg not downloaded yet
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5efb90>
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_892b231476e8cceb6b4ea9181efa2271.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_892b231476e8cceb6b4ea9181efa2271.jpg saved to cache
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 747d5343-6e46-554a-bfe8-ba2ab88bd2d0
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be015d90>
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_564f26458bc5f3db0362fe28a3a464e3.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_564f26458bc5f3db0362fe28a3a464e3.jpg saved to cache
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 747d5343-6e46-554a-bfe8-ba2ab88bd2d0
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_9f856fa155825909aac9ca8d6f868250.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_9f856fa155825909aac9ca8d6f868250.jpg not downloaded yet
2026-03-27 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_34ceb182cd0b5e6ee668394fea07f632.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_e09399ea124273cf0e47ac112a4f182f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_e4fc660c7003a052d471ed6df621731f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be015290>
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_34ceb182cd0b5e6ee668394fea07f632.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_34ceb182cd0b5e6ee668394fea07f632.jpg saved to cache
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 747d5343-6e46-554a-bfe8-ba2ab88bd2d0
2026-03-27 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_9f856fa155825909aac9ca8d6f868250.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf325750>
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Faa%252Fc5aa0d0848d900114b74814ed3a2a267%252Fpa%252FUF20593_e09399ea124273cf0e47ac112a4f182f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_e09399ea124273cf0e47ac112a4f182f.jpg saved to cache
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 747d5343-6e46-554a-bfe8-ba2ab88bd2d0
2026-03-27 10:36:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 747d5343-6e46-554a-bfe8-ba2ab88bd2d0, skipping ID generation
2026-03-27 10:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747d5343-6e46-554a-bfe8-ba2ab88bd2d0 with scrape type 1
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 747d5343-6e46-554a-bfe8-ba2ab88bd2d0 sending to next pipeline
2026-03-27 10:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 747d5343-6e46-554a-bfe8-ba2ab88bd2d0, identifier: UF20593
2026-03-27 10:36:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf5aa90>
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_e4fc660c7003a052d471ed6df621731f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_e4fc660c7003a052d471ed6df621731f.jpg saved to cache
2026-03-27 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d797935d-6332-5bd1-b9eb-fdcde16c6582
2026-03-27 10:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 747d5343-6e46-554a-bfe8-ba2ab88bd2d0 with identifier: UF20593
2026-03-27 10:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 747d5343-6e46-554a-bfe8-ba2ab88bd2d0 with identifier: UF20593
2026-03-27 10:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 747d5343-6e46-554a-bfe8-ba2ab88bd2d0 with identifier: UF20593 to the API
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_e09399ea124273cf0e47ac112a4f182f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:04:23Z',
'fuel_type': 'diesel',
'id': '747d5343-6e46-554a-bfe8-ba2ab88bd2d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF20593',
'listing': 'auction',
'location': 'DE, Flensburg',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 199764,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3448933,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_e09399ea124273cf0e47ac112a4f182f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_892b231476e8cceb6b4ea9181efa2271.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111964,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_564f26458bc5f3db0362fe28a3a464e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3325605,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_34ceb182cd0b5e6ee668394fea07f632.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_d57b2e3b1c21d9678d20d31c8fca852a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3578120,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_7fae9bbcc4723388de3e21e5bc33f746.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_8ad3960532b8efecbe574333d4e66436.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4059565,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_07935b0ab423954942a396dc82fc5ba0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3789557,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_c15578c743a652a9eb41adc60100ef90.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747d5343-6e46-554a-bfe8-ba2ab88bd2d0/747d5343-6e46-554a-bfe8-ba2ab88bd2d0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106443,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/aa/c5aa0d0848d900114b74814ed3a2a267/pa/UF20593_74a5438396f744a3ad4d3f7877cb1c89.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 d T BlueTEC',
'transmission': 'automatic',
'trim': 'T BlueTEC',
'year': 2015}
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF20593%27 HTTP/1.1" 200 None
2026-03-27 10:36:33 [auto1.de] INFO: Saving data for UF20593: {'created_time': 1774607793.549442, 'last_price_update_time': 1774607793.549456, 'auction_closing_time': 1774713863.0}
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF20593') HTTP/1.1" 204 0
2026-03-27 10:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be023b50>
2026-03-27 10:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_9f856fa155825909aac9ca8d6f868250.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_9f856fa155825909aac9ca8d6f868250.jpg saved to cache
2026-03-27 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d797935d-6332-5bd1-b9eb-fdcde16c6582
2026-03-27 10:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_0abc6b64f0d7c2845591d0b1aad26bd5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_5b00d29fc567965e8b413c1533572313.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_e4094a1ceadc2274f1f4d8faaff6513a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1e8210>
2026-03-27 10:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_0abc6b64f0d7c2845591d0b1aad26bd5.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_0abc6b64f0d7c2845591d0b1aad26bd5.jpg saved to cache
2026-03-27 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d797935d-6332-5bd1-b9eb-fdcde16c6582
2026-03-27 10:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf44f5d0>
2026-03-27 10:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_5b00d29fc567965e8b413c1533572313.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_5b00d29fc567965e8b413c1533572313.jpg saved to cache
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d797935d-6332-5bd1-b9eb-fdcde16c6582
2026-03-27 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_b145c5aeb316bd5588897c096eb50484.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf327d50>
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_e4094a1ceadc2274f1f4d8faaff6513a.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_e4094a1ceadc2274f1f4d8faaff6513a.jpg saved to cache
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d797935d-6332-5bd1-b9eb-fdcde16c6582
2026-03-27 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_941caae8949e5ece54dca741f0229a86.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_622601c067f0cbddf57b7a72febea093.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf306850>
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_b145c5aeb316bd5588897c096eb50484.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_b145c5aeb316bd5588897c096eb50484.jpg saved to cache
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d797935d-6332-5bd1-b9eb-fdcde16c6582
2026-03-27 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_8b4731852def186f6ae1aaf4195afb14.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1d2390>
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_941caae8949e5ece54dca741f0229a86.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_941caae8949e5ece54dca741f0229a86.jpg saved to cache
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d797935d-6332-5bd1-b9eb-fdcde16c6582
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf325190>
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_622601c067f0cbddf57b7a72febea093.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_622601c067f0cbddf57b7a72febea093.jpg saved to cache
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d797935d-6332-5bd1-b9eb-fdcde16c6582
2026-03-27 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_88464d64915395da77f690e12811da85.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_5fdcc84647c0fa7c1166ac3ee8afa134.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c53c55d0>
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_8b4731852def186f6ae1aaf4195afb14.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_8b4731852def186f6ae1aaf4195afb14.jpg saved to cache
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d797935d-6332-5bd1-b9eb-fdcde16c6582
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0adb50>
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_88464d64915395da77f690e12811da85.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_88464d64915395da77f690e12811da85.jpg saved to cache
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fbdd0925-1030-5135-b202-7815fa866981
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1b9510>
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa9%252F5ea94e656e3d2a6f2c48daa9f198aebc%252Fpa%252FWC63339_5fdcc84647c0fa7c1166ac3ee8afa134.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_5fdcc84647c0fa7c1166ac3ee8afa134.jpg saved to cache
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d797935d-6332-5bd1-b9eb-fdcde16c6582
2026-03-27 10:36:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d797935d-6332-5bd1-b9eb-fdcde16c6582, skipping ID generation
2026-03-27 10:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d797935d-6332-5bd1-b9eb-fdcde16c6582 with scrape type 1
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d797935d-6332-5bd1-b9eb-fdcde16c6582 sending to next pipeline
2026-03-27 10:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d797935d-6332-5bd1-b9eb-fdcde16c6582, identifier: WC63339
2026-03-27 10:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d797935d-6332-5bd1-b9eb-fdcde16c6582 with identifier: WC63339
2026-03-27 10:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d797935d-6332-5bd1-b9eb-fdcde16c6582 with identifier: WC63339
2026-03-27 10:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d797935d-6332-5bd1-b9eb-fdcde16c6582 with identifier: WC63339 to the API
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_5fdcc84647c0fa7c1166ac3ee8afa134.jpg>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:26:09Z',
'fuel_type': 'petrol',
'id': 'd797935d-6332-5bd1-b9eb-fdcde16c6582',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC63339',
'listing': 'auction',
'location': 'DE, Waiblingen',
'make': 'BMW',
'model': '3er',
'odometer': 78431,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2967960,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_e4fc660c7003a052d471ed6df621731f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_5fdcc84647c0fa7c1166ac3ee8afa134.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_8b4731852def186f6ae1aaf4195afb14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75933,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_622601c067f0cbddf57b7a72febea093.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_941caae8949e5ece54dca741f0229a86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73092,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_b145c5aeb316bd5588897c096eb50484.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64427,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_0abc6b64f0d7c2845591d0b1aad26bd5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_e4094a1ceadc2274f1f4d8faaff6513a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75985,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_5b00d29fc567965e8b413c1533572313.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d797935d-6332-5bd1-b9eb-fdcde16c6582/d797935d-6332-5bd1-b9eb-fdcde16c6582_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/a9/5ea94e656e3d2a6f2c48daa9f198aebc/pa/WC63339_9f856fa155825909aac9ca8d6f868250.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-09-20',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 318i Sport Line',
'transmission': 'manual',
'trim': 'Sport Line',
'year': 2016}
2026-03-27 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63339%27 HTTP/1.1" 200 None
2026-03-27 10:36:35 [auto1.de] INFO: Saving data for WC63339: {'created_time': 1774607795.166984, 'last_price_update_time': 1774607795.166997, 'auction_closing_time': 1774715169.0}
2026-03-27 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC63339') HTTP/1.1" 204 0
2026-03-27 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU49821/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_69135472daa1fa7357f6d619efc1eeb2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0ad790>
2026-03-27 10:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_69135472daa1fa7357f6d619efc1eeb2.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_69135472daa1fa7357f6d619efc1eeb2.jpg saved to cache
2026-03-27 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fbdd0925-1030-5135-b202-7815fa866981
2026-03-27 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_a407e1d000fe55ce80dd3fe9bddd4ac3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be036f90>
2026-03-27 10:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F3c%252F813cf7d2bfe9734238e185c22a291bb4%252Fpa%252FVM88719_a407e1d000fe55ce80dd3fe9bddd4ac3.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_a407e1d000fe55ce80dd3fe9bddd4ac3.jpg saved to cache
2026-03-27 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fbdd0925-1030-5135-b202-7815fa866981
2026-03-27 10:36:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fbdd0925-1030-5135-b202-7815fa866981, skipping ID generation
2026-03-27 10:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbdd0925-1030-5135-b202-7815fa866981 with scrape type 1
2026-03-27 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fbdd0925-1030-5135-b202-7815fa866981 sending to next pipeline
2026-03-27 10:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbdd0925-1030-5135-b202-7815fa866981, identifier: VM88719
2026-03-27 10:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbdd0925-1030-5135-b202-7815fa866981 with identifier: VM88719
2026-03-27 10:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbdd0925-1030-5135-b202-7815fa866981 with identifier: VM88719
2026-03-27 10:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbdd0925-1030-5135-b202-7815fa866981 with identifier: VM88719 to the API
2026-03-27 10:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_a407e1d000fe55ce80dd3fe9bddd4ac3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 169,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 300,
'expiration_date': '2026-03-28T16:31:55Z',
'fuel_type': 'petrol',
'id': 'fbdd0925-1030-5135-b202-7815fa866981',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM88719',
'listing': 'auction',
'location': 'DE, Oranienburg',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 95796,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78693,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_6f0a96ff4025dd56c2d14157c82cad99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2413150,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_bd1b4ae32e96bdf859ebb761c30bbca1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2449647,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_6e87a9ef707ed3628429bad6c65b818e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2011486,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_a407e1d000fe55ce80dd3fe9bddd4ac3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2631745,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_69135472daa1fa7357f6d619efc1eeb2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_88464d64915395da77f690e12811da85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2143287,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_cb7caa25fd782c733efd9862e2686aea.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_0f84355d21197f322f37257f7368c4ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_0118c85a27062100a3fdd211720d99ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdd0925-1030-5135-b202-7815fa866981/fbdd0925-1030-5135-b202-7815fa866981_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2623892,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img81/3c/813cf7d2bfe9734238e185c22a291bb4/pa/VM88719_126b8fe33d9b03aa1d4b50c512ed3e54.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-20',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
'transmission': 'automatic',
'trim': 'GTI Clubsport',
'year': 2022}
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM88719%27 HTTP/1.1" 200 None
2026-03-27 10:36:36 [auto1.de] INFO: Saving data for VM88719: {'created_time': 1774607796.292279, 'last_price_update_time': 1774607796.29229, 'auction_closing_time': 1774715515.0}
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM88719') HTTP/1.1" 204 0
2026-03-27 10:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:36 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 10499 | hits on page: 40
2026-03-27 10:36:36 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM95943%27 HTTP/1.1" 200 None
2026-03-27 10:36:36 [auto1.de] INFO: Scrape type for UM95943: 2
2026-03-27 10:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f706def7-857d-5d05-82c1-9b0ada2e70be with identifier: UM95943
2026-03-27 10:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f706def7-857d-5d05-82c1-9b0ada2e70be with scrape type 2
2026-03-27 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f706def7-857d-5d05-82c1-9b0ada2e70be with scrape type 2
2026-03-27 10:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f706def7-857d-5d05-82c1-9b0ada2e70be, identifier: UM95943
2026-03-27 10:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f706def7-857d-5d05-82c1-9b0ada2e70be with identifier: UM95943
2026-03-27 10:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f706def7-857d-5d05-82c1-9b0ada2e70be with identifier: UM95943
2026-03-27 10:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f706def7-857d-5d05-82c1-9b0ada2e70be with identifier: UM95943 to the API
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:51:51Z',
'fuel_type': 'petrol',
'id': 'f706def7-857d-5d05-82c1-9b0ada2e70be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM95943',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 107240,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-04',
'seller_name': None,
'title': 'Seat Ibiza 1.2 TSI Connect',
'transmission': 'manual',
'trim': 'Connect',
'year': 2016}
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM95943%27 HTTP/1.1" 200 None
2026-03-27 10:36:36 [auto1.de] INFO: Saving data for UM95943: {'auction_closing_time': 1774716711.0, 'created_time': 1774290721.434664, 'last_price_update_time': 1774607796.881039}
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM95943') HTTP/1.1" 204 0
2026-03-27 10:36:36 [auto1.de] INFO: Found listing with ID: NW54336
2026-03-27 10:36:36 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-27 10:36:36 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-27 10:36:36 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-27 10:36:36 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF67152%27 HTTP/1.1" 200 None
2026-03-27 10:36:36 [auto1.de] INFO: Scrape type for PF67152: 2
2026-03-27 10:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3915990-984b-54de-bca3-12bde127017a with identifier: PF67152
2026-03-27 10:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3915990-984b-54de-bca3-12bde127017a with scrape type 2
2026-03-27 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3915990-984b-54de-bca3-12bde127017a with scrape type 2
2026-03-27 10:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3915990-984b-54de-bca3-12bde127017a, identifier: PF67152
2026-03-27 10:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3915990-984b-54de-bca3-12bde127017a with identifier: PF67152
2026-03-27 10:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3915990-984b-54de-bca3-12bde127017a with identifier: PF67152
2026-03-27 10:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3915990-984b-54de-bca3-12bde127017a with identifier: PF67152 to the API
2026-03-27 10:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:36:12Z',
'fuel_type': 'diesel',
'id': 'd3915990-984b-54de-bca3-12bde127017a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF67152',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 257745,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-19',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2016}
2026-03-27 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF67152%27 HTTP/1.1" 200 None
2026-03-27 10:36:37 [auto1.de] INFO: Saving data for PF67152: {'auction_closing_time': 1774715772.0, 'created_time': 1774294233.663818, 'last_price_update_time': 1774607797.364929}
2026-03-27 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF67152') HTTP/1.1" 204 0
2026-03-27 10:36:37 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-27 10:36:37 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-27 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR58128%27 HTTP/1.1" 200 None
2026-03-27 10:36:37 [auto1.de] INFO: Scrape type for XR58128: 2
2026-03-27 10:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2fd21e0-790d-5d3a-a691-437ce04a69c8 with identifier: XR58128
2026-03-27 10:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2fd21e0-790d-5d3a-a691-437ce04a69c8 with scrape type 2
2026-03-27 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2fd21e0-790d-5d3a-a691-437ce04a69c8 with scrape type 2
2026-03-27 10:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2fd21e0-790d-5d3a-a691-437ce04a69c8, identifier: XR58128
2026-03-27 10:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2fd21e0-790d-5d3a-a691-437ce04a69c8 with identifier: XR58128
2026-03-27 10:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2fd21e0-790d-5d3a-a691-437ce04a69c8 with identifier: XR58128
2026-03-27 10:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2fd21e0-790d-5d3a-a691-437ce04a69c8 with identifier: XR58128 to the API
2026-03-27 10:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:00:10Z',
'fuel_type': 'diesel',
'id': 'a2fd21e0-790d-5d3a-a691-437ce04a69c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR58128',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 160999,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-18',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Multivan Generation Six 4Motion',
'transmission': 'automatic',
'trim': 'Multivan Generation Six 4Motion',
'year': 2016}
2026-03-27 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR58128%27 HTTP/1.1" 200 None
2026-03-27 10:36:37 [auto1.de] INFO: Saving data for XR58128: {'auction_closing_time': 1774713610.0, 'created_time': 1774263264.809831, 'last_price_update_time': 1774607797.834406}
2026-03-27 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR58128') HTTP/1.1" 204 0
2026-03-27 10:36:37 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-27 10:36:37 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-27 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK31212%27 HTTP/1.1" 200 None
2026-03-27 10:36:37 [auto1.de] INFO: Scrape type for JK31212: 2
2026-03-27 10:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bec0fae5-44c1-585d-a155-88ba83a17202 with identifier: JK31212
2026-03-27 10:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bec0fae5-44c1-585d-a155-88ba83a17202 with scrape type 2
2026-03-27 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bec0fae5-44c1-585d-a155-88ba83a17202 with scrape type 2
2026-03-27 10:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bec0fae5-44c1-585d-a155-88ba83a17202, identifier: JK31212
2026-03-27 10:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bec0fae5-44c1-585d-a155-88ba83a17202 with identifier: JK31212
2026-03-27 10:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bec0fae5-44c1-585d-a155-88ba83a17202 with identifier: JK31212
2026-03-27 10:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bec0fae5-44c1-585d-a155-88ba83a17202 with identifier: JK31212 to the API
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:34:39Z',
'fuel_type': 'petrol',
'id': 'bec0fae5-44c1-585d-a155-88ba83a17202',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK31212',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 82790,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-12-08',
'seller_name': None,
'title': 'Audi A6 2.0',
'transmission': 'automatic',
'trim': '',
'year': 2002}
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK31212%27 HTTP/1.1" 200 None
2026-03-27 10:36:38 [auto1.de] INFO: Saving data for JK31212: {'auction_closing_time': 1774715679.0, 'created_time': 1773687366.318032, 'last_price_update_time': 1774607798.320539}
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK31212') HTTP/1.1" 204 0
2026-03-27 10:36:38 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-27 10:36:38 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY96570%27 HTTP/1.1" 200 None
2026-03-27 10:36:38 [auto1.de] INFO: Scrape type for GY96570: 2
2026-03-27 10:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b4a116-f55d-5e49-aa23-c6dbf61b2494 with identifier: GY96570
2026-03-27 10:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b4a116-f55d-5e49-aa23-c6dbf61b2494 with scrape type 2
2026-03-27 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9b4a116-f55d-5e49-aa23-c6dbf61b2494 with scrape type 2
2026-03-27 10:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9b4a116-f55d-5e49-aa23-c6dbf61b2494, identifier: GY96570
2026-03-27 10:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9b4a116-f55d-5e49-aa23-c6dbf61b2494 with identifier: GY96570
2026-03-27 10:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9b4a116-f55d-5e49-aa23-c6dbf61b2494 with identifier: GY96570
2026-03-27 10:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9b4a116-f55d-5e49-aa23-c6dbf61b2494 with identifier: GY96570 to the API
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:52:21Z',
'fuel_type': 'diesel',
'id': 'a9b4a116-f55d-5e49-aa23-c6dbf61b2494',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY96570',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 82447,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-01',
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 2.0 TDI Highline 4Motion',
'transmission': 'automatic',
'trim': 'Highline 4Motion',
'year': 2019}
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY96570%27 HTTP/1.1" 200 None
2026-03-27 10:36:38 [auto1.de] INFO: Saving data for GY96570: {'auction_closing_time': 1774716741.0, 'created_time': 1773307460.528637, 'last_price_update_time': 1774607798.908596}
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY96570') HTTP/1.1" 204 0
2026-03-27 10:36:38 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU59417%27 HTTP/1.1" 200 None
2026-03-27 10:36:38 [auto1.de] INFO: Scrape type for ZU59417: 2
2026-03-27 10:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8407425c-0f4f-5956-89f3-e7d9d7d49a3d with identifier: ZU59417
2026-03-27 10:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8407425c-0f4f-5956-89f3-e7d9d7d49a3d with scrape type 2
2026-03-27 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8407425c-0f4f-5956-89f3-e7d9d7d49a3d with scrape type 2
2026-03-27 10:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8407425c-0f4f-5956-89f3-e7d9d7d49a3d, identifier: ZU59417
2026-03-27 10:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8407425c-0f4f-5956-89f3-e7d9d7d49a3d with identifier: ZU59417
2026-03-27 10:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8407425c-0f4f-5956-89f3-e7d9d7d49a3d with identifier: ZU59417
2026-03-27 10:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8407425c-0f4f-5956-89f3-e7d9d7d49a3d with identifier: ZU59417 to the API
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-28T16:34:12Z',
'fuel_type': 'petrol',
'id': '8407425c-0f4f-5956-89f3-e7d9d7d49a3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU59417',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 73259,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-29',
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2019}
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU59417%27 HTTP/1.1" 200 None
2026-03-27 10:36:39 [auto1.de] INFO: Saving data for ZU59417: {'auction_closing_time': 1774715652.0, 'created_time': 1774290961.666728, 'last_price_update_time': 1774607799.420947}
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU59417') HTTP/1.1" 204 0
2026-03-27 10:36:39 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-27 10:36:39 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX86336%27 HTTP/1.1" 200 None
2026-03-27 10:36:39 [auto1.de] INFO: Scrape type for LX86336: 2
2026-03-27 10:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 667ce6bf-58de-515c-98fa-e28fac7675bb with identifier: LX86336
2026-03-27 10:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 667ce6bf-58de-515c-98fa-e28fac7675bb with scrape type 2
2026-03-27 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 667ce6bf-58de-515c-98fa-e28fac7675bb with scrape type 2
2026-03-27 10:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 667ce6bf-58de-515c-98fa-e28fac7675bb, identifier: LX86336
2026-03-27 10:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 667ce6bf-58de-515c-98fa-e28fac7675bb with identifier: LX86336
2026-03-27 10:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 667ce6bf-58de-515c-98fa-e28fac7675bb with identifier: LX86336
2026-03-27 10:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 667ce6bf-58de-515c-98fa-e28fac7675bb with identifier: LX86336 to the API
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:43:17Z',
'fuel_type': 'petrol',
'id': '667ce6bf-58de-515c-98fa-e28fac7675bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX86336',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 49143,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-18',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2018}
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX86336%27 HTTP/1.1" 200 None
2026-03-27 10:36:40 [auto1.de] INFO: Saving data for LX86336: {'auction_closing_time': 1774716197.0, 'created_time': 1774291167.36695, 'last_price_update_time': 1774607800.10679}
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX86336') HTTP/1.1" 204 0
2026-03-27 10:36:40 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-27 10:36:40 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK68029%27 HTTP/1.1" 200 None
2026-03-27 10:36:40 [auto1.de] INFO: Scrape type for HK68029: 2
2026-03-27 10:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f108aaeb-517f-52f2-8ade-454bd505c4d0 with identifier: HK68029
2026-03-27 10:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f108aaeb-517f-52f2-8ade-454bd505c4d0 with scrape type 2
2026-03-27 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f108aaeb-517f-52f2-8ade-454bd505c4d0 with scrape type 2
2026-03-27 10:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f108aaeb-517f-52f2-8ade-454bd505c4d0, identifier: HK68029
2026-03-27 10:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f108aaeb-517f-52f2-8ade-454bd505c4d0 with identifier: HK68029
2026-03-27 10:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f108aaeb-517f-52f2-8ade-454bd505c4d0 with identifier: HK68029
2026-03-27 10:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f108aaeb-517f-52f2-8ade-454bd505c4d0 with identifier: HK68029 to the API
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-03-28T16:27:11Z',
'fuel_type': 'diesel',
'id': 'f108aaeb-517f-52f2-8ade-454bd505c4d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK68029',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'M-Klasse',
'odometer': 363136,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-11-19',
'seller_name': None,
'title': 'Mercedes-Benz M-Klasse ML 320 CDI',
'transmission': 'automatic',
'trim': '',
'year': 2007}
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK68029%27 HTTP/1.1" 200 None
2026-03-27 10:36:40 [auto1.de] INFO: Saving data for HK68029: {'auction_closing_time': 1774715231.0, 'created_time': 1773687853.882407, 'last_price_update_time': 1774607800.581487}
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK68029') HTTP/1.1" 204 0
2026-03-27 10:36:40 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-27 10:36:40 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL71232%27 HTTP/1.1" 200 None
2026-03-27 10:36:40 [auto1.de] INFO: Scrape type for AL71232: 2
2026-03-27 10:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b7451f4-d5f3-51cb-8269-84453813d405 with identifier: AL71232
2026-03-27 10:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b7451f4-d5f3-51cb-8269-84453813d405 with scrape type 2
2026-03-27 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b7451f4-d5f3-51cb-8269-84453813d405 with scrape type 2
2026-03-27 10:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b7451f4-d5f3-51cb-8269-84453813d405, identifier: AL71232
2026-03-27 10:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b7451f4-d5f3-51cb-8269-84453813d405 with identifier: AL71232
2026-03-27 10:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b7451f4-d5f3-51cb-8269-84453813d405 with identifier: AL71232
2026-03-27 10:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b7451f4-d5f3-51cb-8269-84453813d405 with identifier: AL71232 to the API
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:14:44Z',
'fuel_type': 'petrol',
'id': '1b7451f4-d5f3-51cb-8269-84453813d405',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL71232',
'listing': 'auction',
'make': 'Audi',
'model': 'A1',
'odometer': 129595,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-04',
'seller_name': None,
'title': 'Audi A1 1.4 TFSI S line Sportpaket',
'transmission': 'manual',
'trim': 'S line Sportpaket',
'year': 2015}
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL71232%27 HTTP/1.1" 200 None
2026-03-27 10:36:41 [auto1.de] INFO: Saving data for AL71232: {'auction_closing_time': 1774714484.0, 'created_time': 1773859369.203921, 'last_price_update_time': 1774607801.076467}
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL71232') HTTP/1.1" 204 0
2026-03-27 10:36:41 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG34201%27 HTTP/1.1" 200 None
2026-03-27 10:36:41 [auto1.de] INFO: Scrape type for EG34201: 2
2026-03-27 10:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bedc9dc1-37d8-58bf-a424-2b2ac84e9701 with identifier: EG34201
2026-03-27 10:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bedc9dc1-37d8-58bf-a424-2b2ac84e9701 with scrape type 2
2026-03-27 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bedc9dc1-37d8-58bf-a424-2b2ac84e9701 with scrape type 2
2026-03-27 10:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bedc9dc1-37d8-58bf-a424-2b2ac84e9701, identifier: EG34201
2026-03-27 10:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bedc9dc1-37d8-58bf-a424-2b2ac84e9701 with identifier: EG34201
2026-03-27 10:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bedc9dc1-37d8-58bf-a424-2b2ac84e9701 with identifier: EG34201
2026-03-27 10:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bedc9dc1-37d8-58bf-a424-2b2ac84e9701 with identifier: EG34201 to the API
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:42:22Z',
'fuel_type': 'petrol',
'id': 'bedc9dc1-37d8-58bf-a424-2b2ac84e9701',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG34201',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 191827,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-04-03',
'seller_name': None,
'title': 'Audi A4 2.0 TFSIe',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG34201%27 HTTP/1.1" 200 None
2026-03-27 10:36:41 [auto1.de] INFO: Saving data for EG34201: {'auction_closing_time': 1774716142.0, 'created_time': 1773776371.311434, 'last_price_update_time': 1774607801.764235}
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG34201') HTTP/1.1" 204 0
2026-03-27 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR92717> (referer: https://www.auto1.com/v1/car-details-view/FR92717/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:41 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-27 10:36:41 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH16330%27 HTTP/1.1" 200 None
2026-03-27 10:36:41 [auto1.de] INFO: Scrape type for PH16330: 2
2026-03-27 10:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a985feb1-4c09-50c0-8023-e8f1c7394cd4 with identifier: PH16330
2026-03-27 10:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a985feb1-4c09-50c0-8023-e8f1c7394cd4 with scrape type 2
2026-03-27 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a985feb1-4c09-50c0-8023-e8f1c7394cd4 with scrape type 2
2026-03-27 10:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a985feb1-4c09-50c0-8023-e8f1c7394cd4, identifier: PH16330
2026-03-27 10:36:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CK07133/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a985feb1-4c09-50c0-8023-e8f1c7394cd4 with identifier: PH16330
2026-03-27 10:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a985feb1-4c09-50c0-8023-e8f1c7394cd4 with identifier: PH16330
2026-03-27 10:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a985feb1-4c09-50c0-8023-e8f1c7394cd4 with identifier: PH16330 to the API
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:26:23Z',
'fuel_type': 'diesel',
'id': 'a985feb1-4c09-50c0-8023-e8f1c7394cd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH16330',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 123118,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-23',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Elegance 4Motion',
'transmission': 'automatic',
'trim': 'Elegance 4Motion',
'year': 2021}
2026-03-27 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH16330%27 HTTP/1.1" 200 None
2026-03-27 10:36:42 [auto1.de] INFO: Saving data for PH16330: {'auction_closing_time': 1774715183.0, 'created_time': 1773304371.014517, 'last_price_update_time': 1774607802.235815}
2026-03-27 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH16330') HTTP/1.1" 204 0
2026-03-27 10:36:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:42 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-27 10:36:42 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-27 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH61225%27 HTTP/1.1" 200 None
2026-03-27 10:36:42 [auto1.de] INFO: Scrape type for HH61225: 2
2026-03-27 10:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23ab9583-c06e-5ff2-a854-fb39b6a05c87 with identifier: HH61225
2026-03-27 10:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23ab9583-c06e-5ff2-a854-fb39b6a05c87 with scrape type 2
2026-03-27 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23ab9583-c06e-5ff2-a854-fb39b6a05c87 with scrape type 2
2026-03-27 10:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23ab9583-c06e-5ff2-a854-fb39b6a05c87, identifier: HH61225
2026-03-27 10:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23ab9583-c06e-5ff2-a854-fb39b6a05c87 with identifier: HH61225
2026-03-27 10:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23ab9583-c06e-5ff2-a854-fb39b6a05c87 with identifier: HH61225
2026-03-27 10:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23ab9583-c06e-5ff2-a854-fb39b6a05c87 with identifier: HH61225 to the API
2026-03-27 10:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:47:46Z',
'fuel_type': 'petrol',
'id': '23ab9583-c06e-5ff2-a854-fb39b6a05c87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH61225',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 70204,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-12-11',
'seller_name': None,
'title': 'Toyota RAV 4 2.0 Special 4x4',
'transmission': 'manual',
'trim': 'Special 4x4',
'year': 2002}
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH61225%27 HTTP/1.1" 200 None
2026-03-27 10:36:43 [auto1.de] INFO: Saving data for HH61225: {'auction_closing_time': 1774716466.0, 'created_time': 1773305128.605758, 'last_price_update_time': 1774607803.14499}
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH61225') HTTP/1.1" 204 0
2026-03-27 10:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcf531ae-96c1-569c-a7c7-f12a6e59abd6 with identifier: FR92717
2026-03-27 10:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcf531ae-96c1-569c-a7c7-f12a6e59abd6 with scrape type 1
2026-03-27 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcf531ae-96c1-569c-a7c7-f12a6e59abd6
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_5f63755a30df77ea684f98b66c6e20f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_5f63755a30df77ea684f98b66c6e20f4.jpg not downloaded yet
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03907%27 HTTP/1.1" 200 None
2026-03-27 10:36:43 [auto1.de] INFO: Scrape type for BJ03907: 2
2026-03-27 10:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a535f07-fa4a-5c06-bf25-732891dafc2c with identifier: BJ03907
2026-03-27 10:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a535f07-fa4a-5c06-bf25-732891dafc2c with scrape type 2
2026-03-27 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a535f07-fa4a-5c06-bf25-732891dafc2c with scrape type 2
2026-03-27 10:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a535f07-fa4a-5c06-bf25-732891dafc2c, identifier: BJ03907
2026-03-27 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG44703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a535f07-fa4a-5c06-bf25-732891dafc2c with identifier: BJ03907
2026-03-27 10:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a535f07-fa4a-5c06-bf25-732891dafc2c with identifier: BJ03907
2026-03-27 10:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a535f07-fa4a-5c06-bf25-732891dafc2c with identifier: BJ03907 to the API
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:14:59Z',
'fuel_type': 'petrol',
'id': '1a535f07-fa4a-5c06-bf25-732891dafc2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ03907',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 187156,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-07-19',
'seller_name': None,
'title': 'BMW 5er 523i',
'transmission': 'automatic',
'trim': '',
'year': 1998}
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03907%27 HTTP/1.1" 200 None
2026-03-27 10:36:43 [auto1.de] INFO: Saving data for BJ03907: {'auction_closing_time': 1774714499.0, 'created_time': 1774292268.597958, 'last_price_update_time': 1774607803.748182}
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ03907') HTTP/1.1" 204 0
2026-03-27 10:36:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_fde9835dc187c626f6c746db362ec195.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_fde9835dc187c626f6c746db362ec195.jpg not downloaded yet
2026-03-27 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV33449/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89371%27 HTTP/1.1" 200 None
2026-03-27 10:36:43 [auto1.de] INFO: Scrape type for CC89371: 2
2026-03-27 10:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 890ec45a-502a-5db8-9b63-0c20285237bf with identifier: CC89371
2026-03-27 10:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 890ec45a-502a-5db8-9b63-0c20285237bf with scrape type 2
2026-03-27 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 890ec45a-502a-5db8-9b63-0c20285237bf with scrape type 2
2026-03-27 10:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 890ec45a-502a-5db8-9b63-0c20285237bf, identifier: CC89371
2026-03-27 10:36:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 890ec45a-502a-5db8-9b63-0c20285237bf with identifier: CC89371
2026-03-27 10:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 890ec45a-502a-5db8-9b63-0c20285237bf with identifier: CC89371
2026-03-27 10:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 890ec45a-502a-5db8-9b63-0c20285237bf with identifier: CC89371 to the API
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:05:48Z',
'fuel_type': 'petrol',
'id': '890ec45a-502a-5db8-9b63-0c20285237bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC89371',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 84446,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-25',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
'transmission': 'manual',
'trim': 'BlueEfficiency Urban',
'year': 2013}
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89371%27 HTTP/1.1" 200 None
2026-03-27 10:36:44 [auto1.de] INFO: Saving data for CC89371: {'auction_closing_time': 1774713948.0, 'created_time': 1773301802.505674, 'last_price_update_time': 1774607804.26486}
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC89371') HTTP/1.1" 204 0
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_6ddf06b1053b8d00b335366ece18913c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_6ddf06b1053b8d00b335366ece18913c.jpg not downloaded yet
2026-03-27 10:36:44 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG26326%27 HTTP/1.1" 200 None
2026-03-27 10:36:44 [auto1.de] INFO: Scrape type for VG26326: 2
2026-03-27 10:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2b12821-e98c-521d-9438-a452a39ba8ea with identifier: VG26326
2026-03-27 10:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2b12821-e98c-521d-9438-a452a39ba8ea with scrape type 2
2026-03-27 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2b12821-e98c-521d-9438-a452a39ba8ea with scrape type 2
2026-03-27 10:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2b12821-e98c-521d-9438-a452a39ba8ea, identifier: VG26326
2026-03-27 10:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2b12821-e98c-521d-9438-a452a39ba8ea with identifier: VG26326
2026-03-27 10:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2b12821-e98c-521d-9438-a452a39ba8ea with identifier: VG26326
2026-03-27 10:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2b12821-e98c-521d-9438-a452a39ba8ea with identifier: VG26326 to the API
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:40:53Z',
'fuel_type': 'petrol',
'id': 'd2b12821-e98c-521d-9438-a452a39ba8ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG26326',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 129395,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-08',
'seller_name': None,
'title': 'Opel Mokka 1.4 Turbo Edition',
'transmission': 'automatic',
'trim': 'Edition',
'year': 2016}
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG26326%27 HTTP/1.1" 200 None
2026-03-27 10:36:44 [auto1.de] INFO: Saving data for VG26326: {'auction_closing_time': 1774716053.0, 'created_time': 1773859845.04371, 'last_price_update_time': 1774607804.799229}
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG26326') HTTP/1.1" 204 0
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_ae89f83ede3876cec048e817c3c92316.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_ae89f83ede3876cec048e817c3c92316.jpg not downloaded yet
2026-03-27 10:36:44 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL88784%27 HTTP/1.1" 200 None
2026-03-27 10:36:44 [auto1.de] INFO: Scrape type for LL88784: 2
2026-03-27 10:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bb58457-c95d-57d1-9ec3-bdc02cd1834b with identifier: LL88784
2026-03-27 10:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bb58457-c95d-57d1-9ec3-bdc02cd1834b with scrape type 2
2026-03-27 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bb58457-c95d-57d1-9ec3-bdc02cd1834b with scrape type 2
2026-03-27 10:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bb58457-c95d-57d1-9ec3-bdc02cd1834b, identifier: LL88784
2026-03-27 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_5f63755a30df77ea684f98b66c6e20f4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bb58457-c95d-57d1-9ec3-bdc02cd1834b with identifier: LL88784
2026-03-27 10:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bb58457-c95d-57d1-9ec3-bdc02cd1834b with identifier: LL88784
2026-03-27 10:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bb58457-c95d-57d1-9ec3-bdc02cd1834b with identifier: LL88784 to the API
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-28T16:27:18Z',
'fuel_type': 'diesel',
'id': '2bb58457-c95d-57d1-9ec3-bdc02cd1834b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL88784',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 140622,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-06',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 CDI T Elegance',
'transmission': 'automatic',
'trim': 'T Elegance',
'year': 2011}
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL88784%27 HTTP/1.1" 200 None
2026-03-27 10:36:45 [auto1.de] INFO: Saving data for LL88784: {'auction_closing_time': 1774715238.0, 'created_time': 1773304838.315517, 'last_price_update_time': 1774607805.294515}
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL88784') HTTP/1.1" 204 0
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_1c31022f401c19c8d576723891bc474c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_1c31022f401c19c8d576723891bc474c.jpg not downloaded yet
2026-03-27 10:36:45 [auto1.de] INFO: Found listing with ID: HW66490
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW66490%27 HTTP/1.1" 200 None
2026-03-27 10:36:45 [auto1.de] INFO: Scrape type for HW66490: 2
2026-03-27 10:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00a79375-40fa-520a-81d8-6cc5623e8131 with identifier: HW66490
2026-03-27 10:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00a79375-40fa-520a-81d8-6cc5623e8131 with scrape type 2
2026-03-27 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00a79375-40fa-520a-81d8-6cc5623e8131 with scrape type 2
2026-03-27 10:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00a79375-40fa-520a-81d8-6cc5623e8131, identifier: HW66490
2026-03-27 10:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00a79375-40fa-520a-81d8-6cc5623e8131 with identifier: HW66490
2026-03-27 10:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00a79375-40fa-520a-81d8-6cc5623e8131 with identifier: HW66490
2026-03-27 10:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00a79375-40fa-520a-81d8-6cc5623e8131 with identifier: HW66490 to the API
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:35:36Z',
'fuel_type': 'petrol',
'id': '00a79375-40fa-520a-81d8-6cc5623e8131',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW66490',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 101611,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-17',
'seller_name': None,
'title': 'Opel Corsa 1.2 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2022}
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW66490%27 HTTP/1.1" 200 None
2026-03-27 10:36:45 [auto1.de] INFO: Saving data for HW66490: {'auction_closing_time': 1774715736.0, 'created_time': 1774291116.770528, 'last_price_update_time': 1774607805.76446}
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW66490') HTTP/1.1" 204 0
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_c96bc11fac22c4e5ec8dba5eb2687dc6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_c96bc11fac22c4e5ec8dba5eb2687dc6.jpg not downloaded yet
2026-03-27 10:36:45 [auto1.de] INFO: Found listing with ID: UH98886
2026-03-27 10:36:45 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC17243%27 HTTP/1.1" 200 None
2026-03-27 10:36:45 [auto1.de] INFO: Scrape type for XC17243: 2
2026-03-27 10:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea6f3cf5-df17-5907-9c4d-a6074d92f54e with identifier: XC17243
2026-03-27 10:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea6f3cf5-df17-5907-9c4d-a6074d92f54e with scrape type 2
2026-03-27 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea6f3cf5-df17-5907-9c4d-a6074d92f54e with scrape type 2
2026-03-27 10:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea6f3cf5-df17-5907-9c4d-a6074d92f54e, identifier: XC17243
2026-03-27 10:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea6f3cf5-df17-5907-9c4d-a6074d92f54e with identifier: XC17243
2026-03-27 10:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea6f3cf5-df17-5907-9c4d-a6074d92f54e with identifier: XC17243
2026-03-27 10:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea6f3cf5-df17-5907-9c4d-a6074d92f54e with identifier: XC17243 to the API
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:30:18Z',
'fuel_type': 'petrol',
'id': 'ea6f3cf5-df17-5907-9c4d-a6074d92f54e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC17243',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 112748,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-03',
'seller_name': None,
'title': 'Seat Ibiza 1.2 TSI Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2011}
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC17243%27 HTTP/1.1" 200 None
2026-03-27 10:36:46 [auto1.de] INFO: Saving data for XC17243: {'auction_closing_time': 1774715418.0, 'created_time': 1774032301.563577, 'last_price_update_time': 1774607806.333774}
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC17243') HTTP/1.1" 204 0
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_04512596f63d27016cdf6811f981552c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_04512596f63d27016cdf6811f981552c.jpg not downloaded yet
2026-03-27 10:36:46 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ27483%27 HTTP/1.1" 200 None
2026-03-27 10:36:46 [auto1.de] INFO: Scrape type for PZ27483: 2
2026-03-27 10:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db87229-e7e8-562d-adfc-6d731d6ae341 with identifier: PZ27483
2026-03-27 10:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db87229-e7e8-562d-adfc-6d731d6ae341 with scrape type 2
2026-03-27 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3db87229-e7e8-562d-adfc-6d731d6ae341 with scrape type 2
2026-03-27 10:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3db87229-e7e8-562d-adfc-6d731d6ae341, identifier: PZ27483
2026-03-27 10:36:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0ac990>
2026-03-27 10:36:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_5f63755a30df77ea684f98b66c6e20f4.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_5f63755a30df77ea684f98b66c6e20f4.jpg saved to cache
2026-03-27 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcf531ae-96c1-569c-a7c7-f12a6e59abd6
2026-03-27 10:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3db87229-e7e8-562d-adfc-6d731d6ae341 with identifier: PZ27483
2026-03-27 10:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3db87229-e7e8-562d-adfc-6d731d6ae341 with identifier: PZ27483
2026-03-27 10:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3db87229-e7e8-562d-adfc-6d731d6ae341 with identifier: PZ27483 to the API
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:05:00Z',
'fuel_type': 'petrol',
'id': '3db87229-e7e8-562d-adfc-6d731d6ae341',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ27483',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira',
'odometer': 130949,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-27',
'seller_name': None,
'title': 'Opel Zafira 1.6 Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2011}
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ27483%27 HTTP/1.1" 200 None
2026-03-27 10:36:47 [auto1.de] INFO: Saving data for PZ27483: {'auction_closing_time': 1774713900.0, 'created_time': 1774262269.053473, 'last_price_update_time': 1774607807.014197}
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ27483') HTTP/1.1" 204 0
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_d74db13daac88618cae543ff92757681.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_d74db13daac88618cae543ff92757681.jpg not downloaded yet
2026-03-27 10:36:47 [auto1.de] INFO: Found listing with ID: NV75211
2026-03-27 10:36:47 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ19691%27 HTTP/1.1" 200 None
2026-03-27 10:36:47 [auto1.de] INFO: Scrape type for HZ19691: 2
2026-03-27 10:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4577fdf0-59b6-5052-89c2-6ff6a7859fac with identifier: HZ19691
2026-03-27 10:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4577fdf0-59b6-5052-89c2-6ff6a7859fac with scrape type 2
2026-03-27 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4577fdf0-59b6-5052-89c2-6ff6a7859fac with scrape type 2
2026-03-27 10:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4577fdf0-59b6-5052-89c2-6ff6a7859fac, identifier: HZ19691
2026-03-27 10:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4577fdf0-59b6-5052-89c2-6ff6a7859fac with identifier: HZ19691
2026-03-27 10:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4577fdf0-59b6-5052-89c2-6ff6a7859fac with identifier: HZ19691
2026-03-27 10:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4577fdf0-59b6-5052-89c2-6ff6a7859fac with identifier: HZ19691 to the API
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:28:17Z',
'fuel_type': 'petrol',
'id': '4577fdf0-59b6-5052-89c2-6ff6a7859fac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ19691',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 90769,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-21',
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
'transmission': 'automatic',
'trim': 'Sport 4Motion',
'year': 2018}
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ19691%27 HTTP/1.1" 200 None
2026-03-27 10:36:47 [auto1.de] INFO: Saving data for HZ19691: {'auction_closing_time': 1774715297.0, 'created_time': 1773304413.250211, 'last_price_update_time': 1774607807.553341}
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ19691') HTTP/1.1" 204 0
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_aadaa6a637677cb30e3ffbab677f9284.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_aadaa6a637677cb30e3ffbab677f9284.jpg not downloaded yet
2026-03-27 10:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS49483/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD86365> (referer: https://www.auto1.com/v1/car-details-view/SD86365/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:47 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-27 10:36:47 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-27 10:36:47 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-27 10:36:47 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK39912%27 HTTP/1.1" 200 None
2026-03-27 10:36:47 [auto1.de] INFO: Scrape type for ZK39912: 2
2026-03-27 10:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df8e66fe-d663-5c2a-bba9-abd09e0007a5 with identifier: ZK39912
2026-03-27 10:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df8e66fe-d663-5c2a-bba9-abd09e0007a5 with scrape type 2
2026-03-27 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df8e66fe-d663-5c2a-bba9-abd09e0007a5 with scrape type 2
2026-03-27 10:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df8e66fe-d663-5c2a-bba9-abd09e0007a5, identifier: ZK39912
2026-03-27 10:36:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df8e66fe-d663-5c2a-bba9-abd09e0007a5 with identifier: ZK39912
2026-03-27 10:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df8e66fe-d663-5c2a-bba9-abd09e0007a5 with identifier: ZK39912
2026-03-27 10:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df8e66fe-d663-5c2a-bba9-abd09e0007a5 with identifier: ZK39912 to the API
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:58:48Z',
'fuel_type': 'petrol',
'id': 'df8e66fe-d663-5c2a-bba9-abd09e0007a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK39912',
'listing': 'auction',
'make': 'Fiat',
'model': '500C',
'odometer': 40337,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-15',
'seller_name': None,
'title': 'Fiat 500C 1.0 Mild-Hybrid Star',
'transmission': 'manual',
'trim': 'Star',
'year': 2020}
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK39912%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [auto1.de] INFO: Saving data for ZK39912: {'auction_closing_time': 1774717128.0, 'created_time': 1773776283.539138, 'last_price_update_time': 1774607808.052016}
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK39912') HTTP/1.1" 204 0
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_f45caf3eefab9c93f3c4ef97e889eb44.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_f45caf3eefab9c93f3c4ef97e889eb44.jpg not downloaded yet
2026-03-27 10:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f with identifier: SD86365
2026-03-27 10:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f with scrape type 1
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_88e1fc1eafb22be58577827be3e7e402.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_88e1fc1eafb22be58577827be3e7e402.jpg not downloaded yet
2026-03-27 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LL66179> (referer: https://www.auto1.com/v1/car-details-view/LL66179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_25aea0a02fca716a4a1b7ab703ae15c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_25aea0a02fca716a4a1b7ab703ae15c8.jpg not downloaded yet
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_b8c8b960bf0b93ae52ee69e365b324eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_b8c8b960bf0b93ae52ee69e365b324eb.jpg not downloaded yet
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_a434afad984575739ae3f7bbb6f9ecee.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_a434afad984575739ae3f7bbb6f9ecee.jpg not downloaded yet
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_9bcdb0a465b0ed7b2955001436b54841.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_9bcdb0a465b0ed7b2955001436b54841.jpg not downloaded yet
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_697b54daf561678c68d0ed45b7f6afe1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_697b54daf561678c68d0ed45b7f6afe1.jpg not downloaded yet
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_51ede349574740c65a7b596446615824.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_51ede349574740c65a7b596446615824.jpg not downloaded yet
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_6768974e4cff9d5f5ed08b60adf23411.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_6768974e4cff9d5f5ed08b60adf23411.jpg not downloaded yet
2026-03-27 10:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdbc69b1-0d6f-5425-9245-fc5fd47d23b5 with identifier: LL66179
2026-03-27 10:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdbc69b1-0d6f-5425-9245-fc5fd47d23b5 with scrape type 1
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cdbc69b1-0d6f-5425-9245-fc5fd47d23b5
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_0f5044ad69ffd5fe036a24817e46a1b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_0f5044ad69ffd5fe036a24817e46a1b8.jpg not downloaded yet
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_54f8feb63a55fdb65e4531e3b7415fb1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_54f8feb63a55fdb65e4531e3b7415fb1.jpg not downloaded yet
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_8881134a6e46dfbdce22c2959fae7ffa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_8881134a6e46dfbdce22c2959fae7ffa.jpg not downloaded yet
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_333f08044161da4d7e7ae4d984c20def.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_333f08044161da4d7e7ae4d984c20def.jpg not downloaded yet
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_aa50d9e9f984a40300b08df6e67eacbc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_aa50d9e9f984a40300b08df6e67eacbc.jpg not downloaded yet
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_6e0f4faa0b2390baa2847052b0991413.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_6e0f4faa0b2390baa2847052b0991413.jpg not downloaded yet
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_38f2d7c334b49adf598f08d6ace8788e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_38f2d7c334b49adf598f08d6ace8788e.jpg not downloaded yet
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_d9b3fc2163aef9886c16f4dc8810800d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_d9b3fc2163aef9886c16f4dc8810800d.jpg not downloaded yet
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_e2931a2670abb67a67a1d4c2d657e443.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_e2931a2670abb67a67a1d4c2d657e443.jpg not downloaded yet
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_c6df49af1914616c7241bc4b55234fca.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_c6df49af1914616c7241bc4b55234fca.jpg not downloaded yet
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_ab0d6745ecb43c35c9fdc0d3e99fa8a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_ab0d6745ecb43c35c9fdc0d3e99fa8a2.jpg not downloaded yet
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_cdbf83e92141e185c78c7f5ab5513dfe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_cdbf83e92141e185c78c7f5ab5513dfe.jpg not downloaded yet
2026-03-27 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_04512596f63d27016cdf6811f981552c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_88e1fc1eafb22be58577827be3e7e402.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_d74db13daac88618cae543ff92757681.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2d9dd0>
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_04512596f63d27016cdf6811f981552c.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_04512596f63d27016cdf6811f981552c.jpg saved to cache
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcf531ae-96c1-569c-a7c7-f12a6e59abd6
2026-03-27 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_cdbf83e92141e185c78c7f5ab5513dfe.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be03a790>
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_88e1fc1eafb22be58577827be3e7e402.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_88e1fc1eafb22be58577827be3e7e402.jpg saved to cache
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f
2026-03-27 10:36:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf59b7d0>
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_d74db13daac88618cae543ff92757681.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_d74db13daac88618cae543ff92757681.jpg saved to cache
2026-03-27 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcf531ae-96c1-569c-a7c7-f12a6e59abd6
2026-03-27 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF30572/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f2b50>
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_cdbf83e92141e185c78c7f5ab5513dfe.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_cdbf83e92141e185c78c7f5ab5513dfe.jpg saved to cache
2026-03-27 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cdbc69b1-0d6f-5425-9245-fc5fd47d23b5
2026-03-27 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_c6df49af1914616c7241bc4b55234fca.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_ab0d6745ecb43c35c9fdc0d3e99fa8a2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_d9b3fc2163aef9886c16f4dc8810800d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5fb1d0>
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_c6df49af1914616c7241bc4b55234fca.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_c6df49af1914616c7241bc4b55234fca.jpg saved to cache
2026-03-27 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cdbc69b1-0d6f-5425-9245-fc5fd47d23b5
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be263290>
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_ab0d6745ecb43c35c9fdc0d3e99fa8a2.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_ab0d6745ecb43c35c9fdc0d3e99fa8a2.jpg saved to cache
2026-03-27 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cdbc69b1-0d6f-5425-9245-fc5fd47d23b5
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be03ac10>
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_d9b3fc2163aef9886c16f4dc8810800d.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_d9b3fc2163aef9886c16f4dc8810800d.jpg saved to cache
2026-03-27 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cdbc69b1-0d6f-5425-9245-fc5fd47d23b5
2026-03-27 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_e2931a2670abb67a67a1d4c2d657e443.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_38f2d7c334b49adf598f08d6ace8788e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_6e0f4faa0b2390baa2847052b0991413.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3864d0>
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_e2931a2670abb67a67a1d4c2d657e443.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_e2931a2670abb67a67a1d4c2d657e443.jpg saved to cache
2026-03-27 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cdbc69b1-0d6f-5425-9245-fc5fd47d23b5
2026-03-27 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN23019/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be038b10>
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_38f2d7c334b49adf598f08d6ace8788e.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_38f2d7c334b49adf598f08d6ace8788e.jpg saved to cache
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cdbc69b1-0d6f-5425-9245-fc5fd47d23b5
2026-03-27 10:36:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf39d0d0>
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_6e0f4faa0b2390baa2847052b0991413.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_6e0f4faa0b2390baa2847052b0991413.jpg saved to cache
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cdbc69b1-0d6f-5425-9245-fc5fd47d23b5
2026-03-27 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK21596/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB85584> (referer: https://www.auto1.com/v1/car-details-view/XB85584/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_aa50d9e9f984a40300b08df6e67eacbc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_0f5044ad69ffd5fe036a24817e46a1b8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60ef623d-3a90-541b-8018-5c676ee4d2ce with identifier: XB85584
2026-03-27 10:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60ef623d-3a90-541b-8018-5c676ee4d2ce with scrape type 1
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 60ef623d-3a90-541b-8018-5c676ee4d2ce
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Faa%252F4aaa31466267c341cc0b78cefb64946a%252Fpa%252FXB85584_ab994a2823fce0c20ed8ae838f779fbb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_ab994a2823fce0c20ed8ae838f779fbb.jpg not downloaded yet
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Faa%252F4aaa31466267c341cc0b78cefb64946a%252Fpa%252FXB85584_885944252e015b4bf7da26a1dba1bf0b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_885944252e015b4bf7da26a1dba1bf0b.jpg not downloaded yet
2026-03-27 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YF78558> (referer: https://www.auto1.com/v1/car-details-view/YF78558/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Faa%252F4aaa31466267c341cc0b78cefb64946a%252Fpa%252FXB85584_32a4117993839bcd0261e331efb5e3f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_32a4117993839bcd0261e331efb5e3f0.jpg not downloaded yet
2026-03-27 10:36:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf81890>
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_aa50d9e9f984a40300b08df6e67eacbc.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_aa50d9e9f984a40300b08df6e67eacbc.jpg saved to cache
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cdbc69b1-0d6f-5425-9245-fc5fd47d23b5
2026-03-27 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_333f08044161da4d7e7ae4d984c20def.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Faa%252F4aaa31466267c341cc0b78cefb64946a%252Fpa%252FXB85584_515e255dfa8baab5227cc88c94c1ad0c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_515e255dfa8baab5227cc88c94c1ad0c.jpg not downloaded yet
2026-03-27 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_54f8feb63a55fdb65e4531e3b7415fb1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2ec690>
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_0f5044ad69ffd5fe036a24817e46a1b8.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_0f5044ad69ffd5fe036a24817e46a1b8.jpg saved to cache
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cdbc69b1-0d6f-5425-9245-fc5fd47d23b5
2026-03-27 10:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 209a5d1e-9028-5d3b-b29a-2381b4e0f067 with identifier: YF78558
2026-03-27 10:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 209a5d1e-9028-5d3b-b29a-2381b4e0f067 with scrape type 1
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 209a5d1e-9028-5d3b-b29a-2381b4e0f067
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_7a3e1a0cbee63dc8020ce2d94a1eac4f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_7a3e1a0cbee63dc8020ce2d94a1eac4f.jpg not downloaded yet
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Faa%252F4aaa31466267c341cc0b78cefb64946a%252Fpa%252FXB85584_ae26983206bf0f700edb1c1911f21156.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_ae26983206bf0f700edb1c1911f21156.jpg not downloaded yet
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_6a63098f8096f0931e1ce32a3c7a682a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_6a63098f8096f0931e1ce32a3c7a682a.jpg not downloaded yet
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Faa%252F4aaa31466267c341cc0b78cefb64946a%252Fpa%252FXB85584_39edb45faaedcf053678c5af9cdadaa6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_39edb45faaedcf053678c5af9cdadaa6.jpg not downloaded yet
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_ebe008a020aa8c44aa31673684cc2e9c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_ebe008a020aa8c44aa31673684cc2e9c.jpg not downloaded yet
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1d52d0>
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_333f08044161da4d7e7ae4d984c20def.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_333f08044161da4d7e7ae4d984c20def.jpg saved to cache
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f
2026-03-27 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_ab994a2823fce0c20ed8ae838f779fbb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_011772705b8836b73d78a4f4abbe9c2e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_011772705b8836b73d78a4f4abbe9c2e.jpg not downloaded yet
2026-03-27 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_32a4117993839bcd0261e331efb5e3f0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf82a10>
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_54f8feb63a55fdb65e4531e3b7415fb1.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_54f8feb63a55fdb65e4531e3b7415fb1.jpg saved to cache
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_88eadba455cb306a471d70789cb5a245.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_88eadba455cb306a471d70789cb5a245.jpg not downloaded yet
2026-03-27 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_885944252e015b4bf7da26a1dba1bf0b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_a46f519c07f1fd5a604a4f1ba71cd8d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_a46f519c07f1fd5a604a4f1ba71cd8d4.jpg not downloaded yet
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf541d90>
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ef623d-3a90-541b-8018-5c676ee4d2ce/60ef623d-3a90-541b-8018-5c676ee4d2ce_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Faa%252F4aaa31466267c341cc0b78cefb64946a%252Fpa%252FXB85584_ab994a2823fce0c20ed8ae838f779fbb.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_ab994a2823fce0c20ed8ae838f779fbb.jpg saved to cache
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60ef623d-3a90-541b-8018-5c676ee4d2ce
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_a2c0f74d56f3a4d71219437de6ebe4fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_a2c0f74d56f3a4d71219437de6ebe4fe.jpg not downloaded yet
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3ee690>
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ef623d-3a90-541b-8018-5c676ee4d2ce/60ef623d-3a90-541b-8018-5c676ee4d2ce_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Faa%252F4aaa31466267c341cc0b78cefb64946a%252Fpa%252FXB85584_32a4117993839bcd0261e331efb5e3f0.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_32a4117993839bcd0261e331efb5e3f0.jpg saved to cache
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60ef623d-3a90-541b-8018-5c676ee4d2ce
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_653acdc32640fa7c90e1b13871187378.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_653acdc32640fa7c90e1b13871187378.jpg not downloaded yet
2026-03-27 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_39edb45faaedcf053678c5af9cdadaa6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_cbdc7b29bce4e7dee8a9cb66918f6338.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_cbdc7b29bce4e7dee8a9cb66918f6338.jpg not downloaded yet
2026-03-27 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf31a590>
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ef623d-3a90-541b-8018-5c676ee4d2ce/60ef623d-3a90-541b-8018-5c676ee4d2ce_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Faa%252F4aaa31466267c341cc0b78cefb64946a%252Fpa%252FXB85584_885944252e015b4bf7da26a1dba1bf0b.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_885944252e015b4bf7da26a1dba1bf0b.jpg saved to cache
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60ef623d-3a90-541b-8018-5c676ee4d2ce
2026-03-27 10:36:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_6066673dfcd8be593162062ea1d0b195.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_6066673dfcd8be593162062ea1d0b195.jpg not downloaded yet
2026-03-27 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_8881134a6e46dfbdce22c2959fae7ffa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_6768974e4cff9d5f5ed08b60adf23411.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2d9ad0>
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ef623d-3a90-541b-8018-5c676ee4d2ce/60ef623d-3a90-541b-8018-5c676ee4d2ce_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Faa%252F4aaa31466267c341cc0b78cefb64946a%252Fpa%252FXB85584_39edb45faaedcf053678c5af9cdadaa6.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_39edb45faaedcf053678c5af9cdadaa6.jpg saved to cache
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60ef623d-3a90-541b-8018-5c676ee4d2ce
2026-03-27 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_88eadba455cb306a471d70789cb5a245.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_ebe008a020aa8c44aa31673684cc2e9c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_51ede349574740c65a7b596446615824.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:51 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 10500 | hits on page: 40
2026-03-27 10:36:51 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK39912%27 HTTP/1.1" 200 None
2026-03-27 10:36:51 [auto1.de] INFO: Scrape type for ZK39912: 0
2026-03-27 10:36:51 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-27 10:36:51 [auto1.de] INFO: Found listing with ID: JU74172
2026-03-27 10:36:51 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-27 10:36:51 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-27 10:36:51 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-27 10:36:51 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-27 10:36:51 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-27 10:36:51 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-27 10:36:51 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD89889%27 HTTP/1.1" 200 None
2026-03-27 10:36:51 [auto1.de] INFO: Scrape type for DD89889: 2
2026-03-27 10:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08ed6afe-0712-5583-a823-4a52200bdc65 with identifier: DD89889
2026-03-27 10:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ed6afe-0712-5583-a823-4a52200bdc65 with scrape type 2
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08ed6afe-0712-5583-a823-4a52200bdc65 with scrape type 2
2026-03-27 10:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08ed6afe-0712-5583-a823-4a52200bdc65, identifier: DD89889
2026-03-27 10:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08ed6afe-0712-5583-a823-4a52200bdc65 with identifier: DD89889
2026-03-27 10:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08ed6afe-0712-5583-a823-4a52200bdc65 with identifier: DD89889
2026-03-27 10:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08ed6afe-0712-5583-a823-4a52200bdc65 with identifier: DD89889 to the API
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:47:04Z',
'fuel_type': 'diesel',
'id': '08ed6afe-0712-5583-a823-4a52200bdc65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD89889',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 130421,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-04',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 250 d lang BlueTEC Edition',
'transmission': 'automatic',
'trim': 'lang BlueTEC Edition',
'year': 2018}
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD89889%27 HTTP/1.1" 200 None
2026-03-27 10:36:51 [auto1.de] INFO: Saving data for DD89889: {'auction_closing_time': 1774716424.0, 'created_time': 1773428106.334032, 'last_price_update_time': 1774607811.845898}
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD89889') HTTP/1.1" 204 0
2026-03-27 10:36:51 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK47054%27 HTTP/1.1" 200 None
2026-03-27 10:36:52 [auto1.de] INFO: Scrape type for TK47054: 2
2026-03-27 10:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85f890be-beaa-5096-8c2e-ed046630c7f4 with identifier: TK47054
2026-03-27 10:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85f890be-beaa-5096-8c2e-ed046630c7f4 with scrape type 2
2026-03-27 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85f890be-beaa-5096-8c2e-ed046630c7f4 with scrape type 2
2026-03-27 10:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85f890be-beaa-5096-8c2e-ed046630c7f4, identifier: TK47054
2026-03-27 10:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_cbdc7b29bce4e7dee8a9cb66918f6338.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85f890be-beaa-5096-8c2e-ed046630c7f4 with identifier: TK47054
2026-03-27 10:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85f890be-beaa-5096-8c2e-ed046630c7f4 with identifier: TK47054
2026-03-27 10:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85f890be-beaa-5096-8c2e-ed046630c7f4 with identifier: TK47054 to the API
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 557,
'expiration_date': '2026-03-28T16:02:15Z',
'fuel_type': 'petrol',
'id': '85f890be-beaa-5096-8c2e-ed046630c7f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK47054',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 186704,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-04',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 63 AMG 4Matic Avantgarde',
'transmission': 'automatic',
'trim': '4Matic Avantgarde',
'year': 2015}
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK47054%27 HTTP/1.1" 200 None
2026-03-27 10:36:52 [auto1.de] INFO: Saving data for TK47054: {'auction_closing_time': 1774713735.0, 'created_time': 1773776264.054683, 'last_price_update_time': 1774607812.577208}
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK47054') HTTP/1.1" 204 0
2026-03-27 10:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG44420> (referer: https://www.auto1.com/v1/car-details-view/AG44420/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2f8490>
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77973c93862a969a3c6e0168c77f5b8c%252Fpa%252FLL66179_8881134a6e46dfbdce22c2959fae7ffa.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_8881134a6e46dfbdce22c2959fae7ffa.jpg saved to cache
2026-03-27 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cdbc69b1-0d6f-5425-9245-fc5fd47d23b5
2026-03-27 10:36:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdbc69b1-0d6f-5425-9245-fc5fd47d23b5, skipping ID generation
2026-03-27 10:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdbc69b1-0d6f-5425-9245-fc5fd47d23b5 with scrape type 1
2026-03-27 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cdbc69b1-0d6f-5425-9245-fc5fd47d23b5 sending to next pipeline
2026-03-27 10:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdbc69b1-0d6f-5425-9245-fc5fd47d23b5, identifier: LL66179
2026-03-27 10:36:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf80e10>
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_6768974e4cff9d5f5ed08b60adf23411.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_6768974e4cff9d5f5ed08b60adf23411.jpg saved to cache
2026-03-27 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf37c110>
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_88eadba455cb306a471d70789cb5a245.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_88eadba455cb306a471d70789cb5a245.jpg saved to cache
2026-03-27 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 209a5d1e-9028-5d3b-b29a-2381b4e0f067
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf51f6d0>
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_ebe008a020aa8c44aa31673684cc2e9c.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_ebe008a020aa8c44aa31673684cc2e9c.jpg saved to cache
2026-03-27 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 209a5d1e-9028-5d3b-b29a-2381b4e0f067
2026-03-27 10:36:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3ac650>
2026-03-27 10:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_51ede349574740c65a7b596446615824.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_51ede349574740c65a7b596446615824.jpg saved to cache
2026-03-27 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f
2026-03-27 10:36:53 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-27 10:36:53 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-27 10:36:53 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ75768%27 HTTP/1.1" 200 None
2026-03-27 10:36:53 [auto1.de] INFO: Scrape type for LJ75768: 0
2026-03-27 10:36:53 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-27 10:36:53 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL59385%27 HTTP/1.1" 200 None
2026-03-27 10:36:53 [auto1.de] INFO: Scrape type for GL59385: 2
2026-03-27 10:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e074518-5d14-54b4-b821-d65b44f668a9 with identifier: GL59385
2026-03-27 10:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e074518-5d14-54b4-b821-d65b44f668a9 with scrape type 2
2026-03-27 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e074518-5d14-54b4-b821-d65b44f668a9 with scrape type 2
2026-03-27 10:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e074518-5d14-54b4-b821-d65b44f668a9, identifier: GL59385
2026-03-27 10:36:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdbc69b1-0d6f-5425-9245-fc5fd47d23b5 with identifier: LL66179
2026-03-27 10:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdbc69b1-0d6f-5425-9245-fc5fd47d23b5 with identifier: LL66179
2026-03-27 10:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdbc69b1-0d6f-5425-9245-fc5fd47d23b5 with identifier: LL66179 to the API
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_8881134a6e46dfbdce22c2959fae7ffa.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:17:22Z',
'fuel_type': 'diesel',
'id': 'cdbc69b1-0d6f-5425-9245-fc5fd47d23b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL66179',
'listing': 'auction',
'location': 'DE, Zweibrücken',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 248756,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_0f5044ad69ffd5fe036a24817e46a1b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2828912,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_8881134a6e46dfbdce22c2959fae7ffa.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2745239,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_aa50d9e9f984a40300b08df6e67eacbc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2742800,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_6e0f4faa0b2390baa2847052b0991413.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2543351,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_38f2d7c334b49adf598f08d6ace8788e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_d9b3fc2163aef9886c16f4dc8810800d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2643922,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_e2931a2670abb67a67a1d4c2d657e443.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2901063,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_c6df49af1914616c7241bc4b55234fca.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79604,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_ab0d6745ecb43c35c9fdc0d3e99fa8a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbc69b1-0d6f-5425-9245-fc5fd47d23b5/cdbc69b1-0d6f-5425-9245-fc5fd47d23b5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76248,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/97/77973c93862a969a3c6e0168c77f5b8c/pa/LL66179_cdbf83e92141e185c78c7f5ab5513dfe.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL66179%27 HTTP/1.1" 200 None
2026-03-27 10:36:53 [auto1.de] INFO: Saving data for LL66179: {'created_time': 1774607813.682539, 'last_price_update_time': 1774607813.682549, 'auction_closing_time': 1774714642.0}
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL66179') HTTP/1.1" 204 0
2026-03-27 10:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e074518-5d14-54b4-b821-d65b44f668a9 with identifier: GL59385
2026-03-27 10:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e074518-5d14-54b4-b821-d65b44f668a9 with identifier: GL59385
2026-03-27 10:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e074518-5d14-54b4-b821-d65b44f668a9 with identifier: GL59385 to the API
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:03:11Z',
'fuel_type': 'petrol',
'id': '8e074518-5d14-54b4-b821-d65b44f668a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL59385',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 106564,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-21',
'seller_name': None,
'title': 'Peugeot 207 1.4 VTi Urban Move',
'transmission': 'manual',
'trim': 'Urban Move',
'year': 2009}
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL59385%27 HTTP/1.1" 200 None
2026-03-27 10:36:54 [auto1.de] INFO: Saving data for GL59385: {'auction_closing_time': 1774713791.0, 'created_time': 1773340756.345513, 'last_price_update_time': 1774607814.336434}
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL59385') HTTP/1.1" 204 0
2026-03-27 10:36:54 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-27 10:36:54 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-27 10:36:54 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX48260%27 HTTP/1.1" 200 None
2026-03-27 10:36:54 [auto1.de] INFO: Scrape type for TX48260: 2
2026-03-27 10:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87f618ff-196d-5724-85d8-948e6e3a204d with identifier: TX48260
2026-03-27 10:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87f618ff-196d-5724-85d8-948e6e3a204d with scrape type 2
2026-03-27 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87f618ff-196d-5724-85d8-948e6e3a204d with scrape type 2
2026-03-27 10:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87f618ff-196d-5724-85d8-948e6e3a204d, identifier: TX48260
2026-03-27 10:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87f618ff-196d-5724-85d8-948e6e3a204d with identifier: TX48260
2026-03-27 10:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87f618ff-196d-5724-85d8-948e6e3a204d with identifier: TX48260
2026-03-27 10:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87f618ff-196d-5724-85d8-948e6e3a204d with identifier: TX48260 to the API
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:26:34Z',
'fuel_type': 'petrol',
'id': '87f618ff-196d-5724-85d8-948e6e3a204d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX48260',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 93317,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-11-30',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Tour',
'transmission': 'manual',
'trim': 'Tour',
'year': 2007}
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX48260%27 HTTP/1.1" 200 None
2026-03-27 10:36:54 [auto1.de] INFO: Saving data for TX48260: {'auction_closing_time': 1774715194.0, 'created_time': 1773775665.179603, 'last_price_update_time': 1774607814.786406}
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX48260') HTTP/1.1" 204 0
2026-03-27 10:36:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf32d890>
2026-03-27 10:36:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_cbdc7b29bce4e7dee8a9cb66918f6338.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_cbdc7b29bce4e7dee8a9cb66918f6338.jpg saved to cache
2026-03-27 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 209a5d1e-9028-5d3b-b29a-2381b4e0f067
2026-03-27 10:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0730e37a-33a2-5940-a0cc-76627c551249 with identifier: AG44420
2026-03-27 10:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0730e37a-33a2-5940-a0cc-76627c551249 with scrape type 1
2026-03-27 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0730e37a-33a2-5940-a0cc-76627c551249
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_f4dd7b7da9ff2e442e47937628d94ab4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_f4dd7b7da9ff2e442e47937628d94ab4.jpg not downloaded yet
2026-03-27 10:36:54 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-27 10:36:54 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS47503%27 HTTP/1.1" 200 None
2026-03-27 10:36:54 [auto1.de] INFO: Scrape type for NS47503: 2
2026-03-27 10:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a with identifier: NS47503
2026-03-27 10:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a with scrape type 2
2026-03-27 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a with scrape type 2
2026-03-27 10:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a, identifier: NS47503
2026-03-27 10:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a with identifier: NS47503
2026-03-27 10:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a with identifier: NS47503
2026-03-27 10:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b89ff2f-91d0-5d9b-a384-66cb3c07d38a with identifier: NS47503 to the API
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 218,
'expiration_date': '2026-03-28T16:18:00Z',
'fuel_type': 'diesel',
'id': '6b89ff2f-91d0-5d9b-a384-66cb3c07d38a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS47503',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 256494,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-25',
'seller_name': None,
'title': 'BMW 5er 525d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS47503%27 HTTP/1.1" 200 None
2026-03-27 10:36:55 [auto1.de] INFO: Saving data for NS47503: {'auction_closing_time': 1774714680.0, 'created_time': 1773306347.091123, 'last_price_update_time': 1774607815.301093}
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS47503') HTTP/1.1" 204 0
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_a91df2cb97df1010122c8be3c1f80661.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_a91df2cb97df1010122c8be3c1f80661.jpg not downloaded yet
2026-03-27 10:36:55 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-27 10:36:55 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF62684%27 HTTP/1.1" 200 None
2026-03-27 10:36:55 [auto1.de] INFO: Scrape type for FF62684: 2
2026-03-27 10:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 215e824f-a442-5a7a-b2ec-75faf13aca6f with identifier: FF62684
2026-03-27 10:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 215e824f-a442-5a7a-b2ec-75faf13aca6f with scrape type 2
2026-03-27 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 215e824f-a442-5a7a-b2ec-75faf13aca6f with scrape type 2
2026-03-27 10:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 215e824f-a442-5a7a-b2ec-75faf13aca6f, identifier: FF62684
2026-03-27 10:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_011772705b8836b73d78a4f4abbe9c2e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 215e824f-a442-5a7a-b2ec-75faf13aca6f with identifier: FF62684
2026-03-27 10:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 215e824f-a442-5a7a-b2ec-75faf13aca6f with identifier: FF62684
2026-03-27 10:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 215e824f-a442-5a7a-b2ec-75faf13aca6f with identifier: FF62684 to the API
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:10:44Z',
'fuel_type': 'petrol',
'id': '215e824f-a442-5a7a-b2ec-75faf13aca6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF62684',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 103952,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-27',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Beats',
'transmission': 'manual',
'trim': 'Beats',
'year': 2016}
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF62684%27 HTTP/1.1" 200 None
2026-03-27 10:36:55 [auto1.de] INFO: Saving data for FF62684: {'auction_closing_time': 1774714244.0, 'created_time': 1773859767.788987, 'last_price_update_time': 1774607815.880002}
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF62684') HTTP/1.1" 204 0
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_03b9bcea7743d1c8223f65f885d66340.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_03b9bcea7743d1c8223f65f885d66340.jpg not downloaded yet
2026-03-27 10:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_6a63098f8096f0931e1ce32a3c7a682a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_ae26983206bf0f700edb1c1911f21156.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:55 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-27 10:36:55 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-27 10:36:55 [auto1.de] INFO: Found listing with ID: KU06936
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU06936%27 HTTP/1.1" 200 None
2026-03-27 10:36:55 [auto1.de] INFO: Scrape type for KU06936: 2
2026-03-27 10:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01e0ff56-806a-53e8-9e67-fdf22c61f278 with identifier: KU06936
2026-03-27 10:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01e0ff56-806a-53e8-9e67-fdf22c61f278 with scrape type 2
2026-03-27 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01e0ff56-806a-53e8-9e67-fdf22c61f278 with scrape type 2
2026-03-27 10:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01e0ff56-806a-53e8-9e67-fdf22c61f278, identifier: KU06936
2026-03-27 10:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01e0ff56-806a-53e8-9e67-fdf22c61f278 with identifier: KU06936
2026-03-27 10:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01e0ff56-806a-53e8-9e67-fdf22c61f278 with identifier: KU06936
2026-03-27 10:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01e0ff56-806a-53e8-9e67-fdf22c61f278 with identifier: KU06936 to the API
2026-03-27 10:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:05:54Z',
'fuel_type': 'diesel',
'id': '01e0ff56-806a-53e8-9e67-fdf22c61f278',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU06936',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 179124,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-29',
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI Edition Start/Stop',
'transmission': 'automatic',
'trim': 'Edition Start/Stop',
'year': 2019}
2026-03-27 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU06936%27 HTTP/1.1" 200 None
2026-03-27 10:36:56 [auto1.de] INFO: Saving data for KU06936: {'auction_closing_time': 1774713954.0, 'created_time': 1774291849.674869, 'last_price_update_time': 1774607816.38849}
2026-03-27 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU06936') HTTP/1.1" 204 0
2026-03-27 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_668522e08231a8a38030ede285f16680.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_668522e08231a8a38030ede285f16680.jpg not downloaded yet
2026-03-27 10:36:56 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-27 10:36:56 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-27 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS47170%27 HTTP/1.1" 200 None
2026-03-27 10:36:56 [auto1.de] INFO: Scrape type for PS47170: 2
2026-03-27 10:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b19f91f-080b-5ab6-9076-724827ca0d6f with identifier: PS47170
2026-03-27 10:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b19f91f-080b-5ab6-9076-724827ca0d6f with scrape type 2
2026-03-27 10:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b19f91f-080b-5ab6-9076-724827ca0d6f with scrape type 2
2026-03-27 10:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b19f91f-080b-5ab6-9076-724827ca0d6f, identifier: PS47170
2026-03-27 10:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF30572> (referer: https://www.auto1.com/v1/car-details-view/DF30572/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b19f91f-080b-5ab6-9076-724827ca0d6f with identifier: PS47170
2026-03-27 10:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b19f91f-080b-5ab6-9076-724827ca0d6f with identifier: PS47170
2026-03-27 10:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b19f91f-080b-5ab6-9076-724827ca0d6f with identifier: PS47170 to the API
2026-03-27 10:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-28T16:42:47Z',
'fuel_type': 'petrol',
'id': '1b19f91f-080b-5ab6-9076-724827ca0d6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS47170',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 167989,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-01',
'seller_name': None,
'title': 'Citroen C3 1.2 VTi Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2014}
2026-03-27 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS47170%27 HTTP/1.1" 200 None
2026-03-27 10:36:56 [auto1.de] INFO: Saving data for PS47170: {'auction_closing_time': 1774716167.0, 'created_time': 1773426834.292713, 'last_price_update_time': 1774607816.968012}
2026-03-27 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS47170') HTTP/1.1" 204 0
2026-03-27 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_cc513e101f21cc75bce939c05ebd0f6c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_cc513e101f21cc75bce939c05ebd0f6c.jpg not downloaded yet
2026-03-27 10:36:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf59ac90>
2026-03-27 10:36:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_011772705b8836b73d78a4f4abbe9c2e.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_011772705b8836b73d78a4f4abbe9c2e.jpg saved to cache
2026-03-27 10:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 209a5d1e-9028-5d3b-b29a-2381b4e0f067
2026-03-27 10:36:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1d5190>
2026-03-27 10:36:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_6a63098f8096f0931e1ce32a3c7a682a.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_6a63098f8096f0931e1ce32a3c7a682a.jpg saved to cache
2026-03-27 10:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 209a5d1e-9028-5d3b-b29a-2381b4e0f067
2026-03-27 10:36:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be23ec10>
2026-03-27 10:36:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ef623d-3a90-541b-8018-5c676ee4d2ce/60ef623d-3a90-541b-8018-5c676ee4d2ce_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Faa%252F4aaa31466267c341cc0b78cefb64946a%252Fpa%252FXB85584_ae26983206bf0f700edb1c1911f21156.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_ae26983206bf0f700edb1c1911f21156.jpg saved to cache
2026-03-27 10:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60ef623d-3a90-541b-8018-5c676ee4d2ce
2026-03-27 10:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_a91df2cb97df1010122c8be3c1f80661.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:57 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM87247%27 HTTP/1.1" 200 None
2026-03-27 10:36:57 [auto1.de] INFO: Scrape type for KM87247: 2
2026-03-27 10:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15aa9a06-e694-58a4-a7c0-309cbe26e86f with identifier: KM87247
2026-03-27 10:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15aa9a06-e694-58a4-a7c0-309cbe26e86f with scrape type 2
2026-03-27 10:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15aa9a06-e694-58a4-a7c0-309cbe26e86f with scrape type 2
2026-03-27 10:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15aa9a06-e694-58a4-a7c0-309cbe26e86f, identifier: KM87247
2026-03-27 10:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ37067> (referer: https://www.auto1.com/v1/car-details-view/UZ37067/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_7a3e1a0cbee63dc8020ce2d94a1eac4f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_f4dd7b7da9ff2e442e47937628d94ab4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15aa9a06-e694-58a4-a7c0-309cbe26e86f with identifier: KM87247
2026-03-27 10:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15aa9a06-e694-58a4-a7c0-309cbe26e86f with identifier: KM87247
2026-03-27 10:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15aa9a06-e694-58a4-a7c0-309cbe26e86f with identifier: KM87247 to the API
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:49:17Z',
'fuel_type': 'diesel',
'id': '15aa9a06-e694-58a4-a7c0-309cbe26e86f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM87247',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 85106,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-15',
'seller_name': None,
'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2018}
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM87247%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [auto1.de] INFO: Saving data for KM87247: {'auction_closing_time': 1774716557.0, 'created_time': 1774330259.104166, 'last_price_update_time': 1774607818.306799}
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM87247') HTTP/1.1" 204 0
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_4374a44a1c914485a737b5398714d99a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_4374a44a1c914485a737b5398714d99a.jpg not downloaded yet
2026-03-27 10:36:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:58 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-27 10:36:58 [auto1.de] INFO: Found listing with ID: NN29334
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN29334%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [auto1.de] INFO: Scrape type for NN29334: 2
2026-03-27 10:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7543008b-9019-5f5c-96b2-13aaa0953c8b with identifier: NN29334
2026-03-27 10:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7543008b-9019-5f5c-96b2-13aaa0953c8b with scrape type 2
2026-03-27 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7543008b-9019-5f5c-96b2-13aaa0953c8b with scrape type 2
2026-03-27 10:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7543008b-9019-5f5c-96b2-13aaa0953c8b, identifier: NN29334
2026-03-27 10:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dd48c03-6923-57f2-a307-4afd38fb7625 with identifier: DF30572
2026-03-27 10:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dd48c03-6923-57f2-a307-4afd38fb7625 with scrape type 1
2026-03-27 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7dd48c03-6923-57f2-a307-4afd38fb7625
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb1%252F35b172bf0557a73cca13ef89a492ce52%252Fpa%252FDF30572_210898a3560cf609f7ab75ba2972a4f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_210898a3560cf609f7ab75ba2972a4f2.jpg already downloaded
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb1%252F35b172bf0557a73cca13ef89a492ce52%252Fpa%252FDF30572_49e0fbf3ff9a2951fef038cfad4945a8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_49e0fbf3ff9a2951fef038cfad4945a8.jpg already downloaded
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb1%252F35b172bf0557a73cca13ef89a492ce52%252Fpa%252FDF30572_5932718034360c2b12ee1e42afec0023.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_5932718034360c2b12ee1e42afec0023.jpg already downloaded
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb1%252F35b172bf0557a73cca13ef89a492ce52%252Fpa%252FDF30572_dbc4de7dbf40d346a10f005dd869f3e4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_dbc4de7dbf40d346a10f005dd869f3e4.jpg already downloaded
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb1%252F35b172bf0557a73cca13ef89a492ce52%252Fpa%252FDF30572_f058777dac2ed78a8b57da3e22e9a5fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_f058777dac2ed78a8b57da3e22e9a5fa.jpg already downloaded
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb1%252F35b172bf0557a73cca13ef89a492ce52%252Fpa%252FDF30572_854129d2cc25f8fffbf2376abe0a0396.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_854129d2cc25f8fffbf2376abe0a0396.jpg already downloaded
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb1%252F35b172bf0557a73cca13ef89a492ce52%252Fpa%252FDF30572_c39da1b488b99e52348e633fff780576.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_c39da1b488b99e52348e633fff780576.jpg already downloaded
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb1%252F35b172bf0557a73cca13ef89a492ce52%252Fpa%252FDF30572_6846c0e442b92062b0e0a0622d01b443.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_6846c0e442b92062b0e0a0622d01b443.jpg already downloaded
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb1%252F35b172bf0557a73cca13ef89a492ce52%252Fpa%252FDF30572_3ac9f3dd5c3e3283545dabe0c0176458.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_3ac9f3dd5c3e3283545dabe0c0176458.jpg already downloaded
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb1%252F35b172bf0557a73cca13ef89a492ce52%252Fpa%252FDF30572_56f9fe2936fc644738c4ae983f9c834b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_56f9fe2936fc644738c4ae983f9c834b.jpg already downloaded
2026-03-27 10:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7dd48c03-6923-57f2-a307-4afd38fb7625, identifier: DF30572
2026-03-27 10:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_668522e08231a8a38030ede285f16680.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7543008b-9019-5f5c-96b2-13aaa0953c8b with identifier: NN29334
2026-03-27 10:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7543008b-9019-5f5c-96b2-13aaa0953c8b with identifier: NN29334
2026-03-27 10:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7543008b-9019-5f5c-96b2-13aaa0953c8b with identifier: NN29334 to the API
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:21:35Z',
'fuel_type': 'petrol',
'id': '7543008b-9019-5f5c-96b2-13aaa0953c8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN29334',
'listing': 'auction',
'make': 'Kia',
'model': 'Venga',
'odometer': 60396,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-10',
'seller_name': None,
'title': 'Kia Venga 1.6 UEFA Euro 2016',
'transmission': 'automatic',
'trim': 'UEFA Euro 2016',
'year': 2016}
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN29334%27 HTTP/1.1" 200 None
2026-03-27 10:36:59 [auto1.de] INFO: Saving data for NN29334: {'auction_closing_time': 1774714895.0, 'created_time': 1774293442.199332, 'last_price_update_time': 1774607819.117025}
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN29334') HTTP/1.1" 204 0
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_5f7ceb9483a77eedc7a1ec37fad53997.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_5f7ceb9483a77eedc7a1ec37fad53997.jpg not downloaded yet
2026-03-27 10:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7dd48c03-6923-57f2-a307-4afd38fb7625 with identifier: DF30572
2026-03-27 10:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7dd48c03-6923-57f2-a307-4afd38fb7625 with identifier: DF30572
2026-03-27 10:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7dd48c03-6923-57f2-a307-4afd38fb7625 with identifier: DF30572 to the API
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DF30572>
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:48:02Z',
'fuel_type': 'petrol',
'id': '7dd48c03-6923-57f2-a307-4afd38fb7625',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF30572',
'listing': 'auction',
'location': 'DE, Lüdersfeld',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 79824,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_210898a3560cf609f7ab75ba2972a4f2.jpg',
'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_49e0fbf3ff9a2951fef038cfad4945a8.jpg',
'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_5932718034360c2b12ee1e42afec0023.jpg',
'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_dbc4de7dbf40d346a10f005dd869f3e4.jpg',
'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_f058777dac2ed78a8b57da3e22e9a5fa.jpg',
'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_854129d2cc25f8fffbf2376abe0a0396.jpg',
'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_c39da1b488b99e52348e633fff780576.jpg',
'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_6846c0e442b92062b0e0a0622d01b443.jpg',
'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_3ac9f3dd5c3e3283545dabe0c0176458.jpg',
'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_56f9fe2936fc644738c4ae983f9c834b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dd48c03-6923-57f2-a307-4afd38fb7625/7dd48c03-6923-57f2-a307-4afd38fb7625_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2149959,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_210898a3560cf609f7ab75ba2972a4f2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dd48c03-6923-57f2-a307-4afd38fb7625/7dd48c03-6923-57f2-a307-4afd38fb7625_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2140800,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_49e0fbf3ff9a2951fef038cfad4945a8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dd48c03-6923-57f2-a307-4afd38fb7625/7dd48c03-6923-57f2-a307-4afd38fb7625_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51640,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_5932718034360c2b12ee1e42afec0023.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dd48c03-6923-57f2-a307-4afd38fb7625/7dd48c03-6923-57f2-a307-4afd38fb7625_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2028938,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_dbc4de7dbf40d346a10f005dd869f3e4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dd48c03-6923-57f2-a307-4afd38fb7625/7dd48c03-6923-57f2-a307-4afd38fb7625_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2196775,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_f058777dac2ed78a8b57da3e22e9a5fa.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dd48c03-6923-57f2-a307-4afd38fb7625/7dd48c03-6923-57f2-a307-4afd38fb7625_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45851,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_854129d2cc25f8fffbf2376abe0a0396.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dd48c03-6923-57f2-a307-4afd38fb7625/7dd48c03-6923-57f2-a307-4afd38fb7625_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_c39da1b488b99e52348e633fff780576.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dd48c03-6923-57f2-a307-4afd38fb7625/7dd48c03-6923-57f2-a307-4afd38fb7625_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2172896,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_6846c0e442b92062b0e0a0622d01b443.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dd48c03-6923-57f2-a307-4afd38fb7625/7dd48c03-6923-57f2-a307-4afd38fb7625_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_3ac9f3dd5c3e3283545dabe0c0176458.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dd48c03-6923-57f2-a307-4afd38fb7625/7dd48c03-6923-57f2-a307-4afd38fb7625_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42963,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/b1/35b172bf0557a73cca13ef89a492ce52/pa/DF30572_56f9fe2936fc644738c4ae983f9c834b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-02-11',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Lounge BlueMotion Tech',
'transmission': 'manual',
'trim': 'Lounge BlueMotion Tech',
'year': 2016}
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF30572%27 HTTP/1.1" 200 None
2026-03-27 10:36:59 [auto1.de] INFO: Saving data for DF30572: {'created_time': 1774607819.527943, 'last_price_update_time': 1774607819.527958, 'auction_closing_time': 1774716482.0}
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF30572') HTTP/1.1" 204 0
2026-03-27 10:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_03b9bcea7743d1c8223f65f885d66340.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:59 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-27 10:36:59 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-27 10:36:59 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV39961%27 HTTP/1.1" 200 None
2026-03-27 10:36:59 [auto1.de] INFO: Scrape type for EV39961: 2
2026-03-27 10:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35dd651d-25d2-52be-913b-63460085253b with identifier: EV39961
2026-03-27 10:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35dd651d-25d2-52be-913b-63460085253b with scrape type 2
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35dd651d-25d2-52be-913b-63460085253b with scrape type 2
2026-03-27 10:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 35dd651d-25d2-52be-913b-63460085253b, identifier: EV39961
2026-03-27 10:36:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0117d0>
2026-03-27 10:36:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_a91df2cb97df1010122c8be3c1f80661.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_a91df2cb97df1010122c8be3c1f80661.jpg saved to cache
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0730e37a-33a2-5940-a0cc-76627c551249
2026-03-27 10:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a5f763b-223d-5001-b5e9-af1e69743b56 with identifier: UZ37067
2026-03-27 10:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a5f763b-223d-5001-b5e9-af1e69743b56 with scrape type 1
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a5f763b-223d-5001-b5e9-af1e69743b56
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F60%252Fc760c87307cd780cf09d44857a33c053%252Fpa%252FUZ37067_6f3466dc8e11ffd6ab03e7df3b5960b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_6f3466dc8e11ffd6ab03e7df3b5960b3.jpg already downloaded
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F60%252Fc760c87307cd780cf09d44857a33c053%252Fpa%252FUZ37067_1aa9f76fd30d1c97d696fbaa736e2935.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_1aa9f76fd30d1c97d696fbaa736e2935.jpg already downloaded
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F60%252Fc760c87307cd780cf09d44857a33c053%252Fpa%252FUZ37067_3f29fdd094de012b5b7275badab403c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_3f29fdd094de012b5b7275badab403c2.jpg already downloaded
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F60%252Fc760c87307cd780cf09d44857a33c053%252Fpa%252FUZ37067_8237e11379a239a026af583eb544e682.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_8237e11379a239a026af583eb544e682.jpg already downloaded
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F60%252Fc760c87307cd780cf09d44857a33c053%252Fpa%252FUZ37067_0859e6a0ede8c0a0424e7ab903ddfc50.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_0859e6a0ede8c0a0424e7ab903ddfc50.jpg already downloaded
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F60%252Fc760c87307cd780cf09d44857a33c053%252Fpa%252FUZ37067_629a873b661ee595ed9b7aefe26cd9b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_629a873b661ee595ed9b7aefe26cd9b0.jpg already downloaded
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F60%252Fc760c87307cd780cf09d44857a33c053%252Fpa%252FUZ37067_4ae6c8eb014c4cccc559bc099fc76837.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_4ae6c8eb014c4cccc559bc099fc76837.jpg already downloaded
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F60%252Fc760c87307cd780cf09d44857a33c053%252Fpa%252FUZ37067_65475a045cb0ee2ddabe619821f5d7a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_65475a045cb0ee2ddabe619821f5d7a6.jpg already downloaded
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F60%252Fc760c87307cd780cf09d44857a33c053%252Fpa%252FUZ37067_8482c88de5ab0b54263791e25e8be24a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_8482c88de5ab0b54263791e25e8be24a.jpg already downloaded
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F60%252Fc760c87307cd780cf09d44857a33c053%252Fpa%252FUZ37067_3d4411904e2e3ce16ea92f5d0bfdb416.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_3d4411904e2e3ce16ea92f5d0bfdb416.jpg already downloaded
2026-03-27 10:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a5f763b-223d-5001-b5e9-af1e69743b56, identifier: UZ37067
2026-03-27 10:36:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4f6190>
2026-03-27 10:36:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_7a3e1a0cbee63dc8020ce2d94a1eac4f.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_7a3e1a0cbee63dc8020ce2d94a1eac4f.jpg saved to cache
2026-03-27 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 209a5d1e-9028-5d3b-b29a-2381b4e0f067
2026-03-27 10:37:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be25f050>
2026-03-27 10:37:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_f4dd7b7da9ff2e442e47937628d94ab4.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_f4dd7b7da9ff2e442e47937628d94ab4.jpg saved to cache
2026-03-27 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0730e37a-33a2-5940-a0cc-76627c551249
2026-03-27 10:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_cc513e101f21cc75bce939c05ebd0f6c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 35dd651d-25d2-52be-913b-63460085253b with identifier: EV39961
2026-03-27 10:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 35dd651d-25d2-52be-913b-63460085253b with identifier: EV39961
2026-03-27 10:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 35dd651d-25d2-52be-913b-63460085253b with identifier: EV39961 to the API
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:35:54Z',
'fuel_type': 'diesel',
'id': '35dd651d-25d2-52be-913b-63460085253b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV39961',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 278053,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-18',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2009}
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV39961%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [auto1.de] INFO: Saving data for EV39961: {'auction_closing_time': 1774715754.0, 'created_time': 1773308136.069192, 'last_price_update_time': 1774607820.419089}
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV39961') HTTP/1.1" 204 0
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_5b29cc7ccf12cc76ff1c6102500064e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_5b29cc7ccf12cc76ff1c6102500064e3.jpg not downloaded yet
2026-03-27 10:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a5f763b-223d-5001-b5e9-af1e69743b56 with identifier: UZ37067
2026-03-27 10:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a5f763b-223d-5001-b5e9-af1e69743b56 with identifier: UZ37067
2026-03-27 10:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a5f763b-223d-5001-b5e9-af1e69743b56 with identifier: UZ37067 to the API
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UZ37067>
{'auction_title': '',
'c_o_2_emission_value': 195,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:34:59Z',
'fuel_type': 'petrol',
'id': '4a5f763b-223d-5001-b5e9-af1e69743b56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ37067',
'listing': 'auction',
'location': 'DE, Seddiner See',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 95449,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_6f3466dc8e11ffd6ab03e7df3b5960b3.jpg',
'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_1aa9f76fd30d1c97d696fbaa736e2935.jpg',
'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_3f29fdd094de012b5b7275badab403c2.jpg',
'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_8237e11379a239a026af583eb544e682.jpg',
'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_0859e6a0ede8c0a0424e7ab903ddfc50.jpg',
'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_629a873b661ee595ed9b7aefe26cd9b0.jpg',
'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_4ae6c8eb014c4cccc559bc099fc76837.jpg',
'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_65475a045cb0ee2ddabe619821f5d7a6.jpg',
'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_8482c88de5ab0b54263791e25e8be24a.jpg',
'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_3d4411904e2e3ce16ea92f5d0bfdb416.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5f763b-223d-5001-b5e9-af1e69743b56/4a5f763b-223d-5001-b5e9-af1e69743b56_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_6f3466dc8e11ffd6ab03e7df3b5960b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5f763b-223d-5001-b5e9-af1e69743b56/4a5f763b-223d-5001-b5e9-af1e69743b56_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67700,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_1aa9f76fd30d1c97d696fbaa736e2935.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5f763b-223d-5001-b5e9-af1e69743b56/4a5f763b-223d-5001-b5e9-af1e69743b56_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73734,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_3f29fdd094de012b5b7275badab403c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5f763b-223d-5001-b5e9-af1e69743b56/4a5f763b-223d-5001-b5e9-af1e69743b56_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45963,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_8237e11379a239a026af583eb544e682.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5f763b-223d-5001-b5e9-af1e69743b56/4a5f763b-223d-5001-b5e9-af1e69743b56_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73268,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_0859e6a0ede8c0a0424e7ab903ddfc50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5f763b-223d-5001-b5e9-af1e69743b56/4a5f763b-223d-5001-b5e9-af1e69743b56_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_629a873b661ee595ed9b7aefe26cd9b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5f763b-223d-5001-b5e9-af1e69743b56/4a5f763b-223d-5001-b5e9-af1e69743b56_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49179,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_4ae6c8eb014c4cccc559bc099fc76837.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5f763b-223d-5001-b5e9-af1e69743b56/4a5f763b-223d-5001-b5e9-af1e69743b56_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_65475a045cb0ee2ddabe619821f5d7a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5f763b-223d-5001-b5e9-af1e69743b56/4a5f763b-223d-5001-b5e9-af1e69743b56_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74363,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_8482c88de5ab0b54263791e25e8be24a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a5f763b-223d-5001-b5e9-af1e69743b56/4a5f763b-223d-5001-b5e9-af1e69743b56_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/60/c760c87307cd780cf09d44857a33c053/pa/UZ37067_3d4411904e2e3ce16ea92f5d0bfdb416.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-05-11',
'seats_number': 7,
'seller_name': None,
'title': 'Seat Alhambra 1.4 TSI FR-Line',
'transmission': 'automatic',
'trim': 'FR-Line',
'year': 2020}
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ37067%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [auto1.de] INFO: Saving data for UZ37067: {'created_time': 1774607820.899124, 'last_price_update_time': 1774607820.899136, 'auction_closing_time': 1774715699.0}
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ37067') HTTP/1.1" 204 0
2026-03-27 10:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_515e255dfa8baab5227cc88c94c1ad0c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:00 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR51449%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [auto1.de] INFO: Scrape type for SR51449: 2
2026-03-27 10:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c21292a-26b5-5ba9-a20f-dfc5c034abd2 with identifier: SR51449
2026-03-27 10:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c21292a-26b5-5ba9-a20f-dfc5c034abd2 with scrape type 2
2026-03-27 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c21292a-26b5-5ba9-a20f-dfc5c034abd2 with scrape type 2
2026-03-27 10:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c21292a-26b5-5ba9-a20f-dfc5c034abd2, identifier: SR51449
2026-03-27 10:37:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf07890>
2026-03-27 10:37:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_668522e08231a8a38030ede285f16680.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_668522e08231a8a38030ede285f16680.jpg saved to cache
2026-03-27 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0730e37a-33a2-5940-a0cc-76627c551249
2026-03-27 10:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c21292a-26b5-5ba9-a20f-dfc5c034abd2 with identifier: SR51449
2026-03-27 10:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c21292a-26b5-5ba9-a20f-dfc5c034abd2 with identifier: SR51449
2026-03-27 10:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c21292a-26b5-5ba9-a20f-dfc5c034abd2 with identifier: SR51449 to the API
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:21:43Z',
'fuel_type': 'gas',
'id': '8c21292a-26b5-5ba9-a20f-dfc5c034abd2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR51449',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 165129,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-04',
'seller_name': None,
'title': 'Audi A4 2.0 TFSI g-tron Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR51449%27 HTTP/1.1" 200 None
2026-03-27 10:37:01 [auto1.de] INFO: Saving data for SR51449: {'auction_closing_time': 1774714903.0, 'created_time': 1773772563.981637, 'last_price_update_time': 1774607821.499672}
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR51449') HTTP/1.1" 204 0
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_91b793f9d49267b2390a0be4f346c9ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_91b793f9d49267b2390a0be4f346c9ef.jpg not downloaded yet
2026-03-27 10:37:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1f5350>
2026-03-27 10:37:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_03b9bcea7743d1c8223f65f885d66340.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_03b9bcea7743d1c8223f65f885d66340.jpg saved to cache
2026-03-27 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0730e37a-33a2-5940-a0cc-76627c551249
2026-03-27 10:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_4374a44a1c914485a737b5398714d99a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:01 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT77440%27 HTTP/1.1" 200 None
2026-03-27 10:37:01 [auto1.de] INFO: Scrape type for DT77440: 2
2026-03-27 10:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67d27934-8b71-5f6b-948e-7576c2c7bac3 with identifier: DT77440
2026-03-27 10:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67d27934-8b71-5f6b-948e-7576c2c7bac3 with scrape type 2
2026-03-27 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67d27934-8b71-5f6b-948e-7576c2c7bac3 with scrape type 2
2026-03-27 10:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67d27934-8b71-5f6b-948e-7576c2c7bac3, identifier: DT77440
2026-03-27 10:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_5f7ceb9483a77eedc7a1ec37fad53997.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67d27934-8b71-5f6b-948e-7576c2c7bac3 with identifier: DT77440
2026-03-27 10:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67d27934-8b71-5f6b-948e-7576c2c7bac3 with identifier: DT77440
2026-03-27 10:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67d27934-8b71-5f6b-948e-7576c2c7bac3 with identifier: DT77440 to the API
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-28T16:49:19Z',
'fuel_type': 'gas',
'id': '67d27934-8b71-5f6b-948e-7576c2c7bac3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT77440',
'listing': 'auction',
'make': 'Dacia',
'model': 'Logan MCV',
'odometer': 40167,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-03',
'seller_name': None,
'title': 'Dacia Logan MCV 1.0 TCe LPG Stepway',
'transmission': 'manual',
'trim': 'Stepway',
'year': 2020}
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT77440%27 HTTP/1.1" 200 None
2026-03-27 10:37:02 [auto1.de] INFO: Saving data for DT77440: {'auction_closing_time': 1774716559.0, 'created_time': 1773426996.23229, 'last_price_update_time': 1774607822.07859}
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT77440') HTTP/1.1" 204 0
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_81f9765ce5ad3d40b08fa5720659509b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_81f9765ce5ad3d40b08fa5720659509b.jpg not downloaded yet
2026-03-27 10:37:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf37e6d0>
2026-03-27 10:37:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_cc513e101f21cc75bce939c05ebd0f6c.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_cc513e101f21cc75bce939c05ebd0f6c.jpg saved to cache
2026-03-27 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0730e37a-33a2-5940-a0cc-76627c551249
2026-03-27 10:37:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5653b90>
2026-03-27 10:37:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ef623d-3a90-541b-8018-5c676ee4d2ce/60ef623d-3a90-541b-8018-5c676ee4d2ce_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Faa%252F4aaa31466267c341cc0b78cefb64946a%252Fpa%252FXB85584_515e255dfa8baab5227cc88c94c1ad0c.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_515e255dfa8baab5227cc88c94c1ad0c.jpg saved to cache
2026-03-27 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60ef623d-3a90-541b-8018-5c676ee4d2ce
2026-03-27 10:37:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60ef623d-3a90-541b-8018-5c676ee4d2ce, skipping ID generation
2026-03-27 10:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60ef623d-3a90-541b-8018-5c676ee4d2ce with scrape type 1
2026-03-27 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60ef623d-3a90-541b-8018-5c676ee4d2ce sending to next pipeline
2026-03-27 10:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60ef623d-3a90-541b-8018-5c676ee4d2ce, identifier: XB85584
2026-03-27 10:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_697b54daf561678c68d0ed45b7f6afe1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:02 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY91699%27 HTTP/1.1" 200 None
2026-03-27 10:37:02 [auto1.de] INFO: Scrape type for WY91699: 2
2026-03-27 10:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2509d74f-8f1e-53b2-bb45-a01d12da881a with identifier: WY91699
2026-03-27 10:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2509d74f-8f1e-53b2-bb45-a01d12da881a with scrape type 2
2026-03-27 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2509d74f-8f1e-53b2-bb45-a01d12da881a with scrape type 2
2026-03-27 10:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2509d74f-8f1e-53b2-bb45-a01d12da881a, identifier: WY91699
2026-03-27 10:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB67521> (referer: https://www.auto1.com/v1/car-details-view/HB67521/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60ef623d-3a90-541b-8018-5c676ee4d2ce with identifier: XB85584
2026-03-27 10:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60ef623d-3a90-541b-8018-5c676ee4d2ce with identifier: XB85584
2026-03-27 10:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60ef623d-3a90-541b-8018-5c676ee4d2ce with identifier: XB85584 to the API
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_515e255dfa8baab5227cc88c94c1ad0c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.0L',
'engine_horse_power': 60,
'expiration_date': '2026-03-28T16:38:12Z',
'fuel_type': 'petrol',
'id': '60ef623d-3a90-541b-8018-5c676ee4d2ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB85584',
'listing': 'auction',
'location': 'DE, Balingen',
'make': 'Seat',
'model': 'Mii',
'odometer': 201312,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60ef623d-3a90-541b-8018-5c676ee4d2ce/60ef623d-3a90-541b-8018-5c676ee4d2ce_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71231,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_ab994a2823fce0c20ed8ae838f779fbb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60ef623d-3a90-541b-8018-5c676ee4d2ce/60ef623d-3a90-541b-8018-5c676ee4d2ce_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_885944252e015b4bf7da26a1dba1bf0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60ef623d-3a90-541b-8018-5c676ee4d2ce/60ef623d-3a90-541b-8018-5c676ee4d2ce_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82703,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_32a4117993839bcd0261e331efb5e3f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60ef623d-3a90-541b-8018-5c676ee4d2ce/60ef623d-3a90-541b-8018-5c676ee4d2ce_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_515e255dfa8baab5227cc88c94c1ad0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60ef623d-3a90-541b-8018-5c676ee4d2ce/60ef623d-3a90-541b-8018-5c676ee4d2ce_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_ae26983206bf0f700edb1c1911f21156.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60ef623d-3a90-541b-8018-5c676ee4d2ce/60ef623d-3a90-541b-8018-5c676ee4d2ce_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49681,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/aa/4aaa31466267c341cc0b78cefb64946a/pa/XB85584_39edb45faaedcf053678c5af9cdadaa6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-04-22',
'seats_number': 4,
'seller_name': None,
'title': 'Seat Mii 1.0 Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2014}
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85584%27 HTTP/1.1" 200 None
2026-03-27 10:37:02 [auto1.de] INFO: Saving data for XB85584: {'created_time': 1774607822.817247, 'last_price_update_time': 1774607822.817262, 'auction_closing_time': 1774715892.0}
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB85584') HTTP/1.1" 204 0
2026-03-27 10:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2509d74f-8f1e-53b2-bb45-a01d12da881a with identifier: WY91699
2026-03-27 10:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2509d74f-8f1e-53b2-bb45-a01d12da881a with identifier: WY91699
2026-03-27 10:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2509d74f-8f1e-53b2-bb45-a01d12da881a with identifier: WY91699 to the API
2026-03-27 10:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:35:34Z',
'fuel_type': 'diesel',
'id': '2509d74f-8f1e-53b2-bb45-a01d12da881a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY91699',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 279012,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-22',
'seller_name': None,
'title': 'BMW 3er 320d Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2018}
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY91699%27 HTTP/1.1" 200 None
2026-03-27 10:37:03 [auto1.de] INFO: Saving data for WY91699: {'auction_closing_time': 1774715734.0, 'created_time': 1774292227.344446, 'last_price_update_time': 1774607823.188545}
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY91699') HTTP/1.1" 204 0
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4fb150>
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_4374a44a1c914485a737b5398714d99a.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_4374a44a1c914485a737b5398714d99a.jpg saved to cache
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0730e37a-33a2-5940-a0cc-76627c551249
2026-03-27 10:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_9bcdb0a465b0ed7b2955001436b54841.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:03 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-27 10:37:03 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-27 10:37:03 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW79987%27 HTTP/1.1" 200 None
2026-03-27 10:37:03 [auto1.de] INFO: Scrape type for KW79987: 0
2026-03-27 10:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf076d0>
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_5f7ceb9483a77eedc7a1ec37fad53997.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_5f7ceb9483a77eedc7a1ec37fad53997.jpg saved to cache
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0730e37a-33a2-5940-a0cc-76627c551249
2026-03-27 10:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_91b793f9d49267b2390a0be4f346c9ef.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_5b29cc7ccf12cc76ff1c6102500064e3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU49821> (referer: https://www.auto1.com/v1/car-details-view/TU49821/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK21596> (referer: https://www.auto1.com/v1/car-details-view/EK21596/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c57ee1d0>
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_697b54daf561678c68d0ed45b7f6afe1.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_697b54daf561678c68d0ed45b7f6afe1.jpg saved to cache
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f
2026-03-27 10:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1320fc40-bba8-5bfd-9d6c-41e790b295bd with identifier: HB67521
2026-03-27 10:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1320fc40-bba8-5bfd-9d6c-41e790b295bd with scrape type 1
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1320fc40-bba8-5bfd-9d6c-41e790b295bd
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0c953a3431b015551430325b04ec80%252Fpa%252FHB67521_73edb2356e1d43b57f269b6aec9465eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_73edb2356e1d43b57f269b6aec9465eb.jpg not downloaded yet
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0c953a3431b015551430325b04ec80%252Fpa%252FHB67521_3d4b328dd20128e88059f5417d18de47.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_3d4b328dd20128e88059f5417d18de47.jpg not downloaded yet
2026-03-27 10:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FZ93202> (referer: https://www.auto1.com/v1/car-details-view/FZ93202/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1bf8d0>
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_9bcdb0a465b0ed7b2955001436b54841.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_9bcdb0a465b0ed7b2955001436b54841.jpg saved to cache
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f
2026-03-27 10:37:03 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 10502 | hits on page: 40
2026-03-27 10:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_a434afad984575739ae3f7bbb6f9ecee.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0c953a3431b015551430325b04ec80%252Fpa%252FHB67521_a946ed0ac42f5fd616ccf6de7457e988.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_a946ed0ac42f5fd616ccf6de7457e988.jpg not downloaded yet
2026-03-27 10:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_81f9765ce5ad3d40b08fa5720659509b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:03 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-27 10:37:03 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW79987%27 HTTP/1.1" 200 None
2026-03-27 10:37:03 [auto1.de] INFO: Scrape type for KW79987: 0
2026-03-27 10:37:03 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-27 10:37:03 [auto1.de] INFO: Found listing with ID: YU96411
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU96411%27 HTTP/1.1" 200 None
2026-03-27 10:37:03 [auto1.de] INFO: Scrape type for YU96411: 2
2026-03-27 10:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 713588e3-a60b-556f-babb-e148ef288b2f with identifier: YU96411
2026-03-27 10:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 713588e3-a60b-556f-babb-e148ef288b2f with scrape type 2
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 713588e3-a60b-556f-babb-e148ef288b2f with scrape type 2
2026-03-27 10:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 713588e3-a60b-556f-babb-e148ef288b2f, identifier: YU96411
2026-03-27 10:37:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e8dd0>
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_91b793f9d49267b2390a0be4f346c9ef.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_91b793f9d49267b2390a0be4f346c9ef.jpg saved to cache
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0730e37a-33a2-5940-a0cc-76627c551249
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be020e90>
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_5b29cc7ccf12cc76ff1c6102500064e3.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_5b29cc7ccf12cc76ff1c6102500064e3.jpg saved to cache
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0730e37a-33a2-5940-a0cc-76627c551249
2026-03-27 10:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4c1b93f-5b90-55e1-a318-40937b4c67bc with identifier: TU49821
2026-03-27 10:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4c1b93f-5b90-55e1-a318-40937b4c67bc with scrape type 1
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d4c1b93f-5b90-55e1-a318-40937b4c67bc
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_b61213056ad73ddbb5b6e6247fa874ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_b61213056ad73ddbb5b6e6247fa874ab.jpg not downloaded yet
2026-03-27 10:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with identifier: EK21596
2026-03-27 10:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with scrape type 1
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_f4a0a8349c1d16375cb4f0bee78ff987.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_f4a0a8349c1d16375cb4f0bee78ff987.jpg not downloaded yet
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0c953a3431b015551430325b04ec80%252Fpa%252FHB67521_7c210714dea98499c50e7787701dddaa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_7c210714dea98499c50e7787701dddaa.jpg not downloaded yet
2026-03-27 10:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 713588e3-a60b-556f-babb-e148ef288b2f with identifier: YU96411
2026-03-27 10:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 713588e3-a60b-556f-babb-e148ef288b2f with identifier: YU96411
2026-03-27 10:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 713588e3-a60b-556f-babb-e148ef288b2f with identifier: YU96411 to the API
2026-03-27 10:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:57:12Z',
'fuel_type': 'petrol',
'id': '713588e3-a60b-556f-babb-e148ef288b2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU96411',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 111275,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-08',
'seller_name': None,
'title': 'Skoda Fabia 1.0 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2019}
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU96411%27 HTTP/1.1" 200 None
2026-03-27 10:37:04 [auto1.de] INFO: Saving data for YU96411: {'auction_closing_time': 1774717032.0, 'created_time': 1773466227.040482, 'last_price_update_time': 1774607824.153452}
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU96411') HTTP/1.1" 204 0
2026-03-27 10:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_653acdc32640fa7c90e1b13871187378.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_25aea0a02fca716a4a1b7ab703ae15c8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:04 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD28287%27 HTTP/1.1" 200 None
2026-03-27 10:37:04 [auto1.de] INFO: Scrape type for AD28287: 2
2026-03-27 10:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f with identifier: AD28287
2026-03-27 10:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f with scrape type 2
2026-03-27 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f with scrape type 2
2026-03-27 10:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f, identifier: AD28287
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_3e3bfd475fcf4907d32e1cbdea0705b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_3e3bfd475fcf4907d32e1cbdea0705b8.jpg not downloaded yet
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_362781f0dffea85fd31f40cd950a1e22.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_362781f0dffea85fd31f40cd950a1e22.jpg not downloaded yet
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0c953a3431b015551430325b04ec80%252Fpa%252FHB67521_9e88c780123818ba5c60ce8357717029.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_9e88c780123818ba5c60ce8357717029.jpg not downloaded yet
2026-03-27 10:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f with identifier: AD28287
2026-03-27 10:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f with identifier: AD28287
2026-03-27 10:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7cbfd7db-0a6b-5148-bba3-21b5b7aec72f with identifier: AD28287 to the API
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:35:42Z',
'fuel_type': 'petrol',
'id': '7cbfd7db-0a6b-5148-bba3-21b5b7aec72f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD28287',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 104648,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-09',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
'transmission': 'automatic',
'trim': 'BlueEfficiency Style',
'year': 2015}
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD28287%27 HTTP/1.1" 200 None
2026-03-27 10:37:04 [auto1.de] INFO: Saving data for AD28287: {'auction_closing_time': 1774715742.0, 'created_time': 1773775671.866236, 'last_price_update_time': 1774607824.723333}
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD28287') HTTP/1.1" 204 0
2026-03-27 10:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31069b09-bcbe-5f7f-8091-09b5f344c033 with identifier: FZ93202
2026-03-27 10:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31069b09-bcbe-5f7f-8091-09b5f344c033 with scrape type 1
2026-03-27 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 31069b09-bcbe-5f7f-8091-09b5f344c033
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F87%252F1b875f0738c98d29e7991d37de933974%252Fpa%252FFZ93202_e2f45ede7a227c6ccd377699c13beff0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_e2f45ede7a227c6ccd377699c13beff0.jpg not downloaded yet
2026-03-27 10:37:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be09a490>
2026-03-27 10:37:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_a434afad984575739ae3f7bbb6f9ecee.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_a434afad984575739ae3f7bbb6f9ecee.jpg saved to cache
2026-03-27 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f
2026-03-27 10:37:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf359d10>
2026-03-27 10:37:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F50%252F775068cde753be3194b27e6c2778b146%252Fpa%252FAG44420_81f9765ce5ad3d40b08fa5720659509b.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_81f9765ce5ad3d40b08fa5720659509b.jpg saved to cache
2026-03-27 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0730e37a-33a2-5940-a0cc-76627c551249
2026-03-27 10:37:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0730e37a-33a2-5940-a0cc-76627c551249, skipping ID generation
2026-03-27 10:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0730e37a-33a2-5940-a0cc-76627c551249 with scrape type 1
2026-03-27 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0730e37a-33a2-5940-a0cc-76627c551249 sending to next pipeline
2026-03-27 10:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0730e37a-33a2-5940-a0cc-76627c551249, identifier: AG44420
2026-03-27 10:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_a2c0f74d56f3a4d71219437de6ebe4fe.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_aadaa6a637677cb30e3ffbab677f9284.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_f45caf3eefab9c93f3c4ef97e889eb44.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:05 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-27 10:37:05 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-27 10:37:05 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-27 10:37:05 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-27 10:37:05 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ11294%27 HTTP/1.1" 200 None
2026-03-27 10:37:05 [auto1.de] INFO: Scrape type for HJ11294: 2
2026-03-27 10:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd7549f7-c69e-5a96-b13b-3aa8c51f7459 with identifier: HJ11294
2026-03-27 10:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd7549f7-c69e-5a96-b13b-3aa8c51f7459 with scrape type 2
2026-03-27 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd7549f7-c69e-5a96-b13b-3aa8c51f7459 with scrape type 2
2026-03-27 10:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd7549f7-c69e-5a96-b13b-3aa8c51f7459, identifier: HJ11294
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_dc032f48c647f7bab3814273965c4ead.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_dc032f48c647f7bab3814273965c4ead.jpg not downloaded yet
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_26e8ecd75e0a513c807c07f9a8d60085.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_26e8ecd75e0a513c807c07f9a8d60085.jpg not downloaded yet
2026-03-27 10:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0730e37a-33a2-5940-a0cc-76627c551249 with identifier: AG44420
2026-03-27 10:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0730e37a-33a2-5940-a0cc-76627c551249 with identifier: AG44420
2026-03-27 10:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0730e37a-33a2-5940-a0cc-76627c551249 with identifier: AG44420 to the API
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_81f9765ce5ad3d40b08fa5720659509b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:57:09Z',
'fuel_type': 'diesel',
'id': '0730e37a-33a2-5940-a0cc-76627c551249',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG44420',
'listing': 'auction',
'location': 'DE, Neufahrn',
'make': 'Fiat',
'model': 'Doblo',
'odometer': 81911,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_f4dd7b7da9ff2e442e47937628d94ab4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_a91df2cb97df1010122c8be3c1f80661.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62225,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_03b9bcea7743d1c8223f65f885d66340.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61398,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_668522e08231a8a38030ede285f16680.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60928,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_cc513e101f21cc75bce939c05ebd0f6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56383,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_4374a44a1c914485a737b5398714d99a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60401,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_5f7ceb9483a77eedc7a1ec37fad53997.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56215,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_5b29cc7ccf12cc76ff1c6102500064e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63412,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_91b793f9d49267b2390a0be4f346c9ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0730e37a-33a2-5940-a0cc-76627c551249/0730e37a-33a2-5940-a0cc-76627c551249_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59824,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/50/775068cde753be3194b27e6c2778b146/pa/AG44420_81f9765ce5ad3d40b08fa5720659509b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-17',
'seats_number': 3,
'seller_name': None,
'title': 'Fiat Doblo 1.6 JTDM Work Up Pritsche',
'transmission': 'manual',
'trim': 'Work Up Pritsche',
'year': 2019}
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44420%27 HTTP/1.1" 200 None
2026-03-27 10:37:05 [auto1.de] INFO: Saving data for AG44420: {'created_time': 1774607825.665276, 'last_price_update_time': 1774607825.665287, 'auction_closing_time': 1774717029.0}
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG44420') HTTP/1.1" 204 0
2026-03-27 10:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd7549f7-c69e-5a96-b13b-3aa8c51f7459 with identifier: HJ11294
2026-03-27 10:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd7549f7-c69e-5a96-b13b-3aa8c51f7459 with identifier: HJ11294
2026-03-27 10:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd7549f7-c69e-5a96-b13b-3aa8c51f7459 with identifier: HJ11294 to the API
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:56:14Z',
'fuel_type': 'diesel',
'id': 'fd7549f7-c69e-5a96-b13b-3aa8c51f7459',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ11294',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 146693,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-11',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ11294%27 HTTP/1.1" 200 None
2026-03-27 10:37:06 [auto1.de] INFO: Saving data for HJ11294: {'auction_closing_time': 1774716974.0, 'created_time': 1773302707.12766, 'last_price_update_time': 1774607826.047109}
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ11294') HTTP/1.1" 204 0
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F87%252F1b875f0738c98d29e7991d37de933974%252Fpa%252FFZ93202_5bb5b9727f93a914c14af7a5686ddb58.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_5bb5b9727f93a914c14af7a5686ddb58.jpg not downloaded yet
2026-03-27 10:37:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1d3ad0>
2026-03-27 10:37:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_653acdc32640fa7c90e1b13871187378.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_653acdc32640fa7c90e1b13871187378.jpg saved to cache
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 209a5d1e-9028-5d3b-b29a-2381b4e0f067
2026-03-27 10:37:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1bf910>
2026-03-27 10:37:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_25aea0a02fca716a4a1b7ab703ae15c8.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_25aea0a02fca716a4a1b7ab703ae15c8.jpg saved to cache
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f
2026-03-27 10:37:06 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU16486%27 HTTP/1.1" 200 None
2026-03-27 10:37:06 [auto1.de] INFO: Scrape type for LU16486: 2
2026-03-27 10:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6174ccb-9071-50cd-92b6-53c1d9c50ad5 with identifier: LU16486
2026-03-27 10:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6174ccb-9071-50cd-92b6-53c1d9c50ad5 with scrape type 2
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6174ccb-9071-50cd-92b6-53c1d9c50ad5 with scrape type 2
2026-03-27 10:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6174ccb-9071-50cd-92b6-53c1d9c50ad5, identifier: LU16486
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_fe3b205c05a573aab4e813ff0abe15ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_fe3b205c05a573aab4e813ff0abe15ea.jpg not downloaded yet
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_62226d69d5b0bb5b85387e516d068319.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_62226d69d5b0bb5b85387e516d068319.jpg not downloaded yet
2026-03-27 10:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_3d4b328dd20128e88059f5417d18de47.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6174ccb-9071-50cd-92b6-53c1d9c50ad5 with identifier: LU16486
2026-03-27 10:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6174ccb-9071-50cd-92b6-53c1d9c50ad5 with identifier: LU16486
2026-03-27 10:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6174ccb-9071-50cd-92b6-53c1d9c50ad5 with identifier: LU16486 to the API
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:03:06Z',
'fuel_type': 'petrol',
'id': 'd6174ccb-9071-50cd-92b6-53c1d9c50ad5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU16486',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 48528,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-29',
'seller_name': None,
'title': 'Fiat 500X 1.4 Turbo Mirror',
'transmission': 'manual',
'trim': 'Mirror',
'year': 2017}
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU16486%27 HTTP/1.1" 200 None
2026-03-27 10:37:06 [auto1.de] INFO: Saving data for LU16486: {'auction_closing_time': 1774713786.0, 'created_time': 1773741734.08073, 'last_price_update_time': 1774607826.721545}
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU16486') HTTP/1.1" 204 0
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F87%252F1b875f0738c98d29e7991d37de933974%252Fpa%252FFZ93202_cf47cc8d5b3bdc41d08b7f1fcdb32e14.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_cf47cc8d5b3bdc41d08b7f1fcdb32e14.jpg not downloaded yet
2026-03-27 10:37:06 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-27 10:37:06 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-27 10:37:06 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-27 10:37:06 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX81073%27 HTTP/1.1" 200 None
2026-03-27 10:37:06 [auto1.de] INFO: Scrape type for JX81073: 2
2026-03-27 10:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71cc290a-52bb-576e-a722-9ce68fede8f9 with identifier: JX81073
2026-03-27 10:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71cc290a-52bb-576e-a722-9ce68fede8f9 with scrape type 2
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71cc290a-52bb-576e-a722-9ce68fede8f9 with scrape type 2
2026-03-27 10:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71cc290a-52bb-576e-a722-9ce68fede8f9, identifier: JX81073
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_4571440e12c026efd213b6313e6b556a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_4571440e12c026efd213b6313e6b556a.jpg not downloaded yet
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_cd25d8c07254333041457bbd35a7bd7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_cd25d8c07254333041457bbd35a7bd7a.jpg not downloaded yet
2026-03-27 10:37:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1b2f90>
2026-03-27 10:37:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_a2c0f74d56f3a4d71219437de6ebe4fe.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_a2c0f74d56f3a4d71219437de6ebe4fe.jpg saved to cache
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 209a5d1e-9028-5d3b-b29a-2381b4e0f067
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5512290>
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_aadaa6a637677cb30e3ffbab677f9284.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_aadaa6a637677cb30e3ffbab677f9284.jpg saved to cache
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcf531ae-96c1-569c-a7c7-f12a6e59abd6
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf55b6d0>
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_f45caf3eefab9c93f3c4ef97e889eb44.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_f45caf3eefab9c93f3c4ef97e889eb44.jpg saved to cache
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcf531ae-96c1-569c-a7c7-f12a6e59abd6
2026-03-27 10:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_f4a0a8349c1d16375cb4f0bee78ff987.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_7c210714dea98499c50e7787701dddaa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_73edb2356e1d43b57f269b6aec9465eb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:07 [scrapy.extensions.logstats] INFO: Crawled 285 pages (at 37 pages/min), scraped 223 items (at 74 items/min)
2026-03-27 10:37:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-27 10:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71cc290a-52bb-576e-a722-9ce68fede8f9 with identifier: JX81073
2026-03-27 10:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71cc290a-52bb-576e-a722-9ce68fede8f9 with identifier: JX81073
2026-03-27 10:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71cc290a-52bb-576e-a722-9ce68fede8f9 with identifier: JX81073 to the API
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:25:16Z',
'fuel_type': 'diesel',
'id': '71cc290a-52bb-576e-a722-9ce68fede8f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX81073',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 361254,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-26',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2011}
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX81073%27 HTTP/1.1" 200 None
2026-03-27 10:37:07 [auto1.de] INFO: Saving data for JX81073: {'auction_closing_time': 1774715116.0, 'created_time': 1774263171.889573, 'last_price_update_time': 1774607827.494455}
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX81073') HTTP/1.1" 204 0
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F87%252F1b875f0738c98d29e7991d37de933974%252Fpa%252FFZ93202_2defd5b8d6f81df03d2abec01caa4d75.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_2defd5b8d6f81df03d2abec01caa4d75.jpg not downloaded yet
2026-03-27 10:37:07 [auto1.de] INFO: Found listing with ID: RU03073
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU03073%27 HTTP/1.1" 200 None
2026-03-27 10:37:07 [auto1.de] INFO: Scrape type for RU03073: 2
2026-03-27 10:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6026c26d-7adb-588f-b3d5-7c142d7882a6 with identifier: RU03073
2026-03-27 10:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6026c26d-7adb-588f-b3d5-7c142d7882a6 with scrape type 2
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6026c26d-7adb-588f-b3d5-7c142d7882a6 with scrape type 2
2026-03-27 10:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6026c26d-7adb-588f-b3d5-7c142d7882a6, identifier: RU03073
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_9526a0c73fb0af22528d4843bea16181.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_9526a0c73fb0af22528d4843bea16181.jpg not downloaded yet
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_b27d28a10baf37a5dc874b5057d9aee9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_b27d28a10baf37a5dc874b5057d9aee9.jpg not downloaded yet
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5c3b10>
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1320fc40-bba8-5bfd-9d6c-41e790b295bd/1320fc40-bba8-5bfd-9d6c-41e790b295bd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0c953a3431b015551430325b04ec80%252Fpa%252FHB67521_3d4b328dd20128e88059f5417d18de47.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_3d4b328dd20128e88059f5417d18de47.jpg saved to cache
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1320fc40-bba8-5bfd-9d6c-41e790b295bd
2026-03-27 10:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6026c26d-7adb-588f-b3d5-7c142d7882a6 with identifier: RU03073
2026-03-27 10:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6026c26d-7adb-588f-b3d5-7c142d7882a6 with identifier: RU03073
2026-03-27 10:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6026c26d-7adb-588f-b3d5-7c142d7882a6 with identifier: RU03073 to the API
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:50:35Z',
'fuel_type': 'petrol',
'id': '6026c26d-7adb-588f-b3d5-7c142d7882a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU03073',
'listing': 'auction',
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 112858,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-19',
'seller_name': None,
'title': 'Nissan X-Trail 1.6 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2017}
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU03073%27 HTTP/1.1" 200 None
2026-03-27 10:37:08 [auto1.de] INFO: Saving data for RU03073: {'auction_closing_time': 1774716635.0, 'created_time': 1774294810.515037, 'last_price_update_time': 1774607828.150012}
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU03073') HTTP/1.1" 204 0
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F87%252F1b875f0738c98d29e7991d37de933974%252Fpa%252FFZ93202_d70898277d96802291459df8c2c59435.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_d70898277d96802291459df8c2c59435.jpg not downloaded yet
2026-03-27 10:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_6066673dfcd8be593162062ea1d0b195.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:08 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF55006%27 HTTP/1.1" 200 None
2026-03-27 10:37:08 [auto1.de] INFO: Scrape type for XF55006: 2
2026-03-27 10:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca83185e-10e0-55c1-aafe-0031eff06766 with identifier: XF55006
2026-03-27 10:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca83185e-10e0-55c1-aafe-0031eff06766 with scrape type 2
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca83185e-10e0-55c1-aafe-0031eff06766 with scrape type 2
2026-03-27 10:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca83185e-10e0-55c1-aafe-0031eff06766, identifier: XF55006
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_c321a3503b227d358596296c8d4bc9c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_c321a3503b227d358596296c8d4bc9c5.jpg not downloaded yet
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_8a436723c0121dffe2ed298b2a6a73d3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_8a436723c0121dffe2ed298b2a6a73d3.jpg not downloaded yet
2026-03-27 10:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_fe3b205c05a573aab4e813ff0abe15ea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca83185e-10e0-55c1-aafe-0031eff06766 with identifier: XF55006
2026-03-27 10:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca83185e-10e0-55c1-aafe-0031eff06766 with identifier: XF55006
2026-03-27 10:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca83185e-10e0-55c1-aafe-0031eff06766 with identifier: XF55006 to the API
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:51:11Z',
'fuel_type': 'petrol',
'id': 'ca83185e-10e0-55c1-aafe-0031eff06766',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF55006',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 67714,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-19',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.5 TSI ACT Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2020}
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF55006%27 HTTP/1.1" 200 None
2026-03-27 10:37:08 [auto1.de] INFO: Saving data for XF55006: {'auction_closing_time': 1774716671.0, 'created_time': 1773133734.026963, 'last_price_update_time': 1774607828.837605}
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF55006') HTTP/1.1" 204 0
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5c2b90>
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_f4a0a8349c1d16375cb4f0bee78ff987.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_f4a0a8349c1d16375cb4f0bee78ff987.jpg saved to cache
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be25add0>
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1320fc40-bba8-5bfd-9d6c-41e790b295bd/1320fc40-bba8-5bfd-9d6c-41e790b295bd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0c953a3431b015551430325b04ec80%252Fpa%252FHB67521_7c210714dea98499c50e7787701dddaa.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_7c210714dea98499c50e7787701dddaa.jpg saved to cache
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1320fc40-bba8-5bfd-9d6c-41e790b295bd
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2c53d0>
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1320fc40-bba8-5bfd-9d6c-41e790b295bd/1320fc40-bba8-5bfd-9d6c-41e790b295bd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0c953a3431b015551430325b04ec80%252Fpa%252FHB67521_73edb2356e1d43b57f269b6aec9465eb.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_73edb2356e1d43b57f269b6aec9465eb.jpg saved to cache
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1320fc40-bba8-5bfd-9d6c-41e790b295bd
2026-03-27 10:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_5bb5b9727f93a914c14af7a5686ddb58.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_62226d69d5b0bb5b85387e516d068319.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_cf47cc8d5b3bdc41d08b7f1fcdb32e14.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:08 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-27 10:37:08 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF57036%27 HTTP/1.1" 200 None
2026-03-27 10:37:09 [auto1.de] INFO: Scrape type for BF57036: 2
2026-03-27 10:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d358263b-4490-5d1a-9022-1a5e059723da with identifier: BF57036
2026-03-27 10:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d358263b-4490-5d1a-9022-1a5e059723da with scrape type 2
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d358263b-4490-5d1a-9022-1a5e059723da with scrape type 2
2026-03-27 10:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d358263b-4490-5d1a-9022-1a5e059723da, identifier: BF57036
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_c4f06fb4065ab02002670e6809e0f6c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_c4f06fb4065ab02002670e6809e0f6c2.jpg not downloaded yet
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_f25eb1ddb9c822069fd62d0b139ff216.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_f25eb1ddb9c822069fd62d0b139ff216.jpg not downloaded yet
2026-03-27 10:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_a46f519c07f1fd5a604a4f1ba71cd8d4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d358263b-4490-5d1a-9022-1a5e059723da with identifier: BF57036
2026-03-27 10:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d358263b-4490-5d1a-9022-1a5e059723da with identifier: BF57036
2026-03-27 10:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d358263b-4490-5d1a-9022-1a5e059723da with identifier: BF57036 to the API
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:51:33Z',
'fuel_type': 'petrol',
'id': 'd358263b-4490-5d1a-9022-1a5e059723da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF57036',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 78362,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-16',
'seller_name': None,
'title': 'Volkswagen Caddy 1.0 TSI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2019}
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF57036%27 HTTP/1.1" 200 None
2026-03-27 10:37:09 [auto1.de] INFO: Saving data for BF57036: {'auction_closing_time': 1774716693.0, 'created_time': 1773859593.650749, 'last_price_update_time': 1774607829.50242}
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF57036') HTTP/1.1" 204 0
2026-03-27 10:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_dc032f48c647f7bab3814273965c4ead.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:09 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH99848%27 HTTP/1.1" 200 None
2026-03-27 10:37:09 [auto1.de] INFO: Scrape type for UH99848: 2
2026-03-27 10:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6621d8f1-0d38-51de-aca4-fa266393b116 with identifier: UH99848
2026-03-27 10:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6621d8f1-0d38-51de-aca4-fa266393b116 with scrape type 2
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6621d8f1-0d38-51de-aca4-fa266393b116 with scrape type 2
2026-03-27 10:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6621d8f1-0d38-51de-aca4-fa266393b116, identifier: UH99848
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_ccf8e9572eb9283717bf2435d2cf5bec.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_ccf8e9572eb9283717bf2435d2cf5bec.jpg not downloaded yet
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_6beacc3b0f8e3e0d63db42269db141b7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_6beacc3b0f8e3e0d63db42269db141b7.jpg not downloaded yet
2026-03-27 10:37:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be23f850>
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_6066673dfcd8be593162062ea1d0b195.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_6066673dfcd8be593162062ea1d0b195.jpg saved to cache
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 209a5d1e-9028-5d3b-b29a-2381b4e0f067
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2777d0>
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_fe3b205c05a573aab4e813ff0abe15ea.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_fe3b205c05a573aab4e813ff0abe15ea.jpg saved to cache
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4c1b93f-5b90-55e1-a318-40937b4c67bc
2026-03-27 10:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6621d8f1-0d38-51de-aca4-fa266393b116 with identifier: UH99848
2026-03-27 10:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6621d8f1-0d38-51de-aca4-fa266393b116 with identifier: UH99848
2026-03-27 10:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6621d8f1-0d38-51de-aca4-fa266393b116 with identifier: UH99848 to the API
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 328,
'expiration_date': '2026-03-28T16:44:04Z',
'fuel_type': 'hybrid',
'id': '6621d8f1-0d38-51de-aca4-fa266393b116',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH99848',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-60',
'odometer': 77335,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-01',
'seller_name': None,
'title': 'Mazda CX-60 2.5 e-Skyactiv Plug-in Hybrid Prime-Line AWD',
'transmission': 'automatic',
'trim': 'Prime-Line AWD',
'year': 2023}
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH99848%27 HTTP/1.1" 200 None
2026-03-27 10:37:10 [auto1.de] INFO: Saving data for UH99848: {'auction_closing_time': 1774716244.0, 'created_time': 1773223968.395854, 'last_price_update_time': 1774607830.269572}
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH99848') HTTP/1.1" 204 0
2026-03-27 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_e2f45ede7a227c6ccd377699c13beff0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_b27d28a10baf37a5dc874b5057d9aee9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:10 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD60404%27 HTTP/1.1" 200 None
2026-03-27 10:37:10 [auto1.de] INFO: Scrape type for GD60404: 2
2026-03-27 10:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66780655-43eb-5105-8a6f-d6ffb7db9def with identifier: GD60404
2026-03-27 10:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66780655-43eb-5105-8a6f-d6ffb7db9def with scrape type 2
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66780655-43eb-5105-8a6f-d6ffb7db9def with scrape type 2
2026-03-27 10:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66780655-43eb-5105-8a6f-d6ffb7db9def, identifier: GD60404
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_9c5c4f8f46c263ca5094ab45597395bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_9c5c4f8f46c263ca5094ab45597395bc.jpg not downloaded yet
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_7b099fc2e71d354dd27eb66fe26ca224.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_7b099fc2e71d354dd27eb66fe26ca224.jpg not downloaded yet
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be275fd0>
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31069b09-bcbe-5f7f-8091-09b5f344c033/31069b09-bcbe-5f7f-8091-09b5f344c033_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F87%252F1b875f0738c98d29e7991d37de933974%252Fpa%252FFZ93202_5bb5b9727f93a914c14af7a5686ddb58.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_5bb5b9727f93a914c14af7a5686ddb58.jpg saved to cache
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31069b09-bcbe-5f7f-8091-09b5f344c033
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1f08d0>
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_62226d69d5b0bb5b85387e516d068319.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_62226d69d5b0bb5b85387e516d068319.jpg saved to cache
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be10f490>
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31069b09-bcbe-5f7f-8091-09b5f344c033/31069b09-bcbe-5f7f-8091-09b5f344c033_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F87%252F1b875f0738c98d29e7991d37de933974%252Fpa%252FFZ93202_cf47cc8d5b3bdc41d08b7f1fcdb32e14.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_cf47cc8d5b3bdc41d08b7f1fcdb32e14.jpg saved to cache
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31069b09-bcbe-5f7f-8091-09b5f344c033
2026-03-27 10:37:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be259d10>
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fef%252F30ef0647307a05303bf792b313106446%252Fpa%252FYF78558_a46f519c07f1fd5a604a4f1ba71cd8d4.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_a46f519c07f1fd5a604a4f1ba71cd8d4.jpg saved to cache
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 209a5d1e-9028-5d3b-b29a-2381b4e0f067
2026-03-27 10:37:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 209a5d1e-9028-5d3b-b29a-2381b4e0f067, skipping ID generation
2026-03-27 10:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 209a5d1e-9028-5d3b-b29a-2381b4e0f067 with scrape type 1
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 209a5d1e-9028-5d3b-b29a-2381b4e0f067 sending to next pipeline
2026-03-27 10:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 209a5d1e-9028-5d3b-b29a-2381b4e0f067, identifier: YF78558
2026-03-27 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_d70898277d96802291459df8c2c59435.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_c321a3503b227d358596296c8d4bc9c5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66780655-43eb-5105-8a6f-d6ffb7db9def with identifier: GD60404
2026-03-27 10:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66780655-43eb-5105-8a6f-d6ffb7db9def with identifier: GD60404
2026-03-27 10:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66780655-43eb-5105-8a6f-d6ffb7db9def with identifier: GD60404 to the API
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:21:00Z',
'fuel_type': 'petrol',
'id': '66780655-43eb-5105-8a6f-d6ffb7db9def',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD60404',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 87225,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-23',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 220 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2019}
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD60404%27 HTTP/1.1" 200 None
2026-03-27 10:37:11 [auto1.de] INFO: Saving data for GD60404: {'auction_closing_time': 1774714860.0, 'created_time': 1774290920.610145, 'last_price_update_time': 1774607831.129579}
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD60404') HTTP/1.1" 204 0
2026-03-27 10:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 209a5d1e-9028-5d3b-b29a-2381b4e0f067 with identifier: YF78558
2026-03-27 10:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 209a5d1e-9028-5d3b-b29a-2381b4e0f067 with identifier: YF78558
2026-03-27 10:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 209a5d1e-9028-5d3b-b29a-2381b4e0f067 with identifier: YF78558 to the API
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_a46f519c07f1fd5a604a4f1ba71cd8d4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:42:04Z',
'fuel_type': 'diesel',
'id': '209a5d1e-9028-5d3b-b29a-2381b4e0f067',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF78558',
'listing': 'auction',
'location': 'DE, Freiburg im Breisgau',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 244679,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76705,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_7a3e1a0cbee63dc8020ce2d94a1eac4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66314,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_6a63098f8096f0931e1ce32a3c7a682a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_ebe008a020aa8c44aa31673684cc2e9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64178,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_011772705b8836b73d78a4f4abbe9c2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_88eadba455cb306a471d70789cb5a245.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2617159,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_a46f519c07f1fd5a604a4f1ba71cd8d4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2533844,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_a2c0f74d56f3a4d71219437de6ebe4fe.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2507652,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_653acdc32640fa7c90e1b13871187378.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_cbdc7b29bce4e7dee8a9cb66918f6338.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209a5d1e-9028-5d3b-b29a-2381b4e0f067/209a5d1e-9028-5d3b-b29a-2381b4e0f067_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2464656,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img30/ef/30ef0647307a05303bf792b313106446/pa/YF78558_6066673dfcd8be593162062ea1d0b195.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-09-15',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2014}
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF78558%27 HTTP/1.1" 200 None
2026-03-27 10:37:11 [auto1.de] INFO: Saving data for YF78558: {'created_time': 1774607831.562437, 'last_price_update_time': 1774607831.562448, 'auction_closing_time': 1774716124.0}
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF78558') HTTP/1.1" 204 0
2026-03-27 10:37:11 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY70814%27 HTTP/1.1" 200 None
2026-03-27 10:37:11 [auto1.de] INFO: Scrape type for MY70814: 2
2026-03-27 10:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcfc2730-553f-563d-88b9-6f24fed4ed19 with identifier: MY70814
2026-03-27 10:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcfc2730-553f-563d-88b9-6f24fed4ed19 with scrape type 2
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcfc2730-553f-563d-88b9-6f24fed4ed19 with scrape type 2
2026-03-27 10:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcfc2730-553f-563d-88b9-6f24fed4ed19, identifier: MY70814
2026-03-27 10:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN23019> (referer: https://www.auto1.com/v1/car-details-view/UN23019/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS49483> (referer: https://www.auto1.com/v1/car-details-view/JS49483/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV33449> (referer: https://www.auto1.com/v1/car-details-view/ZV33449/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be020810>
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_dc032f48c647f7bab3814273965c4ead.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_dc032f48c647f7bab3814273965c4ead.jpg saved to cache
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4c1b93f-5b90-55e1-a318-40937b4c67bc
2026-03-27 10:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcfc2730-553f-563d-88b9-6f24fed4ed19 with identifier: MY70814
2026-03-27 10:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcfc2730-553f-563d-88b9-6f24fed4ed19 with identifier: MY70814
2026-03-27 10:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcfc2730-553f-563d-88b9-6f24fed4ed19 with identifier: MY70814 to the API
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:26:44Z',
'fuel_type': 'diesel',
'id': 'fcfc2730-553f-563d-88b9-6f24fed4ed19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY70814',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 273796,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-19',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 250 CDI T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2010}
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY70814%27 HTTP/1.1" 200 None
2026-03-27 10:37:12 [auto1.de] INFO: Saving data for MY70814: {'auction_closing_time': 1774715204.0, 'created_time': 1773138690.716435, 'last_price_update_time': 1774607832.167488}
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY70814') HTTP/1.1" 204 0
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf477010>
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31069b09-bcbe-5f7f-8091-09b5f344c033/31069b09-bcbe-5f7f-8091-09b5f344c033_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F87%252F1b875f0738c98d29e7991d37de933974%252Fpa%252FFZ93202_e2f45ede7a227c6ccd377699c13beff0.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_e2f45ede7a227c6ccd377699c13beff0.jpg saved to cache
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31069b09-bcbe-5f7f-8091-09b5f344c033
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be175e50>
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_b27d28a10baf37a5dc874b5057d9aee9.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_b27d28a10baf37a5dc874b5057d9aee9.jpg saved to cache
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-03-27 10:37:12 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-27 10:37:12 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-27 10:37:12 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG64056%27 HTTP/1.1" 200 None
2026-03-27 10:37:12 [auto1.de] INFO: Scrape type for HG64056: 2
2026-03-27 10:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f68b3c0-8911-50b9-b54f-b15889e2dfa0 with identifier: HG64056
2026-03-27 10:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f68b3c0-8911-50b9-b54f-b15889e2dfa0 with scrape type 2
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f68b3c0-8911-50b9-b54f-b15889e2dfa0 with scrape type 2
2026-03-27 10:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f68b3c0-8911-50b9-b54f-b15889e2dfa0, identifier: HG64056
2026-03-27 10:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f68b3c0-8911-50b9-b54f-b15889e2dfa0 with identifier: HG64056
2026-03-27 10:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f68b3c0-8911-50b9-b54f-b15889e2dfa0 with identifier: HG64056
2026-03-27 10:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f68b3c0-8911-50b9-b54f-b15889e2dfa0 with identifier: HG64056 to the API
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:44:04Z',
'fuel_type': 'petrol',
'id': '6f68b3c0-8911-50b9-b54f-b15889e2dfa0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG64056',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 139940,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-03',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 FSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2010}
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG64056%27 HTTP/1.1" 200 None
2026-03-27 10:37:12 [auto1.de] INFO: Saving data for HG64056: {'auction_closing_time': 1774716244.0, 'created_time': 1773660014.792979, 'last_price_update_time': 1774607832.923376}
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG64056') HTTP/1.1" 204 0
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be030610>
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31069b09-bcbe-5f7f-8091-09b5f344c033/31069b09-bcbe-5f7f-8091-09b5f344c033_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F87%252F1b875f0738c98d29e7991d37de933974%252Fpa%252FFZ93202_d70898277d96802291459df8c2c59435.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_d70898277d96802291459df8c2c59435.jpg saved to cache
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31069b09-bcbe-5f7f-8091-09b5f344c033
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be105c50>
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_c321a3503b227d358596296c8d4bc9c5.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_c321a3503b227d358596296c8d4bc9c5.jpg saved to cache
2026-03-27 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d4c1b93f-5b90-55e1-a318-40937b4c67bc
2026-03-27 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_6beacc3b0f8e3e0d63db42269db141b7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_ccf8e9572eb9283717bf2435d2cf5bec.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_f25eb1ddb9c822069fd62d0b139ff216.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:13 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-27 10:37:13 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-27 10:37:13 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-27 10:37:13 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK39186%27 HTTP/1.1" 200 None
2026-03-27 10:37:13 [auto1.de] INFO: Scrape type for PK39186: 2
2026-03-27 10:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4158606e-e4a8-564d-8d85-912f6be14261 with identifier: PK39186
2026-03-27 10:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4158606e-e4a8-564d-8d85-912f6be14261 with scrape type 2
2026-03-27 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4158606e-e4a8-564d-8d85-912f6be14261 with scrape type 2
2026-03-27 10:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4158606e-e4a8-564d-8d85-912f6be14261, identifier: PK39186
2026-03-27 10:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4158606e-e4a8-564d-8d85-912f6be14261 with identifier: PK39186
2026-03-27 10:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4158606e-e4a8-564d-8d85-912f6be14261 with identifier: PK39186
2026-03-27 10:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4158606e-e4a8-564d-8d85-912f6be14261 with identifier: PK39186 to the API
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-28T16:17:03Z',
'fuel_type': 'petrol',
'id': '4158606e-e4a8-564d-8d85-912f6be14261',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK39186',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 70379,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-21',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2021}
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK39186%27 HTTP/1.1" 200 None
2026-03-27 10:37:13 [auto1.de] INFO: Saving data for PK39186: {'auction_closing_time': 1774714623.0, 'created_time': 1774292004.598575, 'last_price_update_time': 1774607833.79074}
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK39186') HTTP/1.1" 204 0
2026-03-27 10:37:13 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-27 10:37:13 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-27 10:37:13 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-27 10:37:13 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE81869%27 HTTP/1.1" 200 None
2026-03-27 10:37:13 [auto1.de] INFO: Scrape type for YE81869: 2
2026-03-27 10:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6fb1fd1-f457-5987-ab8c-66c45c13f8a8 with identifier: YE81869
2026-03-27 10:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6fb1fd1-f457-5987-ab8c-66c45c13f8a8 with scrape type 2
2026-03-27 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6fb1fd1-f457-5987-ab8c-66c45c13f8a8 with scrape type 2
2026-03-27 10:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6fb1fd1-f457-5987-ab8c-66c45c13f8a8, identifier: YE81869
2026-03-27 10:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3c20ecd-2036-53bb-aae1-3f76fc3d8d32 with identifier: UN23019
2026-03-27 10:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c20ecd-2036-53bb-aae1-3f76fc3d8d32 with scrape type 1
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b3c20ecd-2036-53bb-aae1-3f76fc3d8d32
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_91fec5905975f433244931559e27f673.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_91fec5905975f433244931559e27f673.jpg not downloaded yet
2026-03-27 10:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 501382d5-04e2-57da-ae31-a89e85756b31 with identifier: JS49483
2026-03-27 10:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 501382d5-04e2-57da-ae31-a89e85756b31 with scrape type 1
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 501382d5-04e2-57da-ae31-a89e85756b31
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_a5d02a9e8dbf0c0f574ebcad597ea739.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_a5d02a9e8dbf0c0f574ebcad597ea739.jpg not downloaded yet
2026-03-27 10:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae156ef9-371c-5370-bf9d-2c672c632ab4 with identifier: ZV33449
2026-03-27 10:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae156ef9-371c-5370-bf9d-2c672c632ab4 with scrape type 1
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae156ef9-371c-5370-bf9d-2c672c632ab4
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a63dde3f13f15b337ce6f3066a0ec6%252Fpa%252FZV33449_b541891e6b68729308d6e727ac151fec.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_b541891e6b68729308d6e727ac151fec.jpg already downloaded
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a63dde3f13f15b337ce6f3066a0ec6%252Fpa%252FZV33449_bf604b0d80cf32cc474e32b5726b903b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_bf604b0d80cf32cc474e32b5726b903b.jpg already downloaded
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a63dde3f13f15b337ce6f3066a0ec6%252Fpa%252FZV33449_972a5c6dc779a6764bb474a6c5474c58.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_972a5c6dc779a6764bb474a6c5474c58.jpg already downloaded
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a63dde3f13f15b337ce6f3066a0ec6%252Fpa%252FZV33449_49274b60a787602c9c0c76a4cc4e3070.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_49274b60a787602c9c0c76a4cc4e3070.jpg already downloaded
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a63dde3f13f15b337ce6f3066a0ec6%252Fpa%252FZV33449_6da5dcf413afb7996f02f95e72cf8042.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_6da5dcf413afb7996f02f95e72cf8042.jpg already downloaded
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a63dde3f13f15b337ce6f3066a0ec6%252Fpa%252FZV33449_ae670775dbdfe3ba7cb6a43457358b34.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_ae670775dbdfe3ba7cb6a43457358b34.jpg already downloaded
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a63dde3f13f15b337ce6f3066a0ec6%252Fpa%252FZV33449_ae1984104d1284f5c9617e01fb2fd319.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_ae1984104d1284f5c9617e01fb2fd319.jpg already downloaded
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a63dde3f13f15b337ce6f3066a0ec6%252Fpa%252FZV33449_8fcf6e4b9bc1031b313a9e3e2003a64d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_8fcf6e4b9bc1031b313a9e3e2003a64d.jpg already downloaded
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a63dde3f13f15b337ce6f3066a0ec6%252Fpa%252FZV33449_ddc63c5cc0bd5e9b14cf48ef172e2812.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_ddc63c5cc0bd5e9b14cf48ef172e2812.jpg already downloaded
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fa6%252F92a63dde3f13f15b337ce6f3066a0ec6%252Fpa%252FZV33449_1f370cb4d6206fb1c2d3cd4da7410f54.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_1f370cb4d6206fb1c2d3cd4da7410f54.jpg already downloaded
2026-03-27 10:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae156ef9-371c-5370-bf9d-2c672c632ab4, identifier: ZV33449
2026-03-27 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_cd25d8c07254333041457bbd35a7bd7a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6fb1fd1-f457-5987-ab8c-66c45c13f8a8 with identifier: YE81869
2026-03-27 10:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6fb1fd1-f457-5987-ab8c-66c45c13f8a8 with identifier: YE81869
2026-03-27 10:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6fb1fd1-f457-5987-ab8c-66c45c13f8a8 with identifier: YE81869 to the API
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:11:47Z',
'fuel_type': 'petrol',
'id': 'f6fb1fd1-f457-5987-ab8c-66c45c13f8a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE81869',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 227204,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-02',
'seller_name': None,
'title': 'Volkswagen Passat 1.4 TSI ACT Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2015}
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE81869%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [auto1.de] INFO: Saving data for YE81869: {'auction_closing_time': 1774714307.0, 'created_time': 1773469073.781054, 'last_price_update_time': 1774607834.77272}
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE81869') HTTP/1.1" 204 0
2026-03-27 10:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae156ef9-371c-5370-bf9d-2c672c632ab4 with identifier: ZV33449
2026-03-27 10:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae156ef9-371c-5370-bf9d-2c672c632ab4 with identifier: ZV33449
2026-03-27 10:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae156ef9-371c-5370-bf9d-2c672c632ab4 with identifier: ZV33449 to the API
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZV33449>
{'auction_title': '',
'c_o_2_emission_value': 246,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '3.0L',
'engine_horse_power': 230,
'expiration_date': '2026-03-28T16:25:40Z',
'fuel_type': 'diesel',
'id': 'ae156ef9-371c-5370-bf9d-2c672c632ab4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV33449',
'listing': 'auction',
'location': 'DE, Erbach',
'make': 'Mercedes-Benz',
'model': 'M-Klasse',
'odometer': 230861,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_b541891e6b68729308d6e727ac151fec.jpg',
'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_bf604b0d80cf32cc474e32b5726b903b.jpg',
'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_972a5c6dc779a6764bb474a6c5474c58.jpg',
'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_49274b60a787602c9c0c76a4cc4e3070.jpg',
'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_6da5dcf413afb7996f02f95e72cf8042.jpg',
'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_ae670775dbdfe3ba7cb6a43457358b34.jpg',
'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_ae1984104d1284f5c9617e01fb2fd319.jpg',
'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_8fcf6e4b9bc1031b313a9e3e2003a64d.jpg',
'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_ddc63c5cc0bd5e9b14cf48ef172e2812.jpg',
'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_1f370cb4d6206fb1c2d3cd4da7410f54.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae156ef9-371c-5370-bf9d-2c672c632ab4/ae156ef9-371c-5370-bf9d-2c672c632ab4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_b541891e6b68729308d6e727ac151fec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae156ef9-371c-5370-bf9d-2c672c632ab4/ae156ef9-371c-5370-bf9d-2c672c632ab4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_bf604b0d80cf32cc474e32b5726b903b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae156ef9-371c-5370-bf9d-2c672c632ab4/ae156ef9-371c-5370-bf9d-2c672c632ab4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82266,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_972a5c6dc779a6764bb474a6c5474c58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae156ef9-371c-5370-bf9d-2c672c632ab4/ae156ef9-371c-5370-bf9d-2c672c632ab4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66491,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_49274b60a787602c9c0c76a4cc4e3070.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae156ef9-371c-5370-bf9d-2c672c632ab4/ae156ef9-371c-5370-bf9d-2c672c632ab4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80288,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_6da5dcf413afb7996f02f95e72cf8042.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae156ef9-371c-5370-bf9d-2c672c632ab4/ae156ef9-371c-5370-bf9d-2c672c632ab4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87279,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_ae670775dbdfe3ba7cb6a43457358b34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae156ef9-371c-5370-bf9d-2c672c632ab4/ae156ef9-371c-5370-bf9d-2c672c632ab4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77304,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_ae1984104d1284f5c9617e01fb2fd319.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae156ef9-371c-5370-bf9d-2c672c632ab4/ae156ef9-371c-5370-bf9d-2c672c632ab4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_8fcf6e4b9bc1031b313a9e3e2003a64d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae156ef9-371c-5370-bf9d-2c672c632ab4/ae156ef9-371c-5370-bf9d-2c672c632ab4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84851,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_ddc63c5cc0bd5e9b14cf48ef172e2812.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae156ef9-371c-5370-bf9d-2c672c632ab4/ae156ef9-371c-5370-bf9d-2c672c632ab4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/a6/92a63dde3f13f15b337ce6f3066a0ec6/pa/ZV33449_1f370cb4d6206fb1c2d3cd4da7410f54.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-08-12',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz M-Klasse ML 350 CDI 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2010}
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV33449%27 HTTP/1.1" 200 None
2026-03-27 10:37:15 [auto1.de] INFO: Saving data for ZV33449: {'created_time': 1774607835.145952, 'last_price_update_time': 1774607835.145964, 'auction_closing_time': 1774715140.0}
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV33449') HTTP/1.1" 204 0
2026-03-27 10:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_c4f06fb4065ab02002670e6809e0f6c2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_2defd5b8d6f81df03d2abec01caa4d75.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:15 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR76257%27 HTTP/1.1" 200 None
2026-03-27 10:37:15 [auto1.de] INFO: Scrape type for LR76257: 2
2026-03-27 10:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dde93fbc-d47f-5bdc-912e-f44c64e7c2a2 with identifier: LR76257
2026-03-27 10:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dde93fbc-d47f-5bdc-912e-f44c64e7c2a2 with scrape type 2
2026-03-27 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dde93fbc-d47f-5bdc-912e-f44c64e7c2a2 with scrape type 2
2026-03-27 10:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dde93fbc-d47f-5bdc-912e-f44c64e7c2a2, identifier: LR76257
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_5046ed9e4c3c96e0e3fb5772b4324099.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_5046ed9e4c3c96e0e3fb5772b4324099.jpg not downloaded yet
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_a82ff8ffb6de9ccc81566b651a3c5e76.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_a82ff8ffb6de9ccc81566b651a3c5e76.jpg not downloaded yet
2026-03-27 10:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dde93fbc-d47f-5bdc-912e-f44c64e7c2a2 with identifier: LR76257
2026-03-27 10:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dde93fbc-d47f-5bdc-912e-f44c64e7c2a2 with identifier: LR76257
2026-03-27 10:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dde93fbc-d47f-5bdc-912e-f44c64e7c2a2 with identifier: LR76257 to the API
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 77,
'expiration_date': '2026-03-28T16:42:14Z',
'fuel_type': 'petrol',
'id': 'dde93fbc-d47f-5bdc-912e-f44c64e7c2a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR76257',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto Evo',
'odometer': 111778,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-30',
'seller_name': None,
'title': 'Fiat Punto Evo 1.4 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2010}
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR76257%27 HTTP/1.1" 200 None
2026-03-27 10:37:15 [auto1.de] INFO: Saving data for LR76257: {'auction_closing_time': 1774716134.0, 'created_time': 1773306784.281635, 'last_price_update_time': 1774607835.657698}
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR76257') HTTP/1.1" 204 0
2026-03-27 10:37:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be29de10>
2026-03-27 10:37:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_6beacc3b0f8e3e0d63db42269db141b7.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_6beacc3b0f8e3e0d63db42269db141b7.jpg saved to cache
2026-03-27 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-03-27 10:37:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4f9850>
2026-03-27 10:37:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_ccf8e9572eb9283717bf2435d2cf5bec.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_ccf8e9572eb9283717bf2435d2cf5bec.jpg saved to cache
2026-03-27 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d4c1b93f-5b90-55e1-a318-40937b4c67bc
2026-03-27 10:37:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf51e950>
2026-03-27 10:37:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_f25eb1ddb9c822069fd62d0b139ff216.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_f25eb1ddb9c822069fd62d0b139ff216.jpg saved to cache
2026-03-27 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-03-27 10:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_7b099fc2e71d354dd27eb66fe26ca224.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:15 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-27 10:37:15 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-27 10:37:15 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-27 10:37:15 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97511%27 HTTP/1.1" 200 None
2026-03-27 10:37:15 [auto1.de] INFO: Scrape type for PF97511: 2
2026-03-27 10:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44034d65-de7f-5afa-806b-4c568deb5a2b with identifier: PF97511
2026-03-27 10:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44034d65-de7f-5afa-806b-4c568deb5a2b with scrape type 2
2026-03-27 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44034d65-de7f-5afa-806b-4c568deb5a2b with scrape type 2
2026-03-27 10:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44034d65-de7f-5afa-806b-4c568deb5a2b, identifier: PF97511
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_d0dc6eb2efb15705501adaa6f7deae77.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_d0dc6eb2efb15705501adaa6f7deae77.jpg not downloaded yet
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_55f17b8d82052ca7dbc01257441013d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_55f17b8d82052ca7dbc01257441013d4.jpg not downloaded yet
2026-03-27 10:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44034d65-de7f-5afa-806b-4c568deb5a2b with identifier: PF97511
2026-03-27 10:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44034d65-de7f-5afa-806b-4c568deb5a2b with identifier: PF97511
2026-03-27 10:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44034d65-de7f-5afa-806b-4c568deb5a2b with identifier: PF97511 to the API
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:29:30Z',
'fuel_type': 'diesel',
'id': '44034d65-de7f-5afa-806b-4c568deb5a2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF97511',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 376988,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-20',
'seller_name': None,
'title': 'Audi A1 Sportback 1.6 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2013}
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97511%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [auto1.de] INFO: Saving data for PF97511: {'auction_closing_time': 1774715370.0, 'created_time': 1773467119.490981, 'last_price_update_time': 1774607836.420397}
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF97511') HTTP/1.1" 204 0
2026-03-27 10:37:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf36dbd0>
2026-03-27 10:37:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_cd25d8c07254333041457bbd35a7bd7a.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_cd25d8c07254333041457bbd35a7bd7a.jpg saved to cache
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-03-27 10:37:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be289f50>
2026-03-27 10:37:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_c4f06fb4065ab02002670e6809e0f6c2.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_c4f06fb4065ab02002670e6809e0f6c2.jpg saved to cache
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d4c1b93f-5b90-55e1-a318-40937b4c67bc
2026-03-27 10:37:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf551f10>
2026-03-27 10:37:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31069b09-bcbe-5f7f-8091-09b5f344c033/31069b09-bcbe-5f7f-8091-09b5f344c033_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F87%252F1b875f0738c98d29e7991d37de933974%252Fpa%252FFZ93202_2defd5b8d6f81df03d2abec01caa4d75.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_2defd5b8d6f81df03d2abec01caa4d75.jpg saved to cache
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31069b09-bcbe-5f7f-8091-09b5f344c033
2026-03-27 10:37:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31069b09-bcbe-5f7f-8091-09b5f344c033, skipping ID generation
2026-03-27 10:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31069b09-bcbe-5f7f-8091-09b5f344c033 with scrape type 1
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31069b09-bcbe-5f7f-8091-09b5f344c033 sending to next pipeline
2026-03-27 10:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31069b09-bcbe-5f7f-8091-09b5f344c033, identifier: FZ93202
2026-03-27 10:37:16 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-27 10:37:16 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG94093%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [auto1.de] INFO: Scrape type for XG94093: 2
2026-03-27 10:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afcbe0b8-d993-516d-b47a-f969a069e018 with identifier: XG94093
2026-03-27 10:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afcbe0b8-d993-516d-b47a-f969a069e018 with scrape type 2
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afcbe0b8-d993-516d-b47a-f969a069e018 with scrape type 2
2026-03-27 10:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afcbe0b8-d993-516d-b47a-f969a069e018, identifier: XG94093
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_f8bbcd6357114bb7c853cfac034db7de.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_f8bbcd6357114bb7c853cfac034db7de.jpg not downloaded yet
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_91f2ee0de11c5b0e5785117cd19560ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_91f2ee0de11c5b0e5785117cd19560ed.jpg not downloaded yet
2026-03-27 10:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31069b09-bcbe-5f7f-8091-09b5f344c033 with identifier: FZ93202
2026-03-27 10:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31069b09-bcbe-5f7f-8091-09b5f344c033 with identifier: FZ93202
2026-03-27 10:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31069b09-bcbe-5f7f-8091-09b5f344c033 with identifier: FZ93202 to the API
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_2defd5b8d6f81df03d2abec01caa4d75.jpg>
{'auction_title': '',
'c_o_2_emission_value': 220,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 158,
'expiration_date': '2026-03-28T16:13:15Z',
'fuel_type': 'petrol',
'id': '31069b09-bcbe-5f7f-8091-09b5f344c033',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ93202',
'listing': 'auction',
'location': 'DE, Mülheim an der Ruhr',
'make': 'Subaru',
'model': 'Forester',
'odometer': 159776,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31069b09-bcbe-5f7f-8091-09b5f344c033/31069b09-bcbe-5f7f-8091-09b5f344c033_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85216,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_e2f45ede7a227c6ccd377699c13beff0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31069b09-bcbe-5f7f-8091-09b5f344c033/31069b09-bcbe-5f7f-8091-09b5f344c033_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_5bb5b9727f93a914c14af7a5686ddb58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31069b09-bcbe-5f7f-8091-09b5f344c033/31069b09-bcbe-5f7f-8091-09b5f344c033_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101081,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_cf47cc8d5b3bdc41d08b7f1fcdb32e14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31069b09-bcbe-5f7f-8091-09b5f344c033/31069b09-bcbe-5f7f-8091-09b5f344c033_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66524,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_2defd5b8d6f81df03d2abec01caa4d75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31069b09-bcbe-5f7f-8091-09b5f344c033/31069b09-bcbe-5f7f-8091-09b5f344c033_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154617,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/87/1b875f0738c98d29e7991d37de933974/pa/FZ93202_d70898277d96802291459df8c2c59435.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-04-11',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Forester 2.0 X Active',
'transmission': 'automatic',
'trim': 'X Active',
'year': 2007}
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ93202%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [auto1.de] INFO: Saving data for FZ93202: {'created_time': 1774607837.2006, 'last_price_update_time': 1774607837.200613, 'auction_closing_time': 1774714395.0}
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ93202') HTTP/1.1" 204 0
2026-03-27 10:37:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_4571440e12c026efd213b6313e6b556a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_9c5c4f8f46c263ca5094ab45597395bc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afcbe0b8-d993-516d-b47a-f969a069e018 with identifier: XG94093
2026-03-27 10:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afcbe0b8-d993-516d-b47a-f969a069e018 with identifier: XG94093
2026-03-27 10:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afcbe0b8-d993-516d-b47a-f969a069e018 with identifier: XG94093 to the API
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:24:00Z',
'fuel_type': 'petrol',
'id': 'afcbe0b8-d993-516d-b47a-f969a069e018',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG94093',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 84378,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-08',
'seller_name': None,
'title': 'Hyundai i20 1.2 Select',
'transmission': 'manual',
'trim': 'Select',
'year': 2020}
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG94093%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [auto1.de] INFO: Saving data for XG94093: {'auction_closing_time': 1774715040.0, 'created_time': 1773830935.366758, 'last_price_update_time': 1774607837.687724}
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG94093') HTTP/1.1" 204 0
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_aa950dd0f216c068f357392df0e59486.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_aa950dd0f216c068f357392df0e59486.jpg not downloaded yet
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_9d1d5651e726fd005abd038d36a62e26.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_9d1d5651e726fd005abd038d36a62e26.jpg not downloaded yet
2026-03-27 10:37:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0157d0>
2026-03-27 10:37:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_7b099fc2e71d354dd27eb66fe26ca224.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_7b099fc2e71d354dd27eb66fe26ca224.jpg saved to cache
2026-03-27 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-03-27 10:37:17 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 10502 | hits on page: 40
2026-03-27 10:37:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_9e88c780123818ba5c60ce8357717029.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_5cea3afafc3fcd4986156993b092bb16.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_5cea3afafc3fcd4986156993b092bb16.jpg not downloaded yet
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_f62dae36ced97885f4d166db36666031.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_f62dae36ced97885f4d166db36666031.jpg not downloaded yet
2026-03-27 10:37:17 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-27 10:37:17 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00306%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [auto1.de] INFO: Scrape type for HX00306: 2
2026-03-27 10:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45e19cd1-bafb-5783-877a-afdf277ea06e with identifier: HX00306
2026-03-27 10:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e19cd1-bafb-5783-877a-afdf277ea06e with scrape type 2
2026-03-27 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45e19cd1-bafb-5783-877a-afdf277ea06e with scrape type 2
2026-03-27 10:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45e19cd1-bafb-5783-877a-afdf277ea06e, identifier: HX00306
2026-03-27 10:37:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf077d0>
2026-03-27 10:37:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_4571440e12c026efd213b6313e6b556a.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_4571440e12c026efd213b6313e6b556a.jpg saved to cache
2026-03-27 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4c1b93f-5b90-55e1-a318-40937b4c67bc
2026-03-27 10:37:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c561e0d0>
2026-03-27 10:37:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_9c5c4f8f46c263ca5094ab45597395bc.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_9c5c4f8f46c263ca5094ab45597395bc.jpg saved to cache
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d4c1b93f-5b90-55e1-a318-40937b4c67bc
2026-03-27 10:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_b8c8b960bf0b93ae52ee69e365b324eb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45e19cd1-bafb-5783-877a-afdf277ea06e with identifier: HX00306
2026-03-27 10:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45e19cd1-bafb-5783-877a-afdf277ea06e with identifier: HX00306
2026-03-27 10:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45e19cd1-bafb-5783-877a-afdf277ea06e with identifier: HX00306 to the API
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:45:58Z',
'fuel_type': 'diesel',
'id': '45e19cd1-bafb-5783-877a-afdf277ea06e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX00306',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 355675,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-21',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2010}
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00306%27 HTTP/1.1" 200 None
2026-03-27 10:37:18 [auto1.de] INFO: Saving data for HX00306: {'auction_closing_time': 1774716358.0, 'created_time': 1773687000.774716, 'last_price_update_time': 1774607838.387697}
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX00306') HTTP/1.1" 204 0
2026-03-27 10:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_3e3bfd475fcf4907d32e1cbdea0705b8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_c81577ba4dde551e676afb07ad1b305d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_c81577ba4dde551e676afb07ad1b305d.jpg not downloaded yet
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_85cfe46d05cc2db4f0eafe3c9a13c41b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_85cfe46d05cc2db4f0eafe3c9a13c41b.jpg not downloaded yet
2026-03-27 10:37:18 [auto1.de] INFO: Found listing with ID: DT83749
2026-03-27 10:37:18 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK87583%27 HTTP/1.1" 200 None
2026-03-27 10:37:18 [auto1.de] INFO: Scrape type for XK87583: 2
2026-03-27 10:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d with identifier: XK87583
2026-03-27 10:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d with scrape type 2
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d with scrape type 2
2026-03-27 10:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d, identifier: XK87583
2026-03-27 10:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_362781f0dffea85fd31f40cd950a1e22.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d with identifier: XK87583
2026-03-27 10:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d with identifier: XK87583
2026-03-27 10:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d with identifier: XK87583 to the API
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-28T16:45:30Z',
'fuel_type': 'diesel',
'id': 'ab9f8e59-56aa-5236-a42e-67e2ff8c4b1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK87583',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 209117,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-13',
'seller_name': None,
'title': 'BMW 3er 330d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2014}
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK87583%27 HTTP/1.1" 200 None
2026-03-27 10:37:18 [auto1.de] INFO: Saving data for XK87583: {'auction_closing_time': 1774716330.0, 'created_time': 1773775519.798467, 'last_price_update_time': 1774607838.910383}
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK87583') HTTP/1.1" 204 0
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf1af50>
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1320fc40-bba8-5bfd-9d6c-41e790b295bd/1320fc40-bba8-5bfd-9d6c-41e790b295bd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0c953a3431b015551430325b04ec80%252Fpa%252FHB67521_9e88c780123818ba5c60ce8357717029.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_9e88c780123818ba5c60ce8357717029.jpg saved to cache
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1320fc40-bba8-5bfd-9d6c-41e790b295bd
2026-03-27 10:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_b61213056ad73ddbb5b6e6247fa874ab.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_aa9276a589a91bc4e997ccf31a44b2a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_aa9276a589a91bc4e997ccf31a44b2a5.jpg not downloaded yet
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_c738fc8de952890b6e3163a8bb112655.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_c738fc8de952890b6e3163a8bb112655.jpg not downloaded yet
2026-03-27 10:37:19 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU26229%27 HTTP/1.1" 200 None
2026-03-27 10:37:19 [auto1.de] INFO: Scrape type for PU26229: 2
2026-03-27 10:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7b8a3b0-afa1-5551-9113-b3158158a271 with identifier: PU26229
2026-03-27 10:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7b8a3b0-afa1-5551-9113-b3158158a271 with scrape type 2
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7b8a3b0-afa1-5551-9113-b3158158a271 with scrape type 2
2026-03-27 10:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7b8a3b0-afa1-5551-9113-b3158158a271, identifier: PU26229
2026-03-27 10:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7b8a3b0-afa1-5551-9113-b3158158a271 with identifier: PU26229
2026-03-27 10:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7b8a3b0-afa1-5551-9113-b3158158a271 with identifier: PU26229
2026-03-27 10:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7b8a3b0-afa1-5551-9113-b3158158a271 with identifier: PU26229 to the API
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 367,
'expiration_date': '2026-03-28T16:00:43Z',
'fuel_type': 'petrol',
'id': 'f7b8a3b0-afa1-5551-9113-b3158158a271',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU26229',
'listing': 'auction',
'make': 'Audi',
'model': 'RS Q3',
'odometer': 156661,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-27',
'seller_name': None,
'title': 'Audi RS Q3 2.5 TFSI quattro Performance',
'transmission': 'automatic',
'trim': 'quattro Performance',
'year': 2016}
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU26229%27 HTTP/1.1" 200 None
2026-03-27 10:37:19 [auto1.de] INFO: Saving data for PU26229: {'auction_closing_time': 1774713643.0, 'created_time': 1774292341.265369, 'last_price_update_time': 1774607839.535058}
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU26229') HTTP/1.1" 204 0
2026-03-27 10:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_a82ff8ffb6de9ccc81566b651a3c5e76.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_afb774b5694db0b4631adacd6d9dbdc3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_afb774b5694db0b4631adacd6d9dbdc3.jpg not downloaded yet
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_af0f8546c01e5a5c064c7df625bc606c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_af0f8546c01e5a5c064c7df625bc606c.jpg not downloaded yet
2026-03-27 10:37:19 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-27 10:37:19 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14818%27 HTTP/1.1" 200 None
2026-03-27 10:37:19 [auto1.de] INFO: Scrape type for VX14818: 2
2026-03-27 10:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1 with identifier: VX14818
2026-03-27 10:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1 with scrape type 2
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1 with scrape type 2
2026-03-27 10:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1, identifier: VX14818
2026-03-27 10:37:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5657010>
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F66%252Fbb667781ac809b82904a0367f578062e%252Fpa%252FSD86365_b8c8b960bf0b93ae52ee69e365b324eb.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_b8c8b960bf0b93ae52ee69e365b324eb.jpg saved to cache
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f
2026-03-27 10:37:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f, skipping ID generation
2026-03-27 10:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f with scrape type 1
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f sending to next pipeline
2026-03-27 10:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f, identifier: SD86365
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3dcb90>
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_3e3bfd475fcf4907d32e1cbdea0705b8.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_3e3bfd475fcf4907d32e1cbdea0705b8.jpg saved to cache
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4c1b93f-5b90-55e1-a318-40937b4c67bc
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1b9d10>
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_362781f0dffea85fd31f40cd950a1e22.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_362781f0dffea85fd31f40cd950a1e22.jpg saved to cache
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-03-27 10:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_91fec5905975f433244931559e27f673.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1 with identifier: VX14818
2026-03-27 10:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1 with identifier: VX14818
2026-03-27 10:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a87f512-0a7f-5131-9ee0-e5d1de9e35c1 with identifier: VX14818 to the API
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 87,
'expiration_date': '2026-03-28T16:18:59Z',
'fuel_type': 'petrol',
'id': '0a87f512-0a7f-5131-9ee0-e5d1de9e35c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX14818',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 115326,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-21',
'seller_name': None,
'title': 'Opel Corsa 1.4 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2013}
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14818%27 HTTP/1.1" 200 None
2026-03-27 10:37:20 [auto1.de] INFO: Saving data for VX14818: {'auction_closing_time': 1774714739.0, 'created_time': 1773775608.932776, 'last_price_update_time': 1774607840.389847}
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX14818') HTTP/1.1" 204 0
2026-03-27 10:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f with identifier: SD86365
2026-03-27 10:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f with identifier: SD86365
2026-03-27 10:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 823f3697-7e54-5ca7-8bc2-9b9aef41ab8f with identifier: SD86365 to the API
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_b8c8b960bf0b93ae52ee69e365b324eb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:44:51Z',
'fuel_type': 'petrol',
'id': '823f3697-7e54-5ca7-8bc2-9b9aef41ab8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD86365',
'listing': 'auction',
'location': 'DE, Berlin',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 22707,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3164854,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_88e1fc1eafb22be58577827be3e7e402.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40072,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_25aea0a02fca716a4a1b7ab703ae15c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2482962,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_b8c8b960bf0b93ae52ee69e365b324eb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_a434afad984575739ae3f7bbb6f9ecee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77518,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_9bcdb0a465b0ed7b2955001436b54841.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_697b54daf561678c68d0ed45b7f6afe1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2450754,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_51ede349574740c65a7b596446615824.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2173769,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_6768974e4cff9d5f5ed08b60adf23411.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89234,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_54f8feb63a55fdb65e4531e3b7415fb1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823f3697-7e54-5ca7-8bc2-9b9aef41ab8f/823f3697-7e54-5ca7-8bc2-9b9aef41ab8f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78076,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/66/bb667781ac809b82904a0367f578062e/pa/SD86365_333f08044161da4d7e7ae4d984c20def.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-01-16',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2023}
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD86365%27 HTTP/1.1" 200 None
2026-03-27 10:37:20 [auto1.de] INFO: Saving data for SD86365: {'created_time': 1774607840.816728, 'last_price_update_time': 1774607840.81674, 'auction_closing_time': 1774716291.0}
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD86365') HTTP/1.1" 204 0
2026-03-27 10:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_5046ed9e4c3c96e0e3fb5772b4324099.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_f073cc93305b37ffa4b3ac438ffe6940.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_f073cc93305b37ffa4b3ac438ffe6940.jpg not downloaded yet
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_c97ab930803ab545ebff47cf63f25c96.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_c97ab930803ab545ebff47cf63f25c96.jpg not downloaded yet
2026-03-27 10:37:20 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-27 10:37:20 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-27 10:37:20 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD70281%27 HTTP/1.1" 200 None
2026-03-27 10:37:20 [auto1.de] INFO: Scrape type for DD70281: 2
2026-03-27 10:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52e7d1b2-4ac5-573e-a457-f4cba539924f with identifier: DD70281
2026-03-27 10:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52e7d1b2-4ac5-573e-a457-f4cba539924f with scrape type 2
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52e7d1b2-4ac5-573e-a457-f4cba539924f with scrape type 2
2026-03-27 10:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52e7d1b2-4ac5-573e-a457-f4cba539924f, identifier: DD70281
2026-03-27 10:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG97349/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5b26d0>
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_b61213056ad73ddbb5b6e6247fa874ab.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_b61213056ad73ddbb5b6e6247fa874ab.jpg saved to cache
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4c1b93f-5b90-55e1-a318-40937b4c67bc
2026-03-27 10:37:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_91f2ee0de11c5b0e5785117cd19560ed.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52e7d1b2-4ac5-573e-a457-f4cba539924f with identifier: DD70281
2026-03-27 10:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52e7d1b2-4ac5-573e-a457-f4cba539924f with identifier: DD70281
2026-03-27 10:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52e7d1b2-4ac5-573e-a457-f4cba539924f with identifier: DD70281 to the API
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:29:25Z',
'fuel_type': 'diesel',
'id': '52e7d1b2-4ac5-573e-a457-f4cba539924f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD70281',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 216354,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-30',
'seller_name': None,
'title': 'Renault Scenic 1.6 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2011}
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD70281%27 HTTP/1.1" 200 None
2026-03-27 10:37:22 [auto1.de] INFO: Saving data for DD70281: {'auction_closing_time': 1774715365.0, 'created_time': 1773662296.665719, 'last_price_update_time': 1774607842.014629}
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD70281') HTTP/1.1" 204 0
2026-03-27 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_c96bc11fac22c4e5ec8dba5eb2687dc6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:22 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS36397%27 HTTP/1.1" 200 None
2026-03-27 10:37:22 [auto1.de] INFO: Scrape type for LS36397: 2
2026-03-27 10:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25a82215-c99f-5e78-b533-ee6f3f56b44c with identifier: LS36397
2026-03-27 10:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25a82215-c99f-5e78-b533-ee6f3f56b44c with scrape type 2
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25a82215-c99f-5e78-b533-ee6f3f56b44c with scrape type 2
2026-03-27 10:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25a82215-c99f-5e78-b533-ee6f3f56b44c, identifier: LS36397
2026-03-27 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_9d1d5651e726fd005abd038d36a62e26.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25a82215-c99f-5e78-b533-ee6f3f56b44c with identifier: LS36397
2026-03-27 10:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25a82215-c99f-5e78-b533-ee6f3f56b44c with identifier: LS36397
2026-03-27 10:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25a82215-c99f-5e78-b533-ee6f3f56b44c with identifier: LS36397 to the API
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:36:13Z',
'fuel_type': 'diesel',
'id': '25a82215-c99f-5e78-b533-ee6f3f56b44c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS36397',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 116947,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-28',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.0 TDI Comfortline',
'transmission': 'automatic',
'trim': 'Comfortline',
'year': 2015}
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS36397%27 HTTP/1.1" 200 None
2026-03-27 10:37:22 [auto1.de] INFO: Saving data for LS36397: {'auction_closing_time': 1774715773.0, 'created_time': 1773399028.614564, 'last_price_update_time': 1774607842.592126}
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS36397') HTTP/1.1" 204 0
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e8bd0>
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_a82ff8ffb6de9ccc81566b651a3c5e76.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_a82ff8ffb6de9ccc81566b651a3c5e76.jpg saved to cache
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 501382d5-04e2-57da-ae31-a89e85756b31
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be160550>
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_91fec5905975f433244931559e27f673.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_91fec5905975f433244931559e27f673.jpg saved to cache
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3c20ecd-2036-53bb-aae1-3f76fc3d8d32
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0b1250>
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_5046ed9e4c3c96e0e3fb5772b4324099.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_5046ed9e4c3c96e0e3fb5772b4324099.jpg saved to cache
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3c20ecd-2036-53bb-aae1-3f76fc3d8d32
2026-03-27 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_f8bbcd6357114bb7c853cfac034db7de.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:22 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39643%27 HTTP/1.1" 200 None
2026-03-27 10:37:22 [auto1.de] INFO: Scrape type for ZR39643: 2
2026-03-27 10:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbf69fe3-72fa-518b-85bc-30f2c413c9ff with identifier: ZR39643
2026-03-27 10:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbf69fe3-72fa-518b-85bc-30f2c413c9ff with scrape type 2
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbf69fe3-72fa-518b-85bc-30f2c413c9ff with scrape type 2
2026-03-27 10:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbf69fe3-72fa-518b-85bc-30f2c413c9ff, identifier: ZR39643
2026-03-27 10:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbf69fe3-72fa-518b-85bc-30f2c413c9ff with identifier: ZR39643
2026-03-27 10:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbf69fe3-72fa-518b-85bc-30f2c413c9ff with identifier: ZR39643
2026-03-27 10:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbf69fe3-72fa-518b-85bc-30f2c413c9ff with identifier: ZR39643 to the API
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:41:40Z',
'fuel_type': 'diesel',
'id': 'cbf69fe3-72fa-518b-85bc-30f2c413c9ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR39643',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 310704,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-02',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 TDI Maxi Roncalli',
'transmission': 'manual',
'trim': 'Maxi Roncalli',
'year': 2012}
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39643%27 HTTP/1.1" 200 None
2026-03-27 10:37:23 [auto1.de] INFO: Saving data for ZR39643: {'auction_closing_time': 1774716100.0, 'created_time': 1773859552.325996, 'last_price_update_time': 1774607843.460044}
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR39643') HTTP/1.1" 204 0
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5377550>
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_91f2ee0de11c5b0e5785117cd19560ed.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_91f2ee0de11c5b0e5785117cd19560ed.jpg saved to cache
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 501382d5-04e2-57da-ae31-a89e85756b31
2026-03-27 10:37:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf58bfd0>
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_c96bc11fac22c4e5ec8dba5eb2687dc6.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_c96bc11fac22c4e5ec8dba5eb2687dc6.jpg saved to cache
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcf531ae-96c1-569c-a7c7-f12a6e59abd6
2026-03-27 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_85cfe46d05cc2db4f0eafe3c9a13c41b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_f62dae36ced97885f4d166db36666031.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:23 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM98964%27 HTTP/1.1" 200 None
2026-03-27 10:37:23 [auto1.de] INFO: Scrape type for LM98964: 2
2026-03-27 10:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a9b852c-e3fa-510a-8343-cfaba76a51c7 with identifier: LM98964
2026-03-27 10:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a9b852c-e3fa-510a-8343-cfaba76a51c7 with scrape type 2
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a9b852c-e3fa-510a-8343-cfaba76a51c7 with scrape type 2
2026-03-27 10:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a9b852c-e3fa-510a-8343-cfaba76a51c7, identifier: LM98964
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1c7bd0>
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_9d1d5651e726fd005abd038d36a62e26.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_9d1d5651e726fd005abd038d36a62e26.jpg saved to cache
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 501382d5-04e2-57da-ae31-a89e85756b31
2026-03-27 10:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a9b852c-e3fa-510a-8343-cfaba76a51c7 with identifier: LM98964
2026-03-27 10:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a9b852c-e3fa-510a-8343-cfaba76a51c7 with identifier: LM98964
2026-03-27 10:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a9b852c-e3fa-510a-8343-cfaba76a51c7 with identifier: LM98964 to the API
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:41:07Z',
'fuel_type': 'petrol',
'id': '9a9b852c-e3fa-510a-8343-cfaba76a51c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM98964',
'listing': 'auction',
'make': 'Opel',
'model': 'Cascada',
'odometer': 81450,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-01',
'seller_name': None,
'title': 'Opel Cascada 1.4 Turbo Innovation ecoFlex',
'transmission': 'manual',
'trim': 'Innovation ecoFlex',
'year': 2014}
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM98964%27 HTTP/1.1" 200 None
2026-03-27 10:37:24 [auto1.de] INFO: Saving data for LM98964: {'auction_closing_time': 1774716067.0, 'created_time': 1773776027.311036, 'last_price_update_time': 1774607844.341483}
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM98964') HTTP/1.1" 204 0
2026-03-27 10:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_c738fc8de952890b6e3163a8bb112655.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:24 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-27 10:37:24 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-27 10:37:24 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR04535%27 HTTP/1.1" 200 None
2026-03-27 10:37:24 [auto1.de] INFO: Scrape type for KR04535: 2
2026-03-27 10:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5189051-2f00-574e-8578-3a2ccbf9f416 with identifier: KR04535
2026-03-27 10:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5189051-2f00-574e-8578-3a2ccbf9f416 with scrape type 2
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5189051-2f00-574e-8578-3a2ccbf9f416 with scrape type 2
2026-03-27 10:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5189051-2f00-574e-8578-3a2ccbf9f416, identifier: KR04535
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf39fe10>
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_f8bbcd6357114bb7c853cfac034db7de.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_f8bbcd6357114bb7c853cfac034db7de.jpg saved to cache
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3c20ecd-2036-53bb-aae1-3f76fc3d8d32
2026-03-27 10:37:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5189051-2f00-574e-8578-3a2ccbf9f416 with identifier: KR04535
2026-03-27 10:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5189051-2f00-574e-8578-3a2ccbf9f416 with identifier: KR04535
2026-03-27 10:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5189051-2f00-574e-8578-3a2ccbf9f416 with identifier: KR04535 to the API
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:49:06Z',
'fuel_type': 'petrol',
'id': 'b5189051-2f00-574e-8578-3a2ccbf9f416',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR04535',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 174737,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-05',
'seller_name': None,
'title': 'Nissan Qashqai 2.0 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2011}
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR04535%27 HTTP/1.1" 200 None
2026-03-27 10:37:24 [auto1.de] INFO: Saving data for KR04535: {'auction_closing_time': 1774716546.0, 'created_time': 1773427325.088636, 'last_price_update_time': 1774607844.917011}
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR04535') HTTP/1.1" 204 0
2026-03-27 10:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_af0f8546c01e5a5c064c7df625bc606c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_afb774b5694db0b4631adacd6d9dbdc3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:24 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-27 10:37:24 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-27 10:37:24 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM33145%27 HTTP/1.1" 200 None
2026-03-27 10:37:24 [auto1.de] INFO: Scrape type for CM33145: 2
2026-03-27 10:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0db03aed-3932-5b8c-9129-44c0083c47f9 with identifier: CM33145
2026-03-27 10:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0db03aed-3932-5b8c-9129-44c0083c47f9 with scrape type 2
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0db03aed-3932-5b8c-9129-44c0083c47f9 with scrape type 2
2026-03-27 10:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0db03aed-3932-5b8c-9129-44c0083c47f9, identifier: CM33145
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf31790>
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_85cfe46d05cc2db4f0eafe3c9a13c41b.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_85cfe46d05cc2db4f0eafe3c9a13c41b.jpg saved to cache
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 501382d5-04e2-57da-ae31-a89e85756b31
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b0650>
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_f62dae36ced97885f4d166db36666031.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_f62dae36ced97885f4d166db36666031.jpg saved to cache
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 501382d5-04e2-57da-ae31-a89e85756b31
2026-03-27 10:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0db03aed-3932-5b8c-9129-44c0083c47f9 with identifier: CM33145
2026-03-27 10:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0db03aed-3932-5b8c-9129-44c0083c47f9 with identifier: CM33145
2026-03-27 10:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0db03aed-3932-5b8c-9129-44c0083c47f9 with identifier: CM33145 to the API
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-28T16:03:45Z',
'fuel_type': 'petrol',
'id': '0db03aed-3932-5b8c-9129-44c0083c47f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM33145',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 124763,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-30',
'seller_name': None,
'title': 'BMW 1er 118i',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM33145%27 HTTP/1.1" 200 None
2026-03-27 10:37:25 [auto1.de] INFO: Saving data for CM33145: {'auction_closing_time': 1774713825.0, 'created_time': 1773859966.916989, 'last_price_update_time': 1774607845.559704}
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM33145') HTTP/1.1" 204 0
2026-03-27 10:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2c61d0>
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_c738fc8de952890b6e3163a8bb112655.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_c738fc8de952890b6e3163a8bb112655.jpg saved to cache
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 501382d5-04e2-57da-ae31-a89e85756b31
2026-03-27 10:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_aa9276a589a91bc4e997ccf31a44b2a5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:25 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE91450%27 HTTP/1.1" 200 None
2026-03-27 10:37:25 [auto1.de] INFO: Scrape type for PE91450: 2
2026-03-27 10:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adc36cff-999e-5178-a979-7747d1f01eca with identifier: PE91450
2026-03-27 10:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adc36cff-999e-5178-a979-7747d1f01eca with scrape type 2
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adc36cff-999e-5178-a979-7747d1f01eca with scrape type 2
2026-03-27 10:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adc36cff-999e-5178-a979-7747d1f01eca, identifier: PE91450
2026-03-27 10:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_c81577ba4dde551e676afb07ad1b305d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adc36cff-999e-5178-a979-7747d1f01eca with identifier: PE91450
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-27 10:37:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adc36cff-999e-5178-a979-7747d1f01eca with identifier: PE91450
2026-03-27 10:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adc36cff-999e-5178-a979-7747d1f01eca with identifier: PE91450 to the API
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-28T16:29:23Z',
'fuel_type': 'petrol',
'id': 'adc36cff-999e-5178-a979-7747d1f01eca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE91450',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 81833,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-16',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 Edition 2020 AMG Line',
'transmission': 'automatic',
'trim': 'Edition 2020 AMG Line',
'year': 2021}
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE91450%27 HTTP/1.1" 200 None
2026-03-27 10:37:26 [auto1.de] INFO: Saving data for PE91450: {'auction_closing_time': 1774715363.0, 'created_time': 1774294889.730642, 'last_price_update_time': 1774607846.396553}
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE91450') HTTP/1.1" 204 0
2026-03-27 10:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5368d10>
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_af0f8546c01e5a5c064c7df625bc606c.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_af0f8546c01e5a5c064c7df625bc606c.jpg saved to cache
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 501382d5-04e2-57da-ae31-a89e85756b31
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3c7c10>
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_afb774b5694db0b4631adacd6d9dbdc3.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_afb774b5694db0b4631adacd6d9dbdc3.jpg saved to cache
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3c20ecd-2036-53bb-aae1-3f76fc3d8d32
2026-03-27 10:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_c97ab930803ab545ebff47cf63f25c96.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:26 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-27 10:37:26 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV55429%27 HTTP/1.1" 200 None
2026-03-27 10:37:26 [auto1.de] INFO: Scrape type for BV55429: 2
2026-03-27 10:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f9f3241-f4e9-5dc0-93f2-0a175476e266 with identifier: BV55429
2026-03-27 10:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f9f3241-f4e9-5dc0-93f2-0a175476e266 with scrape type 2
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f9f3241-f4e9-5dc0-93f2-0a175476e266 with scrape type 2
2026-03-27 10:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f9f3241-f4e9-5dc0-93f2-0a175476e266, identifier: BV55429
2026-03-27 10:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_9526a0c73fb0af22528d4843bea16181.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f9f3241-f4e9-5dc0-93f2-0a175476e266 with identifier: BV55429
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-27 10:37:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f9f3241-f4e9-5dc0-93f2-0a175476e266 with identifier: BV55429
2026-03-27 10:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f9f3241-f4e9-5dc0-93f2-0a175476e266 with identifier: BV55429 to the API
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:54:43Z',
'fuel_type': 'diesel',
'id': '0f9f3241-f4e9-5dc0-93f2-0a175476e266',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV55429',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Viano',
'odometer': 258012,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-26',
'seller_name': None,
'title': 'Mercedes-Benz Viano 2.1 CDI kompakt Trend',
'transmission': 'automatic',
'trim': 'kompakt Trend',
'year': 2010}
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV55429%27 HTTP/1.1" 200 None
2026-03-27 10:37:27 [auto1.de] INFO: Saving data for BV55429: {'auction_closing_time': 1774716883.0, 'created_time': 1773466624.841306, 'last_price_update_time': 1774607847.20572}
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV55429') HTTP/1.1" 204 0
2026-03-27 10:37:27 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT48359%27 HTTP/1.1" 200 None
2026-03-27 10:37:27 [auto1.de] INFO: Scrape type for HT48359: 2
2026-03-27 10:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67321d13-024e-5a3f-b165-2e95b5d92cd0 with identifier: HT48359
2026-03-27 10:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67321d13-024e-5a3f-b165-2e95b5d92cd0 with scrape type 2
2026-03-27 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67321d13-024e-5a3f-b165-2e95b5d92cd0 with scrape type 2
2026-03-27 10:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67321d13-024e-5a3f-b165-2e95b5d92cd0, identifier: HT48359
2026-03-27 10:37:27 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 10502 | hits on page: 40
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b4a10>
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_aa9276a589a91bc4e997ccf31a44b2a5.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_aa9276a589a91bc4e997ccf31a44b2a5.jpg saved to cache
2026-03-27 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3c20ecd-2036-53bb-aae1-3f76fc3d8d32
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be265ed0>
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_c81577ba4dde551e676afb07ad1b305d.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_c81577ba4dde551e676afb07ad1b305d.jpg saved to cache
2026-03-27 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3c20ecd-2036-53bb-aae1-3f76fc3d8d32
2026-03-27 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_aa950dd0f216c068f357392df0e59486.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_f073cc93305b37ffa4b3ac438ffe6940.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67321d13-024e-5a3f-b165-2e95b5d92cd0 with identifier: HT48359
2026-03-27 10:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67321d13-024e-5a3f-b165-2e95b5d92cd0 with identifier: HT48359
2026-03-27 10:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67321d13-024e-5a3f-b165-2e95b5d92cd0 with identifier: HT48359 to the API
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-28T16:12:57Z',
'fuel_type': 'petrol',
'id': '67321d13-024e-5a3f-b165-2e95b5d92cd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT48359',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 12161,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-06-30',
'seller_name': None,
'title': 'Audi A1 Sportback 30 TFSI Advanced',
'transmission': 'automatic',
'trim': 'Advanced',
'year': 2024}
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT48359%27 HTTP/1.1" 200 None
2026-03-27 10:37:28 [auto1.de] INFO: Saving data for HT48359: {'auction_closing_time': 1774714377.0, 'created_time': 1773302749.523, 'last_price_update_time': 1774607848.135926}
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT48359') HTTP/1.1" 204 0
2026-03-27 10:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_26e8ecd75e0a513c807c07f9a8d60085.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_55f17b8d82052ca7dbc01257441013d4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:28 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-27 10:37:28 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-27 10:37:28 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-27 10:37:28 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-27 10:37:28 [auto1.de] INFO: Found listing with ID: TF25150
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF25150%27 HTTP/1.1" 200 None
2026-03-27 10:37:28 [auto1.de] INFO: Scrape type for TF25150: 2
2026-03-27 10:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8a6f981-b227-5aec-a4e6-cd4896f44197 with identifier: TF25150
2026-03-27 10:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8a6f981-b227-5aec-a4e6-cd4896f44197 with scrape type 2
2026-03-27 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8a6f981-b227-5aec-a4e6-cd4896f44197 with scrape type 2
2026-03-27 10:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8a6f981-b227-5aec-a4e6-cd4896f44197, identifier: TF25150
2026-03-27 10:37:28 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY56514%27 HTTP/1.1" 200 None
2026-03-27 10:37:28 [auto1.de] INFO: Scrape type for CY56514: 2
2026-03-27 10:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57e52fdd-5b2a-59c8-abec-7ab9df597f4e with identifier: CY56514
2026-03-27 10:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57e52fdd-5b2a-59c8-abec-7ab9df597f4e with scrape type 2
2026-03-27 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57e52fdd-5b2a-59c8-abec-7ab9df597f4e with scrape type 2
2026-03-27 10:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57e52fdd-5b2a-59c8-abec-7ab9df597f4e, identifier: CY56514
2026-03-27 10:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8a6f981-b227-5aec-a4e6-cd4896f44197 with identifier: TF25150
2026-03-27 10:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8a6f981-b227-5aec-a4e6-cd4896f44197 with identifier: TF25150
2026-03-27 10:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8a6f981-b227-5aec-a4e6-cd4896f44197 with identifier: TF25150 to the API
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 401,
'expiration_date': '2026-03-28T16:11:07Z',
'fuel_type': 'petrol',
'id': 'a8a6f981-b227-5aec-a4e6-cd4896f44197',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF25150',
'listing': 'auction',
'make': 'Dodge',
'model': 'Ram 1500',
'odometer': 265765,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-14',
'seller_name': None,
'title': 'Dodge Ram 1500 5.7 V8 2X4',
'transmission': 'automatic',
'trim': '2X4',
'year': 2018}
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF25150%27 HTTP/1.1" 200 None
2026-03-27 10:37:28 [auto1.de] INFO: Saving data for TF25150: {'auction_closing_time': 1774714267.0, 'created_time': 1773223487.413305, 'last_price_update_time': 1774607848.741992}
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF25150') HTTP/1.1" 204 0
2026-03-27 10:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57e52fdd-5b2a-59c8-abec-7ab9df597f4e with identifier: CY56514
2026-03-27 10:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57e52fdd-5b2a-59c8-abec-7ab9df597f4e with identifier: CY56514
2026-03-27 10:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57e52fdd-5b2a-59c8-abec-7ab9df597f4e with identifier: CY56514 to the API
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:37:56Z',
'fuel_type': 'diesel',
'id': '57e52fdd-5b2a-59c8-abec-7ab9df597f4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY56514',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 221238,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-18',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2014}
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY56514%27 HTTP/1.1" 200 None
2026-03-27 10:37:29 [auto1.de] INFO: Saving data for CY56514: {'auction_closing_time': 1774715876.0, 'created_time': 1773776238.820337, 'last_price_update_time': 1774607849.092293}
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY56514') HTTP/1.1" 204 0
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf58b190>
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_c97ab930803ab545ebff47cf63f25c96.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_c97ab930803ab545ebff47cf63f25c96.jpg saved to cache
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 501382d5-04e2-57da-ae31-a89e85756b31
2026-03-27 10:37:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5511790>
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9c%252Fc69c4aba491976bb5db54bbac77eef2f%252Fpa%252FTU49821_9526a0c73fb0af22528d4843bea16181.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_9526a0c73fb0af22528d4843bea16181.jpg saved to cache
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4c1b93f-5b90-55e1-a318-40937b4c67bc
2026-03-27 10:37:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4c1b93f-5b90-55e1-a318-40937b4c67bc, skipping ID generation
2026-03-27 10:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4c1b93f-5b90-55e1-a318-40937b4c67bc with scrape type 1
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4c1b93f-5b90-55e1-a318-40937b4c67bc sending to next pipeline
2026-03-27 10:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4c1b93f-5b90-55e1-a318-40937b4c67bc, identifier: TU49821
2026-03-27 10:37:29 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS66521%27 HTTP/1.1" 200 None
2026-03-27 10:37:29 [auto1.de] INFO: Scrape type for HS66521: 2
2026-03-27 10:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 902f27fe-dceb-59f4-822e-05fabfe636e1 with identifier: HS66521
2026-03-27 10:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 902f27fe-dceb-59f4-822e-05fabfe636e1 with scrape type 2
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 902f27fe-dceb-59f4-822e-05fabfe636e1 with scrape type 2
2026-03-27 10:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 902f27fe-dceb-59f4-822e-05fabfe636e1, identifier: HS66521
2026-03-27 10:37:29 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY38898%27 HTTP/1.1" 200 None
2026-03-27 10:37:29 [auto1.de] INFO: Scrape type for ZY38898: 2
2026-03-27 10:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55a13684-c1a1-5d35-91ad-820ae00d4766 with identifier: ZY38898
2026-03-27 10:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55a13684-c1a1-5d35-91ad-820ae00d4766 with scrape type 2
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55a13684-c1a1-5d35-91ad-820ae00d4766 with scrape type 2
2026-03-27 10:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55a13684-c1a1-5d35-91ad-820ae00d4766, identifier: ZY38898
2026-03-27 10:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4c1b93f-5b90-55e1-a318-40937b4c67bc with identifier: TU49821
2026-03-27 10:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4c1b93f-5b90-55e1-a318-40937b4c67bc with identifier: TU49821
2026-03-27 10:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4c1b93f-5b90-55e1-a318-40937b4c67bc with identifier: TU49821 to the API
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_9526a0c73fb0af22528d4843bea16181.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 117,
'expiration_date': '2026-03-28T16:59:16Z',
'fuel_type': 'petrol',
'id': 'd4c1b93f-5b90-55e1-a318-40937b4c67bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU49821',
'listing': 'auction',
'location': 'DE, Gießen',
'make': 'Mitsubishi',
'model': 'ASX',
'odometer': 81645,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_b61213056ad73ddbb5b6e6247fa874ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_3e3bfd475fcf4907d32e1cbdea0705b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62228,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_dc032f48c647f7bab3814273965c4ead.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_fe3b205c05a573aab4e813ff0abe15ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65656,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_4571440e12c026efd213b6313e6b556a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2542108,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_9526a0c73fb0af22528d4843bea16181.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_c321a3503b227d358596296c8d4bc9c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77732,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_c4f06fb4065ab02002670e6809e0f6c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_ccf8e9572eb9283717bf2435d2cf5bec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c1b93f-5b90-55e1-a318-40937b4c67bc/d4c1b93f-5b90-55e1-a318-40937b4c67bc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86386,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/9c/c69c4aba491976bb5db54bbac77eef2f/pa/TU49821_9c5c4f8f46c263ca5094ab45597395bc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-25',
'seats_number': 5,
'seller_name': None,
'title': 'Mitsubishi ASX 1.6 Basis 2WD',
'transmission': 'manual',
'trim': 'Basis 2WD',
'year': 2018}
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU49821%27 HTTP/1.1" 200 None
2026-03-27 10:37:30 [auto1.de] INFO: Saving data for TU49821: {'created_time': 1774607850.033683, 'last_price_update_time': 1774607850.033694, 'auction_closing_time': 1774717156.0}
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU49821') HTTP/1.1" 204 0
2026-03-27 10:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_a946ed0ac42f5fd616ccf6de7457e988.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_1c31022f401c19c8d576723891bc474c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 902f27fe-dceb-59f4-822e-05fabfe636e1 with identifier: HS66521
2026-03-27 10:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 902f27fe-dceb-59f4-822e-05fabfe636e1 with identifier: HS66521
2026-03-27 10:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 902f27fe-dceb-59f4-822e-05fabfe636e1 with identifier: HS66521 to the API
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 80,
'expiration_date': '2026-03-28T16:00:48Z',
'fuel_type': 'petrol',
'id': '902f27fe-dceb-59f4-822e-05fabfe636e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS66521',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 52789,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-07-23',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 Tour',
'transmission': 'automatic',
'trim': 'Tour',
'year': 2007}
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS66521%27 HTTP/1.1" 200 None
2026-03-27 10:37:30 [auto1.de] INFO: Saving data for HS66521: {'auction_closing_time': 1774713648.0, 'created_time': 1773688212.465495, 'last_price_update_time': 1774607850.419095}
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS66521') HTTP/1.1" 204 0
2026-03-27 10:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55a13684-c1a1-5d35-91ad-820ae00d4766 with identifier: ZY38898
2026-03-27 10:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55a13684-c1a1-5d35-91ad-820ae00d4766 with identifier: ZY38898
2026-03-27 10:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55a13684-c1a1-5d35-91ad-820ae00d4766 with identifier: ZY38898 to the API
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-28T16:11:17Z',
'fuel_type': 'diesel',
'id': '55a13684-c1a1-5d35-91ad-820ae00d4766',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY38898',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 119365,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-07',
'seller_name': None,
'title': 'Audi A6 40 TDI Mild-Hybrid Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2019}
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY38898%27 HTTP/1.1" 200 None
2026-03-27 10:37:30 [auto1.de] INFO: Saving data for ZY38898: {'auction_closing_time': 1774714277.0, 'created_time': 1774294319.567424, 'last_price_update_time': 1774607850.786026}
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY38898') HTTP/1.1" 204 0
2026-03-27 10:37:30 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-27 10:37:30 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ40099%27 HTTP/1.1" 200 None
2026-03-27 10:37:30 [auto1.de] INFO: Scrape type for EJ40099: 2
2026-03-27 10:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d6958c0-2d41-5ef8-9680-ce1b28f6a377 with identifier: EJ40099
2026-03-27 10:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6958c0-2d41-5ef8-9680-ce1b28f6a377 with scrape type 2
2026-03-27 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d6958c0-2d41-5ef8-9680-ce1b28f6a377 with scrape type 2
2026-03-27 10:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d6958c0-2d41-5ef8-9680-ce1b28f6a377, identifier: EJ40099
2026-03-27 10:37:30 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH37368%27 HTTP/1.1" 200 None
2026-03-27 10:37:30 [auto1.de] INFO: Scrape type for AH37368: 2
2026-03-27 10:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8879a54d-d2db-59b0-9d1a-a931b7781478 with identifier: AH37368
2026-03-27 10:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8879a54d-d2db-59b0-9d1a-a931b7781478 with scrape type 2
2026-03-27 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8879a54d-d2db-59b0-9d1a-a931b7781478 with scrape type 2
2026-03-27 10:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8879a54d-d2db-59b0-9d1a-a931b7781478, identifier: AH37368
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1d3450>
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_aa950dd0f216c068f357392df0e59486.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_aa950dd0f216c068f357392df0e59486.jpg saved to cache
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3c20ecd-2036-53bb-aae1-3f76fc3d8d32
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf1bed0>
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_f073cc93305b37ffa4b3ac438ffe6940.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_f073cc93305b37ffa4b3ac438ffe6940.jpg saved to cache
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b3c20ecd-2036-53bb-aae1-3f76fc3d8d32
2026-03-27 10:37:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf465fd0>
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_26e8ecd75e0a513c807c07f9a8d60085.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_26e8ecd75e0a513c807c07f9a8d60085.jpg saved to cache
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf1a990>
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_55f17b8d82052ca7dbc01257441013d4.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_55f17b8d82052ca7dbc01257441013d4.jpg saved to cache
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 501382d5-04e2-57da-ae31-a89e85756b31
2026-03-27 10:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_6ddf06b1053b8d00b335366ece18913c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d6958c0-2d41-5ef8-9680-ce1b28f6a377 with identifier: EJ40099
2026-03-27 10:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d6958c0-2d41-5ef8-9680-ce1b28f6a377 with identifier: EJ40099
2026-03-27 10:37:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d6958c0-2d41-5ef8-9680-ce1b28f6a377 with identifier: EJ40099 to the API
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:57:25Z',
'fuel_type': 'petrol',
'id': '8d6958c0-2d41-5ef8-9680-ce1b28f6a377',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ40099',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 113390,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-01',
'seller_name': None,
'title': 'Opel Corsa 1.2 Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2012}
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ40099%27 HTTP/1.1" 200 None
2026-03-27 10:37:31 [auto1.de] INFO: Saving data for EJ40099: {'auction_closing_time': 1774717045.0, 'created_time': 1773469063.801623, 'last_price_update_time': 1774607851.971696}
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ40099') HTTP/1.1" 204 0
2026-03-27 10:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8879a54d-d2db-59b0-9d1a-a931b7781478 with identifier: AH37368
2026-03-27 10:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8879a54d-d2db-59b0-9d1a-a931b7781478 with identifier: AH37368
2026-03-27 10:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8879a54d-d2db-59b0-9d1a-a931b7781478 with identifier: AH37368 to the API
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-28T16:22:19Z',
'fuel_type': 'diesel',
'id': '8879a54d-d2db-59b0-9d1a-a931b7781478',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH37368',
'listing': 'auction',
'make': 'Mazda',
'model': '6',
'odometer': 203164,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-20',
'seller_name': None,
'title': 'Mazda 6 2.2 Turbodiesel Sports-Line',
'transmission': 'automatic',
'trim': 'Sports-Line',
'year': 2014}
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH37368%27 HTTP/1.1" 200 None
2026-03-27 10:37:32 [auto1.de] INFO: Saving data for AH37368: {'auction_closing_time': 1774714939.0, 'created_time': 1773859368.864012, 'last_price_update_time': 1774607852.446247}
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH37368') HTTP/1.1" 204 0
2026-03-27 10:37:32 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR07443%27 HTTP/1.1" 200 None
2026-03-27 10:37:32 [auto1.de] INFO: Scrape type for YR07443: 2
2026-03-27 10:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dc696c5-580f-5784-974b-bc532cf68bd7 with identifier: YR07443
2026-03-27 10:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dc696c5-580f-5784-974b-bc532cf68bd7 with scrape type 2
2026-03-27 10:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dc696c5-580f-5784-974b-bc532cf68bd7 with scrape type 2
2026-03-27 10:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5dc696c5-580f-5784-974b-bc532cf68bd7, identifier: YR07443
2026-03-27 10:37:32 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX41680%27 HTTP/1.1" 200 None
2026-03-27 10:37:32 [auto1.de] INFO: Scrape type for NX41680: 2
2026-03-27 10:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 139a3cd3-d0c5-5bf5-969a-41347fc2d737 with identifier: NX41680
2026-03-27 10:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 139a3cd3-d0c5-5bf5-969a-41347fc2d737 with scrape type 2
2026-03-27 10:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 139a3cd3-d0c5-5bf5-969a-41347fc2d737 with scrape type 2
2026-03-27 10:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 139a3cd3-d0c5-5bf5-969a-41347fc2d737, identifier: NX41680
2026-03-27 10:37:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1ba450>
2026-03-27 10:37:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1320fc40-bba8-5bfd-9d6c-41e790b295bd/1320fc40-bba8-5bfd-9d6c-41e790b295bd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F0c%252F1e0c953a3431b015551430325b04ec80%252Fpa%252FHB67521_a946ed0ac42f5fd616ccf6de7457e988.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_a946ed0ac42f5fd616ccf6de7457e988.jpg saved to cache
2026-03-27 10:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1320fc40-bba8-5bfd-9d6c-41e790b295bd
2026-03-27 10:37:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1320fc40-bba8-5bfd-9d6c-41e790b295bd, skipping ID generation
2026-03-27 10:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1320fc40-bba8-5bfd-9d6c-41e790b295bd with scrape type 1
2026-03-27 10:37:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1320fc40-bba8-5bfd-9d6c-41e790b295bd sending to next pipeline
2026-03-27 10:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1320fc40-bba8-5bfd-9d6c-41e790b295bd, identifier: HB67521
2026-03-27 10:37:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf36dbd0>
2026-03-27 10:37:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_1c31022f401c19c8d576723891bc474c.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_1c31022f401c19c8d576723891bc474c.jpg saved to cache
2026-03-27 10:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcf531ae-96c1-569c-a7c7-f12a6e59abd6
2026-03-27 10:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_8a436723c0121dffe2ed298b2a6a73d3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5dc696c5-580f-5784-974b-bc532cf68bd7 with identifier: YR07443
2026-03-27 10:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5dc696c5-580f-5784-974b-bc532cf68bd7 with identifier: YR07443
2026-03-27 10:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5dc696c5-580f-5784-974b-bc532cf68bd7 with identifier: YR07443 to the API
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 249,
'expiration_date': '2026-03-28T16:13:38Z',
'fuel_type': 'diesel',
'id': '5dc696c5-580f-5784-974b-bc532cf68bd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR07443',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 111280,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-20',
'seller_name': None,
'title': 'Volvo XC90 2.0 B5 Diesel R-Design AWD',
'transmission': 'automatic',
'trim': 'R-Design AWD',
'year': 2019}
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR07443%27 HTTP/1.1" 200 None
2026-03-27 10:37:33 [auto1.de] INFO: Saving data for YR07443: {'auction_closing_time': 1774714418.0, 'created_time': 1773427045.549917, 'last_price_update_time': 1774607853.380419}
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR07443') HTTP/1.1" 204 0
2026-03-27 10:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 139a3cd3-d0c5-5bf5-969a-41347fc2d737 with identifier: NX41680
2026-03-27 10:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 139a3cd3-d0c5-5bf5-969a-41347fc2d737 with identifier: NX41680
2026-03-27 10:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 139a3cd3-d0c5-5bf5-969a-41347fc2d737 with identifier: NX41680 to the API
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:12:03Z',
'fuel_type': 'diesel',
'id': '139a3cd3-d0c5-5bf5-969a-41347fc2d737',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX41680',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 286058,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-07',
'seller_name': None,
'title': 'Volkswagen Touran 1.9 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2009}
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX41680%27 HTTP/1.1" 200 None
2026-03-27 10:37:33 [auto1.de] INFO: Saving data for NX41680: {'auction_closing_time': 1774714323.0, 'created_time': 1774293875.220949, 'last_price_update_time': 1774607853.810264}
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX41680') HTTP/1.1" 204 0
2026-03-27 10:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1320fc40-bba8-5bfd-9d6c-41e790b295bd with identifier: HB67521
2026-03-27 10:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1320fc40-bba8-5bfd-9d6c-41e790b295bd with identifier: HB67521
2026-03-27 10:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1320fc40-bba8-5bfd-9d6c-41e790b295bd with identifier: HB67521 to the API
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_a946ed0ac42f5fd616ccf6de7457e988.jpg>
{'auction_title': '',
'c_o_2_emission_value': 209,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '3.2L',
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:00:48Z',
'fuel_type': 'diesel',
'id': '1320fc40-bba8-5bfd-9d6c-41e790b295bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB67521',
'listing': 'auction',
'location': 'DE, Schweinfurt',
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 459875,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1320fc40-bba8-5bfd-9d6c-41e790b295bd/1320fc40-bba8-5bfd-9d6c-41e790b295bd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_73edb2356e1d43b57f269b6aec9465eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1320fc40-bba8-5bfd-9d6c-41e790b295bd/1320fc40-bba8-5bfd-9d6c-41e790b295bd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76466,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_3d4b328dd20128e88059f5417d18de47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1320fc40-bba8-5bfd-9d6c-41e790b295bd/1320fc40-bba8-5bfd-9d6c-41e790b295bd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80506,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_a946ed0ac42f5fd616ccf6de7457e988.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1320fc40-bba8-5bfd-9d6c-41e790b295bd/1320fc40-bba8-5bfd-9d6c-41e790b295bd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_7c210714dea98499c50e7787701dddaa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1320fc40-bba8-5bfd-9d6c-41e790b295bd/1320fc40-bba8-5bfd-9d6c-41e790b295bd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136887,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/0c/1e0c953a3431b015551430325b04ec80/pa/HB67521_9e88c780123818ba5c60ce8357717029.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2005-01-18',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 320 CDI',
'transmission': 'automatic',
'trim': '',
'year': 2005}
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB67521%27 HTTP/1.1" 200 None
2026-03-27 10:37:34 [auto1.de] INFO: Saving data for HB67521: {'created_time': 1774607854.208083, 'last_price_update_time': 1774607854.208096, 'auction_closing_time': 1774713648.0}
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB67521') HTTP/1.1" 204 0
2026-03-27 10:37:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_fde9835dc187c626f6c746db362ec195.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_b2a736641fa0a47bf85afe93a63f1b58.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:34 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-27 10:37:34 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-27 10:37:34 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS23837%27 HTTP/1.1" 200 None
2026-03-27 10:37:34 [auto1.de] INFO: Scrape type for KS23837: 2
2026-03-27 10:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9702932a-50a8-54af-9bce-3a4249a89b0b with identifier: KS23837
2026-03-27 10:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9702932a-50a8-54af-9bce-3a4249a89b0b with scrape type 2
2026-03-27 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9702932a-50a8-54af-9bce-3a4249a89b0b with scrape type 2
2026-03-27 10:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9702932a-50a8-54af-9bce-3a4249a89b0b, identifier: KS23837
2026-03-27 10:37:34 [auto1.de] INFO: Found listing with ID: CV35791
2026-03-27 10:37:34 [auto1.de] INFO: Found listing with ID: US02416
2026-03-27 10:37:34 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47887%27 HTTP/1.1" 200 None
2026-03-27 10:37:34 [auto1.de] INFO: Scrape type for HF47887: 2
2026-03-27 10:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a38a9b04-c555-594f-951a-43675a0a24d6 with identifier: HF47887
2026-03-27 10:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a38a9b04-c555-594f-951a-43675a0a24d6 with scrape type 2
2026-03-27 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a38a9b04-c555-594f-951a-43675a0a24d6 with scrape type 2
2026-03-27 10:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a38a9b04-c555-594f-951a-43675a0a24d6, identifier: HF47887
2026-03-27 10:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG97349> (referer: https://www.auto1.com/v1/car-details-view/VG97349/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9702932a-50a8-54af-9bce-3a4249a89b0b with identifier: KS23837
2026-03-27 10:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9702932a-50a8-54af-9bce-3a4249a89b0b with identifier: KS23837
2026-03-27 10:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9702932a-50a8-54af-9bce-3a4249a89b0b with identifier: KS23837 to the API
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:54:26Z',
'fuel_type': 'diesel',
'id': '9702932a-50a8-54af-9bce-3a4249a89b0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS23837',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 87729,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-10',
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi 320 L1 Trend',
'transmission': 'manual',
'trim': '320 L1 Trend',
'year': 2020}
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS23837%27 HTTP/1.1" 200 None
2026-03-27 10:37:34 [auto1.de] INFO: Saving data for KS23837: {'auction_closing_time': 1774716866.0, 'created_time': 1772540493.153206, 'last_price_update_time': 1774607854.878469}
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS23837') HTTP/1.1" 204 0
2026-03-27 10:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a38a9b04-c555-594f-951a-43675a0a24d6 with identifier: HF47887
2026-03-27 10:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a38a9b04-c555-594f-951a-43675a0a24d6 with identifier: HF47887
2026-03-27 10:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a38a9b04-c555-594f-951a-43675a0a24d6 with identifier: HF47887 to the API
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:23:41Z',
'fuel_type': 'petrol',
'id': 'a38a9b04-c555-594f-951a-43675a0a24d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF47887',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 113018,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-31',
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47887%27 HTTP/1.1" 200 None
2026-03-27 10:37:35 [auto1.de] INFO: Saving data for HF47887: {'auction_closing_time': 1774715021.0, 'created_time': 1773344898.262217, 'last_price_update_time': 1774607855.235183}
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF47887') HTTP/1.1" 204 0
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be022bd0>
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_6ddf06b1053b8d00b335366ece18913c.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_6ddf06b1053b8d00b335366ece18913c.jpg saved to cache
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcf531ae-96c1-569c-a7c7-f12a6e59abd6
2026-03-27 10:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_696b642a7854b90dae7d8f1058de321f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:35 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY67891%27 HTTP/1.1" 200 None
2026-03-27 10:37:35 [auto1.de] INFO: Scrape type for NY67891: 2
2026-03-27 10:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b6415df-73d6-5386-b38b-37f5ce6717a3 with identifier: NY67891
2026-03-27 10:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b6415df-73d6-5386-b38b-37f5ce6717a3 with scrape type 2
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b6415df-73d6-5386-b38b-37f5ce6717a3 with scrape type 2
2026-03-27 10:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b6415df-73d6-5386-b38b-37f5ce6717a3, identifier: NY67891
2026-03-27 10:37:35 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-27 10:37:35 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59511%27 HTTP/1.1" 200 None
2026-03-27 10:37:35 [auto1.de] INFO: Scrape type for GM59511: 2
2026-03-27 10:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06 with identifier: GM59511
2026-03-27 10:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06 with scrape type 2
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06 with scrape type 2
2026-03-27 10:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06, identifier: GM59511
2026-03-27 10:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b6415df-73d6-5386-b38b-37f5ce6717a3 with identifier: NY67891
2026-03-27 10:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b6415df-73d6-5386-b38b-37f5ce6717a3 with identifier: NY67891
2026-03-27 10:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b6415df-73d6-5386-b38b-37f5ce6717a3 with identifier: NY67891 to the API
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:29:03Z',
'fuel_type': 'petrol',
'id': '8b6415df-73d6-5386-b38b-37f5ce6717a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY67891',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 94062,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-12',
'seller_name': None,
'title': 'Audi A3 Sportback 35 TFSI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY67891%27 HTTP/1.1" 200 None
2026-03-27 10:37:35 [auto1.de] INFO: Saving data for NY67891: {'auction_closing_time': 1774715343.0, 'created_time': 1773429153.567507, 'last_price_update_time': 1774607855.946293}
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY67891') HTTP/1.1" 204 0
2026-03-27 10:37:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06 with identifier: GM59511
2026-03-27 10:37:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06 with identifier: GM59511
2026-03-27 10:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06 with identifier: GM59511 to the API
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:21:53Z',
'fuel_type': 'petrol',
'id': '1cf18ac4-cdd0-5d2c-bb85-c3cedf0fad06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM59511',
'listing': 'auction',
'make': 'Nissan',
'model': 'Pulsar',
'odometer': 202277,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-25',
'seller_name': None,
'title': 'Nissan Pulsar 1.6 Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2018}
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59511%27 HTTP/1.1" 200 None
2026-03-27 10:37:36 [auto1.de] INFO: Saving data for GM59511: {'auction_closing_time': 1774714913.0, 'created_time': 1773772236.151639, 'last_price_update_time': 1774607856.50031}
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM59511') HTTP/1.1" 204 0
2026-03-27 10:37:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be277a10>
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F7c%252Fef7cf45403738287e9649556f7f10b68%252Fpa%252FEK21596_8a436723c0121dffe2ed298b2a6a73d3.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_8a436723c0121dffe2ed298b2a6a73d3.jpg saved to cache
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19
2026-03-27 10:37:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19, skipping ID generation
2026-03-27 10:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with scrape type 1
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 sending to next pipeline
2026-03-27 10:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19, identifier: EK21596
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4f97d0>
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_fde9835dc187c626f6c746db362ec195.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_fde9835dc187c626f6c746db362ec195.jpg saved to cache
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcf531ae-96c1-569c-a7c7-f12a6e59abd6
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be020b90>
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d0c80b-d4ae-5cc4-a782-626d2367a789/d1d0c80b-d4ae-5cc4-a782-626d2367a789_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5f%252F335f98e35cc659bff28022e76809c6b0%252Fpa%252FYS13064_b2a736641fa0a47bf85afe93a63f1b58.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_b2a736641fa0a47bf85afe93a63f1b58.jpg saved to cache
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1d0c80b-d4ae-5cc4-a782-626d2367a789
2026-03-27 10:37:36 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY25163%27 HTTP/1.1" 200 None
2026-03-27 10:37:36 [auto1.de] INFO: Scrape type for FY25163: 2
2026-03-27 10:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99d96466-3930-51a6-b1be-0dc52f8c6537 with identifier: FY25163
2026-03-27 10:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99d96466-3930-51a6-b1be-0dc52f8c6537 with scrape type 2
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99d96466-3930-51a6-b1be-0dc52f8c6537 with scrape type 2
2026-03-27 10:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99d96466-3930-51a6-b1be-0dc52f8c6537, identifier: FY25163
2026-03-27 10:37:37 [auto1.de] INFO: Found listing with ID: WP35313
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP35313%27 HTTP/1.1" 200 None
2026-03-27 10:37:37 [auto1.de] INFO: Scrape type for WP35313: 1
2026-03-27 10:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with identifier: EK21596
2026-03-27 10:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with identifier: EK21596
2026-03-27 10:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b02dc6b-cad8-5579-8b4c-ba44ecac7f19 with identifier: EK21596 to the API
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_8a436723c0121dffe2ed298b2a6a73d3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:00:35Z',
'fuel_type': 'petrol',
'id': '6b02dc6b-cad8-5579-8b4c-ba44ecac7f19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK21596',
'listing': 'auction',
'location': 'DE, Kamen',
'make': 'Mazda',
'model': 'CX-30',
'odometer': 6650,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74291,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_f4a0a8349c1d16375cb4f0bee78ff987.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_362781f0dffea85fd31f40cd950a1e22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3038053,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_26e8ecd75e0a513c807c07f9a8d60085.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69540,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_62226d69d5b0bb5b85387e516d068319.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60855,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_cd25d8c07254333041457bbd35a7bd7a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72504,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_b27d28a10baf37a5dc874b5057d9aee9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3285816,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_8a436723c0121dffe2ed298b2a6a73d3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84334,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_f25eb1ddb9c822069fd62d0b139ff216.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70137,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_6beacc3b0f8e3e0d63db42269db141b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b02dc6b-cad8-5579-8b4c-ba44ecac7f19/6b02dc6b-cad8-5579-8b4c-ba44ecac7f19_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64812,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/7c/ef7cf45403738287e9649556f7f10b68/pa/EK21596_7b099fc2e71d354dd27eb66fe26ca224.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda CX-30 2.0 SKYACTIV-G Mild-Hybrid Homura 2WD',
'transmission': 'manual',
'trim': 'Homura 2WD',
'year': 2022}
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK21596%27 HTTP/1.1" 200 None
2026-03-27 10:37:37 [auto1.de] INFO: Saving data for EK21596: {'created_time': 1774607857.509515, 'last_price_update_time': 1774607857.509531, 'auction_closing_time': 1774713635.0}
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK21596') HTTP/1.1" 204 0
2026-03-27 10:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_b41c6ec8d802feb02ab11af8b9053271.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_7f05947ec0c080f4ef36b6a2f7f5f343.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99d96466-3930-51a6-b1be-0dc52f8c6537 with identifier: FY25163
2026-03-27 10:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99d96466-3930-51a6-b1be-0dc52f8c6537 with identifier: FY25163
2026-03-27 10:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99d96466-3930-51a6-b1be-0dc52f8c6537 with identifier: FY25163 to the API
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:35:39Z',
'fuel_type': 'petrol',
'id': '99d96466-3930-51a6-b1be-0dc52f8c6537',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY25163',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 274078,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-10-26',
'seller_name': None,
'title': 'Volkswagen Caddy 1.6 Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2004}
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY25163%27 HTTP/1.1" 200 None
2026-03-27 10:37:37 [auto1.de] INFO: Saving data for FY25163: {'auction_closing_time': 1774715739.0, 'created_time': 1774265056.555747, 'last_price_update_time': 1774607857.945206}
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY25163') HTTP/1.1" 204 0
2026-03-27 10:37:37 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-27 10:37:37 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-27 10:37:37 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD77905%27 HTTP/1.1" 200 None
2026-03-27 10:37:37 [auto1.de] INFO: Scrape type for WD77905: 2
2026-03-27 10:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07d51b98-8420-5bdb-879c-0e5f42d78048 with identifier: WD77905
2026-03-27 10:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07d51b98-8420-5bdb-879c-0e5f42d78048 with scrape type 2
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07d51b98-8420-5bdb-879c-0e5f42d78048 with scrape type 2
2026-03-27 10:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07d51b98-8420-5bdb-879c-0e5f42d78048, identifier: WD77905
2026-03-27 10:37:38 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU29418%27 HTTP/1.1" 200 None
2026-03-27 10:37:38 [auto1.de] INFO: Scrape type for AU29418: 2
2026-03-27 10:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd with identifier: AU29418
2026-03-27 10:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd with scrape type 2
2026-03-27 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd with scrape type 2
2026-03-27 10:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd, identifier: AU29418
2026-03-27 10:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Duplicate ID generated for item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: VG97349, dropping item
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf359c90>
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_696b642a7854b90dae7d8f1058de321f.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_696b642a7854b90dae7d8f1058de321f.jpg saved to cache
2026-03-27 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d
2026-03-27 10:37:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_3a8f5ad8358b10c99309e4b9df648709.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07d51b98-8420-5bdb-879c-0e5f42d78048 with identifier: WD77905
2026-03-27 10:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07d51b98-8420-5bdb-879c-0e5f42d78048 with identifier: WD77905
2026-03-27 10:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07d51b98-8420-5bdb-879c-0e5f42d78048 with identifier: WD77905 to the API
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 250,
'expiration_date': '2026-03-28T16:40:10Z',
'fuel_type': 'petrol',
'id': '07d51b98-8420-5bdb-879c-0e5f42d78048',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD77905',
'listing': 'auction',
'make': 'Porsche',
'model': '911',
'odometer': 111574,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1991-11-18',
'seller_name': None,
'title': 'Porsche 911 964 Carrera 4',
'transmission': 'manual',
'trim': 'Carrera 4',
'year': 1991}
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD77905%27 HTTP/1.1" 200 None
2026-03-27 10:37:38 [auto1.de] INFO: Saving data for WD77905: {'auction_closing_time': 1774716010.0, 'created_time': 1774377395.585769, 'last_price_update_time': 1774607858.576885}
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD77905') HTTP/1.1" 204 0
2026-03-27 10:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd with identifier: AU29418
2026-03-27 10:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd with identifier: AU29418
2026-03-27 10:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd with identifier: AU29418 to the API
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 281,
'expiration_date': '2026-03-28T16:27:30Z',
'fuel_type': 'petrol',
'id': '2e6c78b9-5a9f-57b8-9f55-1fd84b594cbd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU29418',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 18673,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-18',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 300 Mild-Hybrid T 4Matic AMG Line',
'transmission': 'automatic',
'trim': 'T 4Matic AMG Line',
'year': 2023}
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU29418%27 HTTP/1.1" 200 None
2026-03-27 10:37:38 [auto1.de] INFO: Saving data for AU29418: {'auction_closing_time': 1774715250.0, 'created_time': 1774293951.753626, 'last_price_update_time': 1774607858.973146}
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU29418') HTTP/1.1" 204 0
2026-03-27 10:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_a5d02a9e8dbf0c0f574ebcad597ea739.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:38 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-27 10:37:38 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-27 10:37:38 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV64840%27 HTTP/1.1" 200 None
2026-03-27 10:37:39 [auto1.de] INFO: Scrape type for CV64840: 2
2026-03-27 10:37:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59405564-e0ad-51a3-9882-d7724f423a48 with identifier: CV64840
2026-03-27 10:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59405564-e0ad-51a3-9882-d7724f423a48 with scrape type 2
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59405564-e0ad-51a3-9882-d7724f423a48 with scrape type 2
2026-03-27 10:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59405564-e0ad-51a3-9882-d7724f423a48, identifier: CV64840
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1693d0>
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d0c80b-d4ae-5cc4-a782-626d2367a789/d1d0c80b-d4ae-5cc4-a782-626d2367a789_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F5f%252F335f98e35cc659bff28022e76809c6b0%252Fpa%252FYS13064_b41c6ec8d802feb02ab11af8b9053271.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_b41c6ec8d802feb02ab11af8b9053271.jpg saved to cache
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1d0c80b-d4ae-5cc4-a782-626d2367a789
2026-03-27 10:37:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1d0c80b-d4ae-5cc4-a782-626d2367a789, skipping ID generation
2026-03-27 10:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1d0c80b-d4ae-5cc4-a782-626d2367a789 with scrape type 1
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1d0c80b-d4ae-5cc4-a782-626d2367a789 sending to next pipeline
2026-03-27 10:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1d0c80b-d4ae-5cc4-a782-626d2367a789, identifier: YS13064
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be29f210>
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F08%252Fc30845838c3a1a86b084b920407b34ed%252Fpa%252FGB74339_7f05947ec0c080f4ef36b6a2f7f5f343.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_7f05947ec0c080f4ef36b6a2f7f5f343.jpg saved to cache
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d
2026-03-27 10:37:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d, skipping ID generation
2026-03-27 10:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d with scrape type 1
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d sending to next pipeline
2026-03-27 10:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d, identifier: GB74339
2026-03-27 10:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59405564-e0ad-51a3-9882-d7724f423a48 with identifier: CV64840
2026-03-27 10:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59405564-e0ad-51a3-9882-d7724f423a48 with identifier: CV64840
2026-03-27 10:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59405564-e0ad-51a3-9882-d7724f423a48 with identifier: CV64840 to the API
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:16:09Z',
'fuel_type': 'petrol',
'id': '59405564-e0ad-51a3-9882-d7724f423a48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV64840',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 24462,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-12',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200 Mild-Hybrid Progressive',
'transmission': 'automatic',
'trim': 'Progressive',
'year': 2022}
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV64840%27 HTTP/1.1" 200 None
2026-03-27 10:37:39 [auto1.de] INFO: Saving data for CV64840: {'auction_closing_time': 1774714569.0, 'created_time': 1774293854.856412, 'last_price_update_time': 1774607859.791531}
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV64840') HTTP/1.1" 204 0
2026-03-27 10:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1d0c80b-d4ae-5cc4-a782-626d2367a789 with identifier: YS13064
2026-03-27 10:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1d0c80b-d4ae-5cc4-a782-626d2367a789 with identifier: YS13064
2026-03-27 10:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1d0c80b-d4ae-5cc4-a782-626d2367a789 with identifier: YS13064 to the API
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_b41c6ec8d802feb02ab11af8b9053271.jpg>
{'auction_title': '',
'c_o_2_emission_value': 98,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 5',
'engine': '1.0L',
'engine_horse_power': 60,
'expiration_date': '2026-03-28T16:20:54Z',
'fuel_type': 'petrol',
'id': 'd1d0c80b-d4ae-5cc4-a782-626d2367a789',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS13064',
'listing': 'auction',
'location': 'DE, Dortmund',
'make': 'Smart',
'model': 'fortwo',
'odometer': 98483,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d0c80b-d4ae-5cc4-a782-626d2367a789/d1d0c80b-d4ae-5cc4-a782-626d2367a789_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_b41c6ec8d802feb02ab11af8b9053271.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d0c80b-d4ae-5cc4-a782-626d2367a789/d1d0c80b-d4ae-5cc4-a782-626d2367a789_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80307,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_b2a736641fa0a47bf85afe93a63f1b58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d0c80b-d4ae-5cc4-a782-626d2367a789/d1d0c80b-d4ae-5cc4-a782-626d2367a789_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_9a4419523503aa5501e97830e35b9ecd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d0c80b-d4ae-5cc4-a782-626d2367a789/d1d0c80b-d4ae-5cc4-a782-626d2367a789_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87497,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_ce3c608b8f489722e4200bd494aba8b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d0c80b-d4ae-5cc4-a782-626d2367a789/d1d0c80b-d4ae-5cc4-a782-626d2367a789_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91216,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/5f/335f98e35cc659bff28022e76809c6b0/pa/YS13064_6a34b10722f3a0664d2151822363a1a0.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-06-30',
'seats_number': 2,
'seller_name': None,
'title': 'Smart fortwo 1.0 Micro Hybrid Drive pure',
'transmission': 'automatic',
'trim': 'Micro Hybrid Drive pure',
'year': 2012}
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS13064%27 HTTP/1.1" 200 None
2026-03-27 10:37:40 [auto1.de] INFO: Saving data for YS13064: {'created_time': 1774607860.201718, 'last_price_update_time': 1774607860.201734, 'auction_closing_time': 1774714854.0}
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS13064') HTTP/1.1" 204 0
2026-03-27 10:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d with identifier: GB74339
2026-03-27 10:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d with identifier: GB74339
2026-03-27 10:37:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d with identifier: GB74339 to the API
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_7f05947ec0c080f4ef36b6a2f7f5f343.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:35:35Z',
'fuel_type': 'petrol',
'id': '3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB74339',
'listing': 'auction',
'location': 'DE, Landsberg am Lech',
'make': 'Kia',
'model': 'Stonic',
'odometer': 48990,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83873,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_7f05947ec0c080f4ef36b6a2f7f5f343.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_696b642a7854b90dae7d8f1058de321f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_8022c74097d0723835c88e983ce3cc04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66505,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_39db3e8dab57656076ffa8a3d27893d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_6bcc0aa6cc05f5f6fc551196899e486e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_ac311aacdeb153d79bc215c478313513.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62980,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_58782b179469e9e3cfff707ace041a87.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79034,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_da0b913709705d0843d80004e0cd6b7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70590,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_e90b0db832b8586c2eeaaa15bf8b93aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d/3bd2d12c-38ae-5424-add0-8a0e5dc1cf3d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71613,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/08/c30845838c3a1a86b084b920407b34ed/pa/GB74339_d44f1e611ac9e649642b919080828807.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-16',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Stonic 1.0 TGDI Platinum Edition',
'transmission': 'manual',
'trim': 'Platinum Edition',
'year': 2018}
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB74339%27 HTTP/1.1" 200 None
2026-03-27 10:37:40 [auto1.de] INFO: Saving data for GB74339: {'created_time': 1774607860.637799, 'last_price_update_time': 1774607860.637818, 'auction_closing_time': 1774715735.0}
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB74339') HTTP/1.1" 204 0
2026-03-27 10:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_b49c13f39755983920412b8c7bd258b8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:40 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92547%27 HTTP/1.1" 200 None
2026-03-27 10:37:40 [auto1.de] INFO: Scrape type for MV92547: 2
2026-03-27 10:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd45a1c7-0a05-58f7-af6a-c15e3d223f7f with identifier: MV92547
2026-03-27 10:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd45a1c7-0a05-58f7-af6a-c15e3d223f7f with scrape type 2
2026-03-27 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd45a1c7-0a05-58f7-af6a-c15e3d223f7f with scrape type 2
2026-03-27 10:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd45a1c7-0a05-58f7-af6a-c15e3d223f7f, identifier: MV92547
2026-03-27 10:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd45a1c7-0a05-58f7-af6a-c15e3d223f7f with identifier: MV92547
2026-03-27 10:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd45a1c7-0a05-58f7-af6a-c15e3d223f7f with identifier: MV92547
2026-03-27 10:37:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd45a1c7-0a05-58f7-af6a-c15e3d223f7f with identifier: MV92547 to the API
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-28T16:12:25Z',
'fuel_type': 'petrol',
'id': 'dd45a1c7-0a05-58f7-af6a-c15e3d223f7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV92547',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 108582,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-09',
'seller_name': None,
'title': 'Toyota Aygo 1.0 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2011}
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92547%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [auto1.de] INFO: Saving data for MV92547: {'auction_closing_time': 1774714345.0, 'created_time': 1773304589.394061, 'last_price_update_time': 1774607861.168717}
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV92547') HTTP/1.1" 204 0
2026-03-27 10:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG44703> (referer: https://www.auto1.com/v1/car-details-view/NG44703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CK07133> (referer: https://www.auto1.com/v1/car-details-view/CK07133/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be036550>
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03/9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F37%252F943749232f06296f5869faa9de688b6d%252Fpa%252FCZ12085_3a8f5ad8358b10c99309e4b9df648709.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_3a8f5ad8358b10c99309e4b9df648709.jpg saved to cache
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03
2026-03-27 10:37:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03, skipping ID generation
2026-03-27 10:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03 with scrape type 1
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03 sending to next pipeline
2026-03-27 10:37:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03, identifier: CZ12085
2026-03-27 10:37:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf44ccd0>
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F75%252F86757f45d88aeae161585d11a42cfbbe%252Fpa%252FJS49483_a5d02a9e8dbf0c0f574ebcad597ea739.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_a5d02a9e8dbf0c0f574ebcad597ea739.jpg saved to cache
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 501382d5-04e2-57da-ae31-a89e85756b31
2026-03-27 10:37:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 501382d5-04e2-57da-ae31-a89e85756b31, skipping ID generation
2026-03-27 10:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 501382d5-04e2-57da-ae31-a89e85756b31 with scrape type 1
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 501382d5-04e2-57da-ae31-a89e85756b31 sending to next pipeline
2026-03-27 10:37:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 501382d5-04e2-57da-ae31-a89e85756b31, identifier: JS49483
2026-03-27 10:37:41 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-27 10:37:41 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-27 10:37:41 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-27 10:37:41 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND18169%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [auto1.de] INFO: Scrape type for ND18169: 2
2026-03-27 10:37:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65d9dc76-4491-5308-9b75-88a0aceea15e with identifier: ND18169
2026-03-27 10:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65d9dc76-4491-5308-9b75-88a0aceea15e with scrape type 2
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65d9dc76-4491-5308-9b75-88a0aceea15e with scrape type 2
2026-03-27 10:37:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65d9dc76-4491-5308-9b75-88a0aceea15e, identifier: ND18169
2026-03-27 10:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03 with identifier: CZ12085
2026-03-27 10:37:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03 with identifier: CZ12085
2026-03-27 10:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03 with identifier: CZ12085 to the API
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_3a8f5ad8358b10c99309e4b9df648709.jpg>
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:15:42Z',
'fuel_type': 'diesel',
'id': '9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ12085',
'listing': 'auction',
'location': 'DE, Pattensen',
'make': 'BMW',
'model': '1er',
'odometer': 252305,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03/9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114393,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_d1eba88cd7069ef4b96c10317ea03157.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03/9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118223,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_a2516a04a51424cde2d735b328292437.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03/9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_3a8f5ad8358b10c99309e4b9df648709.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03/9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_6212269f38983100303308b2f7134a20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03/9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84926,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_74ff4669953cd062528796e9fe1d8616.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03/9f9eb2e4-7c29-5f9a-8d28-37ec4d372f03_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/37/943749232f06296f5869faa9de688b6d/pa/CZ12085_890e5ad88b9073742b83585381790091.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-05-06',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 120d',
'transmission': 'automatic',
'trim': '',
'year': 2008}
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ12085%27 HTTP/1.1" 200 None
2026-03-27 10:37:42 [auto1.de] INFO: Saving data for CZ12085: {'created_time': 1774607862.511246, 'last_price_update_time': 1774607862.511266, 'auction_closing_time': 1774714542.0}
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ12085') HTTP/1.1" 204 0
2026-03-27 10:37:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 501382d5-04e2-57da-ae31-a89e85756b31 with identifier: JS49483
2026-03-27 10:37:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 501382d5-04e2-57da-ae31-a89e85756b31 with identifier: JS49483
2026-03-27 10:37:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 501382d5-04e2-57da-ae31-a89e85756b31 with identifier: JS49483 to the API
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_a5d02a9e8dbf0c0f574ebcad597ea739.jpg>
{'auction_title': '',
'c_o_2_emission_value': 174,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.8L',
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:19:58Z',
'fuel_type': 'petrol',
'id': '501382d5-04e2-57da-ae31-a89e85756b31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS49483',
'listing': 'auction',
'location': 'DE, Neumünster',
'make': 'Audi',
'model': 'A4',
'odometer': 121424,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2502843,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_a5d02a9e8dbf0c0f574ebcad597ea739.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63516,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_a82ff8ffb6de9ccc81566b651a3c5e76.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68765,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_55f17b8d82052ca7dbc01257441013d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59061,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_91f2ee0de11c5b0e5785117cd19560ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_9d1d5651e726fd005abd038d36a62e26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_f62dae36ced97885f4d166db36666031.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_85cfe46d05cc2db4f0eafe3c9a13c41b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79786,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_c738fc8de952890b6e3163a8bb112655.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73568,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_af0f8546c01e5a5c064c7df625bc606c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501382d5-04e2-57da-ae31-a89e85756b31/501382d5-04e2-57da-ae31-a89e85756b31_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/75/86757f45d88aeae161585d11a42cfbbe/pa/JS49483_c97ab930803ab545ebff47cf63f25c96.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-12-08',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 1.8 TFSI Ambiente',
'transmission': 'automatic',
'trim': 'Ambiente',
'year': 2009}
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS49483%27 HTTP/1.1" 200 None
2026-03-27 10:37:43 [auto1.de] INFO: Saving data for JS49483: {'created_time': 1774607863.047406, 'last_price_update_time': 1774607863.047418, 'auction_closing_time': 1774714798.0}
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS49483') HTTP/1.1" 204 0
2026-03-27 10:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65d9dc76-4491-5308-9b75-88a0aceea15e with identifier: ND18169
2026-03-27 10:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65d9dc76-4491-5308-9b75-88a0aceea15e with identifier: ND18169
2026-03-27 10:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65d9dc76-4491-5308-9b75-88a0aceea15e with identifier: ND18169 to the API
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:13:37Z',
'fuel_type': 'petrol',
'id': '65d9dc76-4491-5308-9b75-88a0aceea15e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND18169',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 134901,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-30',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND18169%27 HTTP/1.1" 200 None
2026-03-27 10:37:43 [auto1.de] INFO: Saving data for ND18169: {'auction_closing_time': 1774714417.0, 'created_time': 1773732648.390875, 'last_price_update_time': 1774607863.425928}
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND18169') HTTP/1.1" 204 0
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf44e990>
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0366b08b-3323-5348-9f58-b06c9b82d43a/0366b08b-3323-5348-9f58-b06c9b82d43a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F67%252F3467282c69428371108c07a1a72304ff%252Fpa%252FTE41931_b49c13f39755983920412b8c7bd258b8.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_b49c13f39755983920412b8c7bd258b8.jpg saved to cache
2026-03-27 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0366b08b-3323-5348-9f58-b06c9b82d43a
2026-03-27 10:37:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0366b08b-3323-5348-9f58-b06c9b82d43a, skipping ID generation
2026-03-27 10:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0366b08b-3323-5348-9f58-b06c9b82d43a with scrape type 1
2026-03-27 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0366b08b-3323-5348-9f58-b06c9b82d43a sending to next pipeline
2026-03-27 10:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0366b08b-3323-5348-9f58-b06c9b82d43a, identifier: TE41931
2026-03-27 10:37:43 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-27 10:37:43 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28952%27 HTTP/1.1" 200 None
2026-03-27 10:37:43 [auto1.de] INFO: Scrape type for UE28952: 2
2026-03-27 10:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed2cc29a-6784-59ea-a8d3-2e2ef23b8597 with identifier: UE28952
2026-03-27 10:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed2cc29a-6784-59ea-a8d3-2e2ef23b8597 with scrape type 2
2026-03-27 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed2cc29a-6784-59ea-a8d3-2e2ef23b8597 with scrape type 2
2026-03-27 10:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed2cc29a-6784-59ea-a8d3-2e2ef23b8597, identifier: UE28952
2026-03-27 10:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LV46830/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN30127> (referer: https://www.auto1.com/v1/car-details-view/MN30127/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0366b08b-3323-5348-9f58-b06c9b82d43a with identifier: TE41931
2026-03-27 10:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0366b08b-3323-5348-9f58-b06c9b82d43a with identifier: TE41931
2026-03-27 10:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0366b08b-3323-5348-9f58-b06c9b82d43a with identifier: TE41931 to the API
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_b49c13f39755983920412b8c7bd258b8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.1L',
'engine_horse_power': 73,
'expiration_date': '2026-03-28T16:51:02Z',
'fuel_type': 'petrol',
'id': '0366b08b-3323-5348-9f58-b06c9b82d43a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE41931',
'listing': 'auction',
'location': 'DE, Osnabrück',
'make': 'Renault',
'model': 'Clio',
'odometer': 176011,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0366b08b-3323-5348-9f58-b06c9b82d43a/0366b08b-3323-5348-9f58-b06c9b82d43a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90524,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_0e40ae62bc02249cf2ce40def88e1775.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0366b08b-3323-5348-9f58-b06c9b82d43a/0366b08b-3323-5348-9f58-b06c9b82d43a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_6d933a5d348b9bf9c32f1721d14c8b19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0366b08b-3323-5348-9f58-b06c9b82d43a/0366b08b-3323-5348-9f58-b06c9b82d43a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74656,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_b49c13f39755983920412b8c7bd258b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0366b08b-3323-5348-9f58-b06c9b82d43a/0366b08b-3323-5348-9f58-b06c9b82d43a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_06b6f09b8616501f707e4164934f7e4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0366b08b-3323-5348-9f58-b06c9b82d43a/0366b08b-3323-5348-9f58-b06c9b82d43a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img34/67/3467282c69428371108c07a1a72304ff/pa/TE41931_6490558787f79ebe7e238c71fcd6f911.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-10-26',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.2 Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2016}
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE41931%27 HTTP/1.1" 200 None
2026-03-27 10:37:44 [auto1.de] INFO: Saving data for TE41931: {'created_time': 1774607864.078061, 'last_price_update_time': 1774607864.078073, 'auction_closing_time': 1774716662.0}
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE41931') HTTP/1.1" 204 0
2026-03-27 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_5cea3afafc3fcd4986156993b092bb16.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed2cc29a-6784-59ea-a8d3-2e2ef23b8597 with identifier: UE28952
2026-03-27 10:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed2cc29a-6784-59ea-a8d3-2e2ef23b8597 with identifier: UE28952
2026-03-27 10:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed2cc29a-6784-59ea-a8d3-2e2ef23b8597 with identifier: UE28952 to the API
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:05:07Z',
'fuel_type': 'diesel',
'id': 'ed2cc29a-6784-59ea-a8d3-2e2ef23b8597',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE28952',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40',
'odometer': 102150,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-17',
'seller_name': None,
'title': 'Volvo V40 2.0 D2 Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2019}
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28952%27 HTTP/1.1" 200 None
2026-03-27 10:37:44 [auto1.de] INFO: Saving data for UE28952: {'auction_closing_time': 1774713907.0, 'created_time': 1773687295.060854, 'last_price_update_time': 1774607864.459484}
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE28952') HTTP/1.1" 204 0
2026-03-27 10:37:44 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ86023%27 HTTP/1.1" 200 None
2026-03-27 10:37:44 [auto1.de] INFO: Scrape type for RZ86023: 2
2026-03-27 10:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3aa066d-4166-54bc-8173-c7c4b71ccf2f with identifier: RZ86023
2026-03-27 10:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3aa066d-4166-54bc-8173-c7c4b71ccf2f with scrape type 2
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3aa066d-4166-54bc-8173-c7c4b71ccf2f with scrape type 2
2026-03-27 10:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3aa066d-4166-54bc-8173-c7c4b71ccf2f, identifier: RZ86023
2026-03-27 10:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4a405ad-9c93-5878-9f15-78035a93bfa7 with identifier: NG44703
2026-03-27 10:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4a405ad-9c93-5878-9f15-78035a93bfa7 with scrape type 1
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b4a405ad-9c93-5878-9f15-78035a93bfa7
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fa8%252F1ba86de8c97ea84515890b05a208e64a%252Fpa%252FNG44703_c8188a11b6ca6e312b508c1b1156b350.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_c8188a11b6ca6e312b508c1b1156b350.jpg not downloaded yet
2026-03-27 10:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2983a78-277c-5fd4-a391-68b07ebff38e with identifier: CK07133
2026-03-27 10:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2983a78-277c-5fd4-a391-68b07ebff38e with scrape type 1
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2983a78-277c-5fd4-a391-68b07ebff38e
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fc6%252F88c647eea0ebf93680c40ec5a6688c34%252Fpa%252FCK07133_e485f49c9bec7ca089655305c8e3d096.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_e485f49c9bec7ca089655305c8e3d096.jpg already downloaded
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fc6%252F88c647eea0ebf93680c40ec5a6688c34%252Fpa%252FCK07133_8f21b218b9fbabede6b774f185a39b85.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_8f21b218b9fbabede6b774f185a39b85.jpg already downloaded
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fc6%252F88c647eea0ebf93680c40ec5a6688c34%252Fpa%252FCK07133_1ab3f68db059bdecccc48b546a850b61.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_1ab3f68db059bdecccc48b546a850b61.jpg already downloaded
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fc6%252F88c647eea0ebf93680c40ec5a6688c34%252Fpa%252FCK07133_5436b6b6680218cf6c13dccdb5e7c409.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_5436b6b6680218cf6c13dccdb5e7c409.jpg already downloaded
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fc6%252F88c647eea0ebf93680c40ec5a6688c34%252Fpa%252FCK07133_ce6446c44a266e4849ad46543e3bb5d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_ce6446c44a266e4849ad46543e3bb5d7.jpg already downloaded
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fc6%252F88c647eea0ebf93680c40ec5a6688c34%252Fpa%252FCK07133_adb0fc4a731887a818946a38c9d5f182.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_adb0fc4a731887a818946a38c9d5f182.jpg already downloaded
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fc6%252F88c647eea0ebf93680c40ec5a6688c34%252Fpa%252FCK07133_d63179c8366ba3507dc1eead14379dd0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_d63179c8366ba3507dc1eead14379dd0.jpg already downloaded
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fc6%252F88c647eea0ebf93680c40ec5a6688c34%252Fpa%252FCK07133_b09867ad6596fbf9b43bba6a1effe3c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_b09867ad6596fbf9b43bba6a1effe3c4.jpg already downloaded
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fc6%252F88c647eea0ebf93680c40ec5a6688c34%252Fpa%252FCK07133_c5c273f3752aee5572708a01f7517717.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_c5c273f3752aee5572708a01f7517717.jpg already downloaded
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fc6%252F88c647eea0ebf93680c40ec5a6688c34%252Fpa%252FCK07133_fef4543e31ee949c957d15e8dc984883.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_fef4543e31ee949c957d15e8dc984883.jpg already downloaded
2026-03-27 10:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2983a78-277c-5fd4-a391-68b07ebff38e, identifier: CK07133
2026-03-27 10:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3aa066d-4166-54bc-8173-c7c4b71ccf2f with identifier: RZ86023
2026-03-27 10:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3aa066d-4166-54bc-8173-c7c4b71ccf2f with identifier: RZ86023
2026-03-27 10:37:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3aa066d-4166-54bc-8173-c7c4b71ccf2f with identifier: RZ86023 to the API
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:12:52Z',
'fuel_type': 'petrol',
'id': 'd3aa066d-4166-54bc-8173-c7c4b71ccf2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ86023',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 152454,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-14',
'seller_name': None,
'title': 'Skoda Fabia 1.4 Cool Edition',
'transmission': 'manual',
'trim': 'Cool Edition',
'year': 2009}
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ86023%27 HTTP/1.1" 200 None
2026-03-27 10:37:45 [auto1.de] INFO: Saving data for RZ86023: {'auction_closing_time': 1774714372.0, 'created_time': 1774291993.583421, 'last_price_update_time': 1774607865.293218}
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ86023') HTTP/1.1" 204 0
2026-03-27 10:37:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2983a78-277c-5fd4-a391-68b07ebff38e with identifier: CK07133
2026-03-27 10:37:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2983a78-277c-5fd4-a391-68b07ebff38e with identifier: CK07133
2026-03-27 10:37:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2983a78-277c-5fd4-a391-68b07ebff38e with identifier: CK07133 to the API
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CK07133>
{'auction_title': '',
'c_o_2_emission_value': 172,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:37:12Z',
'fuel_type': 'petrol',
'id': 'c2983a78-277c-5fd4-a391-68b07ebff38e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK07133',
'listing': 'auction',
'location': 'DE, Schkopau (OT Rassnitz)',
'make': 'Fiat',
'model': 'Tipo',
'odometer': 121435,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_e485f49c9bec7ca089655305c8e3d096.jpg',
'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_8f21b218b9fbabede6b774f185a39b85.jpg',
'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_1ab3f68db059bdecccc48b546a850b61.jpg',
'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_5436b6b6680218cf6c13dccdb5e7c409.jpg',
'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_ce6446c44a266e4849ad46543e3bb5d7.jpg',
'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_adb0fc4a731887a818946a38c9d5f182.jpg',
'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_d63179c8366ba3507dc1eead14379dd0.jpg',
'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_b09867ad6596fbf9b43bba6a1effe3c4.jpg',
'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_c5c273f3752aee5572708a01f7517717.jpg',
'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_fef4543e31ee949c957d15e8dc984883.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2983a78-277c-5fd4-a391-68b07ebff38e/c2983a78-277c-5fd4-a391-68b07ebff38e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_e485f49c9bec7ca089655305c8e3d096.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2983a78-277c-5fd4-a391-68b07ebff38e/c2983a78-277c-5fd4-a391-68b07ebff38e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79400,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_8f21b218b9fbabede6b774f185a39b85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2983a78-277c-5fd4-a391-68b07ebff38e/c2983a78-277c-5fd4-a391-68b07ebff38e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73387,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_1ab3f68db059bdecccc48b546a850b61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2983a78-277c-5fd4-a391-68b07ebff38e/c2983a78-277c-5fd4-a391-68b07ebff38e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62784,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_5436b6b6680218cf6c13dccdb5e7c409.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2983a78-277c-5fd4-a391-68b07ebff38e/c2983a78-277c-5fd4-a391-68b07ebff38e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63070,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_ce6446c44a266e4849ad46543e3bb5d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2983a78-277c-5fd4-a391-68b07ebff38e/c2983a78-277c-5fd4-a391-68b07ebff38e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_adb0fc4a731887a818946a38c9d5f182.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2983a78-277c-5fd4-a391-68b07ebff38e/c2983a78-277c-5fd4-a391-68b07ebff38e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55594,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_d63179c8366ba3507dc1eead14379dd0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2983a78-277c-5fd4-a391-68b07ebff38e/c2983a78-277c-5fd4-a391-68b07ebff38e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78782,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_b09867ad6596fbf9b43bba6a1effe3c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2983a78-277c-5fd4-a391-68b07ebff38e/c2983a78-277c-5fd4-a391-68b07ebff38e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_c5c273f3752aee5572708a01f7517717.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2983a78-277c-5fd4-a391-68b07ebff38e/c2983a78-277c-5fd4-a391-68b07ebff38e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57758,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/c6/88c647eea0ebf93680c40ec5a6688c34/pa/CK07133_fef4543e31ee949c957d15e8dc984883.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-26',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Tipo 1.4 Turbo S-Design',
'transmission': 'manual',
'trim': 'S-Design',
'year': 2019}
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK07133%27 HTTP/1.1" 200 None
2026-03-27 10:37:45 [auto1.de] INFO: Saving data for CK07133: {'created_time': 1774607865.653676, 'last_price_update_time': 1774607865.653688, 'auction_closing_time': 1774715832.0}
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK07133') HTTP/1.1" 204 0
2026-03-27 10:37:45 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-27 10:37:45 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML83071%27 HTTP/1.1" 200 None
2026-03-27 10:37:45 [auto1.de] INFO: Scrape type for ML83071: 2
2026-03-27 10:37:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf1464de-ec0f-5df8-9637-527ced3807d1 with identifier: ML83071
2026-03-27 10:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf1464de-ec0f-5df8-9637-527ced3807d1 with scrape type 2
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf1464de-ec0f-5df8-9637-527ced3807d1 with scrape type 2
2026-03-27 10:37:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf1464de-ec0f-5df8-9637-527ced3807d1, identifier: ML83071
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fa8%252F1ba86de8c97ea84515890b05a208e64a%252Fpa%252FNG44703_5bcd49b160393eafd658a6ba0cfb5203.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_5bcd49b160393eafd658a6ba0cfb5203.jpg not downloaded yet
2026-03-27 10:37:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7279628-8c27-54c7-a514-a6c484547c0b with identifier: MN30127
2026-03-27 10:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7279628-8c27-54c7-a514-a6c484547c0b with scrape type 1
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7279628-8c27-54c7-a514-a6c484547c0b
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_9b5c32d21275d244b671edb0789eec4a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_9b5c32d21275d244b671edb0789eec4a.jpg not downloaded yet
2026-03-27 10:37:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be093d10>
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_5cea3afafc3fcd4986156993b092bb16.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_5cea3afafc3fcd4986156993b092bb16.jpg saved to cache
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3c20ecd-2036-53bb-aae1-3f76fc3d8d32
2026-03-27 10:37:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf1464de-ec0f-5df8-9637-527ced3807d1 with identifier: ML83071
2026-03-27 10:37:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf1464de-ec0f-5df8-9637-527ced3807d1 with identifier: ML83071
2026-03-27 10:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf1464de-ec0f-5df8-9637-527ced3807d1 with identifier: ML83071 to the API
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-03-28T16:05:39Z',
'fuel_type': 'diesel',
'id': 'bf1464de-ec0f-5df8-9637-527ced3807d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML83071',
'listing': 'auction',
'make': 'Kia',
'model': 'Sorento',
'odometer': 240215,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-29',
'seller_name': None,
'title': 'Kia Sorento 2.2 CRDi Spirit 4WD',
'transmission': 'automatic',
'trim': 'Spirit 4WD',
'year': 2010}
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML83071%27 HTTP/1.1" 200 None
2026-03-27 10:37:46 [auto1.de] INFO: Saving data for ML83071: {'auction_closing_time': 1774713939.0, 'created_time': 1773811836.820344, 'last_price_update_time': 1774607866.352287}
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML83071') HTTP/1.1" 204 0
2026-03-27 10:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP35313/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:46 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF17432%27 HTTP/1.1" 200 None
2026-03-27 10:37:46 [auto1.de] INFO: Scrape type for DF17432: 2
2026-03-27 10:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15fba982-c75b-5b0d-bb14-56f7808719b3 with identifier: DF17432
2026-03-27 10:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15fba982-c75b-5b0d-bb14-56f7808719b3 with scrape type 2
2026-03-27 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15fba982-c75b-5b0d-bb14-56f7808719b3 with scrape type 2
2026-03-27 10:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15fba982-c75b-5b0d-bb14-56f7808719b3, identifier: DF17432
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fa8%252F1ba86de8c97ea84515890b05a208e64a%252Fpa%252FNG44703_364505d42bc069a7d77b642938d48b63.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_364505d42bc069a7d77b642938d48b63.jpg not downloaded yet
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_50f1512a06b0bc497170baa6f9e1b862.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_50f1512a06b0bc497170baa6f9e1b862.jpg not downloaded yet
2026-03-27 10:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15fba982-c75b-5b0d-bb14-56f7808719b3 with identifier: DF17432
2026-03-27 10:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15fba982-c75b-5b0d-bb14-56f7808719b3 with identifier: DF17432
2026-03-27 10:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15fba982-c75b-5b0d-bb14-56f7808719b3 with identifier: DF17432 to the API
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:57:11Z',
'fuel_type': 'petrol',
'id': '15fba982-c75b-5b0d-bb14-56f7808719b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF17432',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 71020,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-07',
'seller_name': None,
'title': 'Opel Astra 1.4 SIDI Turbo Dynamic Start/Stop',
'transmission': 'manual',
'trim': 'Dynamic Start/Stop',
'year': 2017}
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF17432%27 HTTP/1.1" 200 None
2026-03-27 10:37:46 [auto1.de] INFO: Saving data for DF17432: {'auction_closing_time': 1774717031.0, 'created_time': 1773138727.980088, 'last_price_update_time': 1774607866.876755}
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF17432') HTTP/1.1" 204 0
2026-03-27 10:37:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:46 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-27 10:37:46 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-27 10:37:46 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS62021%27 HTTP/1.1" 200 None
2026-03-27 10:37:46 [auto1.de] INFO: Scrape type for JS62021: 0
2026-03-27 10:37:46 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB05774%27 HTTP/1.1" 200 None
2026-03-27 10:37:46 [auto1.de] INFO: Scrape type for NB05774: 2
2026-03-27 10:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efd943df-a583-5214-85c6-7f9588fb9e2d with identifier: NB05774
2026-03-27 10:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efd943df-a583-5214-85c6-7f9588fb9e2d with scrape type 2
2026-03-27 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efd943df-a583-5214-85c6-7f9588fb9e2d with scrape type 2
2026-03-27 10:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efd943df-a583-5214-85c6-7f9588fb9e2d, identifier: NB05774
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fa8%252F1ba86de8c97ea84515890b05a208e64a%252Fpa%252FNG44703_b1160cf29bb012775a8a65183158aef7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_b1160cf29bb012775a8a65183158aef7.jpg not downloaded yet
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_fcc9cf4c467a01e9ca8a1df1f0566b70.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_fcc9cf4c467a01e9ca8a1df1f0566b70.jpg not downloaded yet
2026-03-27 10:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_c8188a11b6ca6e312b508c1b1156b350.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efd943df-a583-5214-85c6-7f9588fb9e2d with identifier: NB05774
2026-03-27 10:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efd943df-a583-5214-85c6-7f9588fb9e2d with identifier: NB05774
2026-03-27 10:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efd943df-a583-5214-85c6-7f9588fb9e2d with identifier: NB05774 to the API
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:01:51Z',
'fuel_type': 'diesel',
'id': 'efd943df-a583-5214-85c6-7f9588fb9e2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB05774',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 90166,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-07',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TDI GTD',
'transmission': 'automatic',
'trim': 'GTD',
'year': 2022}
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB05774%27 HTTP/1.1" 200 None
2026-03-27 10:37:47 [auto1.de] INFO: Saving data for NB05774: {'auction_closing_time': 1774713711.0, 'created_time': 1773387069.761915, 'last_price_update_time': 1774607867.39298}
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB05774') HTTP/1.1" 204 0
2026-03-27 10:37:47 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14183%27 HTTP/1.1" 200 None
2026-03-27 10:37:47 [auto1.de] INFO: Scrape type for BS14183: 2
2026-03-27 10:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccde1fa7-8f30-5cff-ac77-cf11bf9f344e with identifier: BS14183
2026-03-27 10:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccde1fa7-8f30-5cff-ac77-cf11bf9f344e with scrape type 2
2026-03-27 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccde1fa7-8f30-5cff-ac77-cf11bf9f344e with scrape type 2
2026-03-27 10:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccde1fa7-8f30-5cff-ac77-cf11bf9f344e, identifier: BS14183
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fa8%252F1ba86de8c97ea84515890b05a208e64a%252Fpa%252FNG44703_650334815de2e5ac06a0863dfe080f4b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_650334815de2e5ac06a0863dfe080f4b.jpg not downloaded yet
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_90a3e6e28fd8fcdb16e908241205a0c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_90a3e6e28fd8fcdb16e908241205a0c0.jpg not downloaded yet
2026-03-27 10:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccde1fa7-8f30-5cff-ac77-cf11bf9f344e with identifier: BS14183
2026-03-27 10:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccde1fa7-8f30-5cff-ac77-cf11bf9f344e with identifier: BS14183
2026-03-27 10:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccde1fa7-8f30-5cff-ac77-cf11bf9f344e with identifier: BS14183 to the API
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:18:14Z',
'fuel_type': 'diesel',
'id': 'ccde1fa7-8f30-5cff-ac77-cf11bf9f344e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS14183',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 318606,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-21',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2012}
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14183%27 HTTP/1.1" 200 None
2026-03-27 10:37:47 [auto1.de] INFO: Saving data for BS14183: {'auction_closing_time': 1774714694.0, 'created_time': 1773657878.991557, 'last_price_update_time': 1774607867.904532}
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS14183') HTTP/1.1" 204 0
2026-03-27 10:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG00954/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:48 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 10502 | hits on page: 40
2026-03-27 10:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_9b5c32d21275d244b671edb0789eec4a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_5bcd49b160393eafd658a6ba0cfb5203.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:48 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN10477%27 HTTP/1.1" 200 None
2026-03-27 10:37:48 [auto1.de] INFO: Scrape type for YN10477: 2
2026-03-27 10:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 767874dd-8854-5495-b26e-2ed022d09474 with identifier: YN10477
2026-03-27 10:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 767874dd-8854-5495-b26e-2ed022d09474 with scrape type 2
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 767874dd-8854-5495-b26e-2ed022d09474 with scrape type 2
2026-03-27 10:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 767874dd-8854-5495-b26e-2ed022d09474, identifier: YN10477
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fa8%252F1ba86de8c97ea84515890b05a208e64a%252Fpa%252FNG44703_75f9a4974b5f2438ee07e67e1f0a7bb0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_75f9a4974b5f2438ee07e67e1f0a7bb0.jpg not downloaded yet
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_c6b5b614cae23561a3a32c22370190db.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_c6b5b614cae23561a3a32c22370190db.jpg not downloaded yet
2026-03-27 10:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_364505d42bc069a7d77b642938d48b63.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 767874dd-8854-5495-b26e-2ed022d09474 with identifier: YN10477
2026-03-27 10:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 767874dd-8854-5495-b26e-2ed022d09474 with identifier: YN10477
2026-03-27 10:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 767874dd-8854-5495-b26e-2ed022d09474 with identifier: YN10477 to the API
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 235,
'expiration_date': '2026-03-28T16:49:04Z',
'fuel_type': 'diesel',
'id': '767874dd-8854-5495-b26e-2ed022d09474',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN10477',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 202455,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-29',
'seller_name': None,
'title': 'Volvo XC90 2.0 D5 Momentum AWD',
'transmission': 'automatic',
'trim': 'Momentum AWD',
'year': 2016}
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN10477%27 HTTP/1.1" 200 None
2026-03-27 10:37:48 [auto1.de] INFO: Saving data for YN10477: {'auction_closing_time': 1774716544.0, 'created_time': 1774262580.263548, 'last_price_update_time': 1774607868.644525}
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN10477') HTTP/1.1" 204 0
2026-03-27 10:37:48 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-27 10:37:48 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68921%27 HTTP/1.1" 200 None
2026-03-27 10:37:48 [auto1.de] INFO: Scrape type for JV68921: 2
2026-03-27 10:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 578483f7-106b-5d5c-aa13-65f7a53dd0d4 with identifier: JV68921
2026-03-27 10:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 578483f7-106b-5d5c-aa13-65f7a53dd0d4 with scrape type 2
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 578483f7-106b-5d5c-aa13-65f7a53dd0d4 with scrape type 2
2026-03-27 10:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 578483f7-106b-5d5c-aa13-65f7a53dd0d4, identifier: JV68921
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e71d0>
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4a405ad-9c93-5878-9f15-78035a93bfa7/b4a405ad-9c93-5878-9f15-78035a93bfa7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fa8%252F1ba86de8c97ea84515890b05a208e64a%252Fpa%252FNG44703_c8188a11b6ca6e312b508c1b1156b350.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_c8188a11b6ca6e312b508c1b1156b350.jpg saved to cache
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4a405ad-9c93-5878-9f15-78035a93bfa7
2026-03-27 10:37:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_50f1512a06b0bc497170baa6f9e1b862.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:48 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD55088%27 HTTP/1.1" 200 None
2026-03-27 10:37:48 [auto1.de] INFO: Scrape type for FD55088: 2
2026-03-27 10:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cae73e79-fd7c-582c-b87e-cd4fdbb01de2 with identifier: FD55088
2026-03-27 10:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cae73e79-fd7c-582c-b87e-cd4fdbb01de2 with scrape type 2
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cae73e79-fd7c-582c-b87e-cd4fdbb01de2 with scrape type 2
2026-03-27 10:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cae73e79-fd7c-582c-b87e-cd4fdbb01de2, identifier: FD55088
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_5072db9a5dc1f7ff4819449c6079ebcb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_5072db9a5dc1f7ff4819449c6079ebcb.jpg not downloaded yet
2026-03-27 10:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 578483f7-106b-5d5c-aa13-65f7a53dd0d4 with identifier: JV68921
2026-03-27 10:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 578483f7-106b-5d5c-aa13-65f7a53dd0d4 with identifier: JV68921
2026-03-27 10:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 578483f7-106b-5d5c-aa13-65f7a53dd0d4 with identifier: JV68921 to the API
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 188,
'expiration_date': '2026-03-28T16:50:36Z',
'fuel_type': 'hybrid',
'id': '578483f7-106b-5d5c-aa13-65f7a53dd0d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV68921',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Eclipse Cross',
'odometer': 44585,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-01',
'seller_name': None,
'title': 'Mitsubishi Eclipse Cross 2.4 Plug-in Hybrid Plus 4WD',
'transmission': 'automatic',
'trim': 'Plus 4WD',
'year': 2021}
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68921%27 HTTP/1.1" 200 None
2026-03-27 10:37:49 [auto1.de] INFO: Saving data for JV68921: {'auction_closing_time': 1774716636.0, 'created_time': 1774293915.315679, 'last_price_update_time': 1774607869.257959}
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV68921') HTTP/1.1" 204 0
2026-03-27 10:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cae73e79-fd7c-582c-b87e-cd4fdbb01de2 with identifier: FD55088
2026-03-27 10:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cae73e79-fd7c-582c-b87e-cd4fdbb01de2 with identifier: FD55088
2026-03-27 10:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cae73e79-fd7c-582c-b87e-cd4fdbb01de2 with identifier: FD55088 to the API
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-03-28T16:27:37Z',
'fuel_type': 'petrol',
'id': 'cae73e79-fd7c-582c-b87e-cd4fdbb01de2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD55088',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 238568,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-04-07',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 320 T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2004}
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD55088%27 HTTP/1.1" 200 None
2026-03-27 10:37:49 [auto1.de] INFO: Saving data for FD55088: {'auction_closing_time': 1774715257.0, 'created_time': 1774349944.992767, 'last_price_update_time': 1774607869.724279}
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD55088') HTTP/1.1" 204 0
2026-03-27 10:37:49 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU97792%27 HTTP/1.1" 200 None
2026-03-27 10:37:49 [auto1.de] INFO: Scrape type for TU97792: 2
2026-03-27 10:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf with identifier: TU97792
2026-03-27 10:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf with scrape type 2
2026-03-27 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf with scrape type 2
2026-03-27 10:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf, identifier: TU97792
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2247d0>
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_9b5c32d21275d244b671edb0789eec4a.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_9b5c32d21275d244b671edb0789eec4a.jpg saved to cache
2026-03-27 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7279628-8c27-54c7-a514-a6c484547c0b
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0cc790>
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4a405ad-9c93-5878-9f15-78035a93bfa7/b4a405ad-9c93-5878-9f15-78035a93bfa7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fa8%252F1ba86de8c97ea84515890b05a208e64a%252Fpa%252FNG44703_5bcd49b160393eafd658a6ba0cfb5203.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_5bcd49b160393eafd658a6ba0cfb5203.jpg saved to cache
2026-03-27 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4a405ad-9c93-5878-9f15-78035a93bfa7
2026-03-27 10:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_b1160cf29bb012775a8a65183158aef7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_fcc9cf4c467a01e9ca8a1df1f0566b70.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:49 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ55573%27 HTTP/1.1" 200 None
2026-03-27 10:37:49 [auto1.de] INFO: Scrape type for KJ55573: 2
2026-03-27 10:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0 with identifier: KJ55573
2026-03-27 10:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0 with scrape type 2
2026-03-27 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0 with scrape type 2
2026-03-27 10:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0, identifier: KJ55573
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_bff34a99a7c55b160bc713d317c24cc3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_bff34a99a7c55b160bc713d317c24cc3.jpg not downloaded yet
2026-03-27 10:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf with identifier: TU97792
2026-03-27 10:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf with identifier: TU97792
2026-03-27 10:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 720c9c0a-b91f-5e92-bc08-7f234d3e9ddf with identifier: TU97792 to the API
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 349,
'expiration_date': '2026-03-28T16:32:28Z',
'fuel_type': 'diesel',
'id': '720c9c0a-b91f-5e92-bc08-7f234d3e9ddf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU97792',
'listing': 'auction',
'make': 'Audi',
'model': 'S6',
'odometer': 76073,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-09',
'seller_name': None,
'title': 'Audi S6 3.0 TDI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2020}
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU97792%27 HTTP/1.1" 200 None
2026-03-27 10:37:50 [auto1.de] INFO: Saving data for TU97792: {'auction_closing_time': 1774715548.0, 'created_time': 1774293193.95069, 'last_price_update_time': 1774607870.427815}
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU97792') HTTP/1.1" 204 0
2026-03-27 10:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_650334815de2e5ac06a0863dfe080f4b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_90a3e6e28fd8fcdb16e908241205a0c0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0 with identifier: KJ55573
2026-03-27 10:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0 with identifier: KJ55573
2026-03-27 10:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0 with identifier: KJ55573 to the API
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-28T16:45:30Z',
'fuel_type': 'diesel',
'id': 'eaae3afa-2e08-565a-ad2c-b3ad6cbed0b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ55573',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLK-Klasse',
'odometer': 180448,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-23',
'seller_name': None,
'title': 'Mercedes-Benz GLK-Klasse GLK 200 CDI',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ55573%27 HTTP/1.1" 200 None
2026-03-27 10:37:50 [auto1.de] INFO: Saving data for KJ55573: {'auction_closing_time': 1774716330.0, 'created_time': 1774293423.03468, 'last_price_update_time': 1774607870.773493}
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ55573') HTTP/1.1" 204 0
2026-03-27 10:37:50 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG31593%27 HTTP/1.1" 200 None
2026-03-27 10:37:50 [auto1.de] INFO: Scrape type for VG31593: 2
2026-03-27 10:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb09a726-8673-56d7-901b-435312ad1eb7 with identifier: VG31593
2026-03-27 10:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb09a726-8673-56d7-901b-435312ad1eb7 with scrape type 2
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb09a726-8673-56d7-901b-435312ad1eb7 with scrape type 2
2026-03-27 10:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb09a726-8673-56d7-901b-435312ad1eb7, identifier: VG31593
2026-03-27 10:37:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e9950>
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4a405ad-9c93-5878-9f15-78035a93bfa7/b4a405ad-9c93-5878-9f15-78035a93bfa7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fa8%252F1ba86de8c97ea84515890b05a208e64a%252Fpa%252FNG44703_364505d42bc069a7d77b642938d48b63.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_364505d42bc069a7d77b642938d48b63.jpg saved to cache
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4a405ad-9c93-5878-9f15-78035a93bfa7
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be011790>
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_50f1512a06b0bc497170baa6f9e1b862.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_50f1512a06b0bc497170baa6f9e1b862.jpg saved to cache
2026-03-27 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7279628-8c27-54c7-a514-a6c484547c0b
2026-03-27 10:37:51 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-27 10:37:51 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-27 10:37:51 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN13511%27 HTTP/1.1" 200 None
2026-03-27 10:37:51 [auto1.de] INFO: Scrape type for UN13511: 2
2026-03-27 10:37:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37544f20-f4f9-5ba6-a37e-5c299210d676 with identifier: UN13511
2026-03-27 10:37:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37544f20-f4f9-5ba6-a37e-5c299210d676 with scrape type 2
2026-03-27 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37544f20-f4f9-5ba6-a37e-5c299210d676 with scrape type 2
2026-03-27 10:37:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37544f20-f4f9-5ba6-a37e-5c299210d676, identifier: UN13511
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_bdae8df7f8eb15bd6f2f303de690ae5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_bdae8df7f8eb15bd6f2f303de690ae5b.jpg not downloaded yet
2026-03-27 10:37:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb09a726-8673-56d7-901b-435312ad1eb7 with identifier: VG31593
2026-03-27 10:37:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb09a726-8673-56d7-901b-435312ad1eb7 with identifier: VG31593
2026-03-27 10:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb09a726-8673-56d7-901b-435312ad1eb7 with identifier: VG31593 to the API
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:40:51Z',
'fuel_type': 'petrol',
'id': 'bb09a726-8673-56d7-901b-435312ad1eb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG31593',
'listing': 'auction',
'make': 'Fiat',
'model': 'Tipo',
'odometer': 62671,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-03',
'seller_name': None,
'title': 'Fiat Tipo 1.4 Turbo Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2017}
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG31593%27 HTTP/1.1" 200 None
2026-03-27 10:37:51 [auto1.de] INFO: Saving data for VG31593: {'auction_closing_time': 1774716051.0, 'created_time': 1773400548.816226, 'last_price_update_time': 1774607871.573725}
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG31593') HTTP/1.1" 204 0
2026-03-27 10:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_75f9a4974b5f2438ee07e67e1f0a7bb0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37544f20-f4f9-5ba6-a37e-5c299210d676 with identifier: UN13511
2026-03-27 10:37:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37544f20-f4f9-5ba6-a37e-5c299210d676 with identifier: UN13511
2026-03-27 10:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37544f20-f4f9-5ba6-a37e-5c299210d676 with identifier: UN13511 to the API
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 145,
'expiration_date': '2026-03-28T16:34:33Z',
'fuel_type': 'petrol',
'id': '37544f20-f4f9-5ba6-a37e-5c299210d676',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN13511',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 17692,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-14',
'seller_name': None,
'title': 'Ford Focus 2.0 Ghia',
'transmission': 'manual',
'trim': 'Ghia',
'year': 2009}
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN13511%27 HTTP/1.1" 200 None
2026-03-27 10:37:51 [auto1.de] INFO: Saving data for UN13511: {'auction_closing_time': 1774715673.0, 'created_time': 1772546597.414282, 'last_price_update_time': 1774607871.93377}
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN13511') HTTP/1.1" 204 0
2026-03-27 10:37:51 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF39323%27 HTTP/1.1" 200 None
2026-03-27 10:37:51 [auto1.de] INFO: Scrape type for SF39323: 2
2026-03-27 10:37:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 516bf52b-7d1a-5824-8a78-514fd82ab9be with identifier: SF39323
2026-03-27 10:37:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 516bf52b-7d1a-5824-8a78-514fd82ab9be with scrape type 2
2026-03-27 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 516bf52b-7d1a-5824-8a78-514fd82ab9be with scrape type 2
2026-03-27 10:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 516bf52b-7d1a-5824-8a78-514fd82ab9be, identifier: SF39323
2026-03-27 10:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX11179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2aac50>
2026-03-27 10:37:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4a405ad-9c93-5878-9f15-78035a93bfa7/b4a405ad-9c93-5878-9f15-78035a93bfa7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fa8%252F1ba86de8c97ea84515890b05a208e64a%252Fpa%252FNG44703_b1160cf29bb012775a8a65183158aef7.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_b1160cf29bb012775a8a65183158aef7.jpg saved to cache
2026-03-27 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4a405ad-9c93-5878-9f15-78035a93bfa7
2026-03-27 10:37:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5356410>
2026-03-27 10:37:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_fcc9cf4c467a01e9ca8a1df1f0566b70.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_fcc9cf4c467a01e9ca8a1df1f0566b70.jpg saved to cache
2026-03-27 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7279628-8c27-54c7-a514-a6c484547c0b
2026-03-27 10:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_ae89f83ede3876cec048e817c3c92316.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_c6b5b614cae23561a3a32c22370190db.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_5159a6b00090f725de0e8e48f32928ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_5159a6b00090f725de0e8e48f32928ec.jpg not downloaded yet
2026-03-27 10:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 516bf52b-7d1a-5824-8a78-514fd82ab9be with identifier: SF39323
2026-03-27 10:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 516bf52b-7d1a-5824-8a78-514fd82ab9be with identifier: SF39323
2026-03-27 10:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 516bf52b-7d1a-5824-8a78-514fd82ab9be with identifier: SF39323 to the API
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:40:23Z',
'fuel_type': 'diesel',
'id': '516bf52b-7d1a-5824-8a78-514fd82ab9be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF39323',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 214198,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-05-03',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline',
'transmission': 'automatic',
'trim': 'Highline',
'year': 2007}
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF39323%27 HTTP/1.1" 200 None
2026-03-27 10:37:52 [auto1.de] INFO: Saving data for SF39323: {'auction_closing_time': 1774716023.0, 'created_time': 1773341507.645434, 'last_price_update_time': 1774607872.600972}
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF39323') HTTP/1.1" 204 0
2026-03-27 10:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_5072db9a5dc1f7ff4819449c6079ebcb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS71504%27 HTTP/1.1" 200 None
2026-03-27 10:37:52 [auto1.de] INFO: Scrape type for DS71504: 2
2026-03-27 10:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a16104c-a989-59e4-a076-4ccb828c94a3 with identifier: DS71504
2026-03-27 10:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a16104c-a989-59e4-a076-4ccb828c94a3 with scrape type 2
2026-03-27 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a16104c-a989-59e4-a076-4ccb828c94a3 with scrape type 2
2026-03-27 10:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a16104c-a989-59e4-a076-4ccb828c94a3, identifier: DS71504
2026-03-27 10:37:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be13a410>
2026-03-27 10:37:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4a405ad-9c93-5878-9f15-78035a93bfa7/b4a405ad-9c93-5878-9f15-78035a93bfa7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fa8%252F1ba86de8c97ea84515890b05a208e64a%252Fpa%252FNG44703_650334815de2e5ac06a0863dfe080f4b.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_650334815de2e5ac06a0863dfe080f4b.jpg saved to cache
2026-03-27 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4a405ad-9c93-5878-9f15-78035a93bfa7
2026-03-27 10:37:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be039710>
2026-03-27 10:37:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_90a3e6e28fd8fcdb16e908241205a0c0.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_90a3e6e28fd8fcdb16e908241205a0c0.jpg saved to cache
2026-03-27 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7279628-8c27-54c7-a514-a6c484547c0b
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_9ac7eeb2b8664b43ade003e02add992d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_9ac7eeb2b8664b43ade003e02add992d.jpg not downloaded yet
2026-03-27 10:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a16104c-a989-59e4-a076-4ccb828c94a3 with identifier: DS71504
2026-03-27 10:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a16104c-a989-59e4-a076-4ccb828c94a3 with identifier: DS71504
2026-03-27 10:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a16104c-a989-59e4-a076-4ccb828c94a3 with identifier: DS71504 to the API
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:44:35Z',
'fuel_type': 'petrol',
'id': '5a16104c-a989-59e4-a076-4ccb828c94a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS71504',
'listing': 'auction',
'make': 'Jeep',
'model': 'Wrangler Unlimited',
'odometer': 318722,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-30',
'seller_name': None,
'title': 'Jeep Wrangler Unlimited 3.8 V6 Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2009}
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS71504%27 HTTP/1.1" 200 None
2026-03-27 10:37:53 [auto1.de] INFO: Saving data for DS71504: {'auction_closing_time': 1774716275.0, 'created_time': 1773774573.224593, 'last_price_update_time': 1774607873.36939}
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS71504') HTTP/1.1" 204 0
2026-03-27 10:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_d0dc6eb2efb15705501adaa6f7deae77.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_bff34a99a7c55b160bc713d317c24cc3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:53 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-27 10:37:53 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-27 10:37:53 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-27 10:37:53 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-27 10:37:53 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-27 10:37:53 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-27 10:37:53 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-27 10:37:53 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-27 10:37:53 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE41577%27 HTTP/1.1" 200 None
2026-03-27 10:37:53 [auto1.de] INFO: Scrape type for ZE41577: 2
2026-03-27 10:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28e0b63b-a1f1-5434-b83d-e69deadc7fa3 with identifier: ZE41577
2026-03-27 10:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28e0b63b-a1f1-5434-b83d-e69deadc7fa3 with scrape type 2
2026-03-27 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28e0b63b-a1f1-5434-b83d-e69deadc7fa3 with scrape type 2
2026-03-27 10:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28e0b63b-a1f1-5434-b83d-e69deadc7fa3, identifier: ZE41577
2026-03-27 10:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf31790>
2026-03-27 10:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4a405ad-9c93-5878-9f15-78035a93bfa7/b4a405ad-9c93-5878-9f15-78035a93bfa7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fa8%252F1ba86de8c97ea84515890b05a208e64a%252Fpa%252FNG44703_75f9a4974b5f2438ee07e67e1f0a7bb0.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_75f9a4974b5f2438ee07e67e1f0a7bb0.jpg saved to cache
2026-03-27 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4a405ad-9c93-5878-9f15-78035a93bfa7
2026-03-27 10:37:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4a405ad-9c93-5878-9f15-78035a93bfa7, skipping ID generation
2026-03-27 10:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4a405ad-9c93-5878-9f15-78035a93bfa7 with scrape type 1
2026-03-27 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4a405ad-9c93-5878-9f15-78035a93bfa7 sending to next pipeline
2026-03-27 10:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4a405ad-9c93-5878-9f15-78035a93bfa7, identifier: NG44703
2026-03-27 10:37:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5511790>
2026-03-27 10:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F88%252Fe788e03ef751d1742052214bf6bf4838%252Fpa%252FFR92717_ae89f83ede3876cec048e817c3c92316.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_ae89f83ede3876cec048e817c3c92316.jpg saved to cache
2026-03-27 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcf531ae-96c1-569c-a7c7-f12a6e59abd6
2026-03-27 10:37:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcf531ae-96c1-569c-a7c7-f12a6e59abd6, skipping ID generation
2026-03-27 10:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcf531ae-96c1-569c-a7c7-f12a6e59abd6 with scrape type 1
2026-03-27 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcf531ae-96c1-569c-a7c7-f12a6e59abd6 sending to next pipeline
2026-03-27 10:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcf531ae-96c1-569c-a7c7-f12a6e59abd6, identifier: FR92717
2026-03-27 10:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5b3a90>
2026-03-27 10:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_c6b5b614cae23561a3a32c22370190db.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_c6b5b614cae23561a3a32c22370190db.jpg saved to cache
2026-03-27 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7279628-8c27-54c7-a514-a6c484547c0b
2026-03-27 10:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28e0b63b-a1f1-5434-b83d-e69deadc7fa3 with identifier: ZE41577
2026-03-27 10:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28e0b63b-a1f1-5434-b83d-e69deadc7fa3 with identifier: ZE41577
2026-03-27 10:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28e0b63b-a1f1-5434-b83d-e69deadc7fa3 with identifier: ZE41577 to the API
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:51:56Z',
'fuel_type': 'diesel',
'id': '28e0b63b-a1f1-5434-b83d-e69deadc7fa3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE41577',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 56337,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-19',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi Mild-Hybrid 320 L1 Tourneo Titanium',
'transmission': 'manual',
'trim': '320 L1 Tourneo Titanium',
'year': 2022}
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE41577%27 HTTP/1.1" 200 None
2026-03-27 10:37:54 [auto1.de] INFO: Saving data for ZE41577: {'auction_closing_time': 1774716716.0, 'created_time': 1773513911.847413, 'last_price_update_time': 1774607874.454235}
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE41577') HTTP/1.1" 204 0
2026-03-27 10:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4a405ad-9c93-5878-9f15-78035a93bfa7 with identifier: NG44703
2026-03-27 10:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4a405ad-9c93-5878-9f15-78035a93bfa7 with identifier: NG44703
2026-03-27 10:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4a405ad-9c93-5878-9f15-78035a93bfa7 with identifier: NG44703 to the API
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_75f9a4974b5f2438ee07e67e1f0a7bb0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 166,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:29:18Z',
'fuel_type': 'petrol',
'id': 'b4a405ad-9c93-5878-9f15-78035a93bfa7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG44703',
'listing': 'auction',
'location': 'DE, Eisenach',
'make': 'Renault',
'model': 'Megane',
'odometer': 143570,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4a405ad-9c93-5878-9f15-78035a93bfa7/b4a405ad-9c93-5878-9f15-78035a93bfa7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_c8188a11b6ca6e312b508c1b1156b350.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4a405ad-9c93-5878-9f15-78035a93bfa7/b4a405ad-9c93-5878-9f15-78035a93bfa7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72427,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_5bcd49b160393eafd658a6ba0cfb5203.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4a405ad-9c93-5878-9f15-78035a93bfa7/b4a405ad-9c93-5878-9f15-78035a93bfa7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84766,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_364505d42bc069a7d77b642938d48b63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4a405ad-9c93-5878-9f15-78035a93bfa7/b4a405ad-9c93-5878-9f15-78035a93bfa7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73857,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_b1160cf29bb012775a8a65183158aef7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4a405ad-9c93-5878-9f15-78035a93bfa7/b4a405ad-9c93-5878-9f15-78035a93bfa7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123942,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_650334815de2e5ac06a0863dfe080f4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4a405ad-9c93-5878-9f15-78035a93bfa7/b4a405ad-9c93-5878-9f15-78035a93bfa7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/a8/1ba86de8c97ea84515890b05a208e64a/pa/NG44703_75f9a4974b5f2438ee07e67e1f0a7bb0.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.6 Avantage',
'transmission': 'manual',
'trim': 'Avantage',
'year': 2007}
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG44703%27 HTTP/1.1" 200 None
2026-03-27 10:37:54 [auto1.de] INFO: Saving data for NG44703: {'created_time': 1774607874.812894, 'last_price_update_time': 1774607874.812906, 'auction_closing_time': 1774715358.0}
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG44703') HTTP/1.1" 204 0
2026-03-27 10:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcf531ae-96c1-569c-a7c7-f12a6e59abd6 with identifier: FR92717
2026-03-27 10:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcf531ae-96c1-569c-a7c7-f12a6e59abd6 with identifier: FR92717
2026-03-27 10:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcf531ae-96c1-569c-a7c7-f12a6e59abd6 with identifier: FR92717 to the API
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_ae89f83ede3876cec048e817c3c92316.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:50:50Z',
'fuel_type': 'diesel',
'id': 'fcf531ae-96c1-569c-a7c7-f12a6e59abd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR92717',
'listing': 'auction',
'location': 'DE, Leipzig',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 195183,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74958,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_5f63755a30df77ea684f98b66c6e20f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66675,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_fde9835dc187c626f6c746db362ec195.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70404,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_6ddf06b1053b8d00b335366ece18913c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2495904,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_ae89f83ede3876cec048e817c3c92316.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_1c31022f401c19c8d576723891bc474c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2642863,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_c96bc11fac22c4e5ec8dba5eb2687dc6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2502932,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_04512596f63d27016cdf6811f981552c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2927208,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_d74db13daac88618cae543ff92757681.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82146,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_aadaa6a637677cb30e3ffbab677f9284.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf531ae-96c1-569c-a7c7-f12a6e59abd6/fcf531ae-96c1-569c-a7c7-f12a6e59abd6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79995,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/88/e788e03ef751d1742052214bf6bf4838/pa/FR92717_f45caf3eefab9c93f3c4ef97e889eb44.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2010}
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR92717%27 HTTP/1.1" 200 None
2026-03-27 10:37:55 [auto1.de] INFO: Saving data for FR92717: {'created_time': 1774607875.210748, 'last_price_update_time': 1774607875.210761, 'auction_closing_time': 1774716650.0}
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR92717') HTTP/1.1" 204 0
2026-03-27 10:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3c6c50>
2026-03-27 10:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_5072db9a5dc1f7ff4819449c6079ebcb.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_5072db9a5dc1f7ff4819449c6079ebcb.jpg saved to cache
2026-03-27 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7279628-8c27-54c7-a514-a6c484547c0b
2026-03-27 10:37:55 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-27 10:37:55 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-27 10:37:55 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ65167%27 HTTP/1.1" 200 None
2026-03-27 10:37:55 [auto1.de] INFO: Scrape type for EJ65167: 2
2026-03-27 10:37:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eae9671e-9421-543e-b9fc-2939da586128 with identifier: EJ65167
2026-03-27 10:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eae9671e-9421-543e-b9fc-2939da586128 with scrape type 2
2026-03-27 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eae9671e-9421-543e-b9fc-2939da586128 with scrape type 2
2026-03-27 10:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eae9671e-9421-543e-b9fc-2939da586128, identifier: EJ65167
2026-03-27 10:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_bdae8df7f8eb15bd6f2f303de690ae5b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eae9671e-9421-543e-b9fc-2939da586128 with identifier: EJ65167
2026-03-27 10:37:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eae9671e-9421-543e-b9fc-2939da586128 with identifier: EJ65167
2026-03-27 10:37:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eae9671e-9421-543e-b9fc-2939da586128 with identifier: EJ65167 to the API
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:58:05Z',
'fuel_type': 'petrol',
'id': 'eae9671e-9421-543e-b9fc-2939da586128',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ65167',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 101389,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-26',
'seller_name': None,
'title': 'Volkswagen Beetle 1.2 TSI Design BlueMotion Tech',
'transmission': 'manual',
'trim': 'Design BlueMotion Tech',
'year': 2016}
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ65167%27 HTTP/1.1" 200 None
2026-03-27 10:37:55 [auto1.de] INFO: Saving data for EJ65167: {'auction_closing_time': 1774717085.0, 'created_time': 1774330258.749606, 'last_price_update_time': 1774607875.725889}
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ65167') HTTP/1.1" 204 0
2026-03-27 10:37:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2c7950>
2026-03-27 10:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fec%252F8eeca923803e195f28b32efed92efbc4%252Fpa%252FUN23019_d0dc6eb2efb15705501adaa6f7deae77.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_d0dc6eb2efb15705501adaa6f7deae77.jpg saved to cache
2026-03-27 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3c20ecd-2036-53bb-aae1-3f76fc3d8d32
2026-03-27 10:37:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3c20ecd-2036-53bb-aae1-3f76fc3d8d32, skipping ID generation
2026-03-27 10:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c20ecd-2036-53bb-aae1-3f76fc3d8d32 with scrape type 1
2026-03-27 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3c20ecd-2036-53bb-aae1-3f76fc3d8d32 sending to next pipeline
2026-03-27 10:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3c20ecd-2036-53bb-aae1-3f76fc3d8d32, identifier: UN23019
2026-03-27 10:37:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be262310>
2026-03-27 10:37:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_bff34a99a7c55b160bc713d317c24cc3.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_bff34a99a7c55b160bc713d317c24cc3.jpg saved to cache
2026-03-27 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7279628-8c27-54c7-a514-a6c484547c0b
2026-03-27 10:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_5159a6b00090f725de0e8e48f32928ec.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:56 [auto1.de] INFO: Found listing with ID: DM09688
2026-03-27 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM09688%27 HTTP/1.1" 200 None
2026-03-27 10:37:56 [auto1.de] INFO: Scrape type for DM09688: 2
2026-03-27 10:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bedea8c-86ef-55b4-b91a-2b03e16d7a96 with identifier: DM09688
2026-03-27 10:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bedea8c-86ef-55b4-b91a-2b03e16d7a96 with scrape type 2
2026-03-27 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bedea8c-86ef-55b4-b91a-2b03e16d7a96 with scrape type 2
2026-03-27 10:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bedea8c-86ef-55b4-b91a-2b03e16d7a96, identifier: DM09688
2026-03-27 10:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3c20ecd-2036-53bb-aae1-3f76fc3d8d32 with identifier: UN23019
2026-03-27 10:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3c20ecd-2036-53bb-aae1-3f76fc3d8d32 with identifier: UN23019
2026-03-27 10:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3c20ecd-2036-53bb-aae1-3f76fc3d8d32 with identifier: UN23019 to the API
2026-03-27 10:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_d0dc6eb2efb15705501adaa6f7deae77.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:51:45Z',
'fuel_type': 'diesel',
'id': 'b3c20ecd-2036-53bb-aae1-3f76fc3d8d32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN23019',
'listing': 'auction',
'location': 'DE, Hilden',
'make': 'Skoda',
'model': 'Superb',
'odometer': 194498,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74319,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_91fec5905975f433244931559e27f673.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_5046ed9e4c3c96e0e3fb5772b4324099.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2938150,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_d0dc6eb2efb15705501adaa6f7deae77.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_f8bbcd6357114bb7c853cfac034db7de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58536,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_aa950dd0f216c068f357392df0e59486.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2336726,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_5cea3afafc3fcd4986156993b092bb16.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55722,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_c81577ba4dde551e676afb07ad1b305d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72257,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_aa9276a589a91bc4e997ccf31a44b2a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_afb774b5694db0b4631adacd6d9dbdc3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3c20ecd-2036-53bb-aae1-3f76fc3d8d32/b3c20ecd-2036-53bb-aae1-3f76fc3d8d32_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/ec/8eeca923803e195f28b32efed92efbc4/pa/UN23019_f073cc93305b37ffa4b3ac438ffe6940.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2014}
2026-03-27 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN23019%27 HTTP/1.1" 200 None
2026-03-27 10:37:56 [auto1.de] INFO: Saving data for UN23019: {'created_time': 1774607876.616746, 'last_price_update_time': 1774607876.616758, 'auction_closing_time': 1774716705.0}
2026-03-27 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN23019') HTTP/1.1" 204 0
2026-03-27 10:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bedea8c-86ef-55b4-b91a-2b03e16d7a96 with identifier: DM09688
2026-03-27 10:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bedea8c-86ef-55b4-b91a-2b03e16d7a96 with identifier: DM09688
2026-03-27 10:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bedea8c-86ef-55b4-b91a-2b03e16d7a96 with identifier: DM09688 to the API
2026-03-27 10:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 218,
'expiration_date': '2026-03-28T16:47:48Z',
'fuel_type': 'hybrid',
'id': '2bedea8c-86ef-55b4-b91a-2b03e16d7a96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM09688',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse Limousine',
'odometer': 83000,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-22',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse Limousine A 250e AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM09688%27 HTTP/1.1" 200 None
2026-03-27 10:37:57 [auto1.de] INFO: Saving data for DM09688: {'auction_closing_time': 1774716468.0, 'created_time': 1773304748.988045, 'last_price_update_time': 1774607877.433768}
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM09688') HTTP/1.1" 204 0
2026-03-27 10:37:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_e311c87d0b895945583945ef71d58369.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:57 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC63717%27 HTTP/1.1" 200 None
2026-03-27 10:37:57 [auto1.de] INFO: Scrape type for FC63717: 2
2026-03-27 10:37:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4202cc82-8783-587b-94f3-5bf44f83d80a with identifier: FC63717
2026-03-27 10:37:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4202cc82-8783-587b-94f3-5bf44f83d80a with scrape type 2
2026-03-27 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4202cc82-8783-587b-94f3-5bf44f83d80a with scrape type 2
2026-03-27 10:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4202cc82-8783-587b-94f3-5bf44f83d80a, identifier: FC63717
2026-03-27 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2f3450>
2026-03-27 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_bdae8df7f8eb15bd6f2f303de690ae5b.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_bdae8df7f8eb15bd6f2f303de690ae5b.jpg saved to cache
2026-03-27 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7279628-8c27-54c7-a514-a6c484547c0b
2026-03-27 10:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4202cc82-8783-587b-94f3-5bf44f83d80a with identifier: FC63717
2026-03-27 10:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4202cc82-8783-587b-94f3-5bf44f83d80a with identifier: FC63717
2026-03-27 10:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4202cc82-8783-587b-94f3-5bf44f83d80a with identifier: FC63717 to the API
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-28T16:59:35Z',
'fuel_type': 'petrol',
'id': '4202cc82-8783-587b-94f3-5bf44f83d80a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC63717',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 193879,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-05-02',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 280 T Elegance',
'transmission': 'automatic',
'trim': 'T Elegance',
'year': 2007}
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC63717%27 HTTP/1.1" 200 None
2026-03-27 10:37:57 [auto1.de] INFO: Saving data for FC63717: {'auction_closing_time': 1774717175.0, 'created_time': 1773400373.320799, 'last_price_update_time': 1774607877.966123}
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC63717') HTTP/1.1" 204 0
2026-03-27 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2f1050>
2026-03-27 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_5159a6b00090f725de0e8e48f32928ec.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_5159a6b00090f725de0e8e48f32928ec.jpg saved to cache
2026-03-27 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7279628-8c27-54c7-a514-a6c484547c0b
2026-03-27 10:37:58 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-27 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC48235%27 HTTP/1.1" 200 None
2026-03-27 10:37:58 [auto1.de] INFO: Scrape type for UC48235: 2
2026-03-27 10:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f844a996-7748-5fb5-834a-0e0b804d35ea with identifier: UC48235
2026-03-27 10:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f844a996-7748-5fb5-834a-0e0b804d35ea with scrape type 2
2026-03-27 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f844a996-7748-5fb5-834a-0e0b804d35ea with scrape type 2
2026-03-27 10:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f844a996-7748-5fb5-834a-0e0b804d35ea, identifier: UC48235
2026-03-27 10:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB94614> (referer: https://www.auto1.com/v1/car-details-view/MB94614/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f844a996-7748-5fb5-834a-0e0b804d35ea with identifier: UC48235
2026-03-27 10:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f844a996-7748-5fb5-834a-0e0b804d35ea with identifier: UC48235
2026-03-27 10:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f844a996-7748-5fb5-834a-0e0b804d35ea with identifier: UC48235 to the API
2026-03-27 10:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 341,
'expiration_date': '2026-03-28T16:05:13Z',
'fuel_type': 'hybrid',
'id': 'f844a996-7748-5fb5-834a-0e0b804d35ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC48235',
'listing': 'auction',
'make': 'Volvo',
'model': 'V90',
'odometer': 78881,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-07',
'seller_name': None,
'title': 'Volvo V90 2.0 T6 Plug-in Hybrid Inscription AWD',
'transmission': 'automatic',
'trim': 'Inscription AWD',
'year': 2021}
2026-03-27 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC48235%27 HTTP/1.1" 200 None
2026-03-27 10:37:58 [auto1.de] INFO: Saving data for UC48235: {'auction_closing_time': 1774713913.0, 'created_time': 1773741152.924581, 'last_price_update_time': 1774607878.491702}
2026-03-27 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC48235') HTTP/1.1" 204 0
2026-03-27 10:37:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf31990>
2026-03-27 10:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fbe%252F3dbec2a00c5b40175f0a21ecb0ebcf1a%252Fpa%252FYW88691_e311c87d0b895945583945ef71d58369.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_e311c87d0b895945583945ef71d58369.jpg saved to cache
2026-03-27 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2636e10-6ba9-578c-ada5-3013d96fdaad
2026-03-27 10:37:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2636e10-6ba9-578c-ada5-3013d96fdaad, skipping ID generation
2026-03-27 10:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2636e10-6ba9-578c-ada5-3013d96fdaad with scrape type 1
2026-03-27 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2636e10-6ba9-578c-ada5-3013d96fdaad sending to next pipeline
2026-03-27 10:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2636e10-6ba9-578c-ada5-3013d96fdaad, identifier: YW88691
2026-03-27 10:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_9ac7eeb2b8664b43ade003e02add992d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:58 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-27 10:37:58 [auto1.de] INFO: Found listing with ID: GT54447
2026-03-27 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54447%27 HTTP/1.1" 200 None
2026-03-27 10:37:58 [auto1.de] INFO: Scrape type for GT54447: 2
2026-03-27 10:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55f72f66-aea8-5595-8cbf-0e9fd7ed591b with identifier: GT54447
2026-03-27 10:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55f72f66-aea8-5595-8cbf-0e9fd7ed591b with scrape type 2
2026-03-27 10:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55f72f66-aea8-5595-8cbf-0e9fd7ed591b with scrape type 2
2026-03-27 10:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55f72f66-aea8-5595-8cbf-0e9fd7ed591b, identifier: GT54447
2026-03-27 10:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2636e10-6ba9-578c-ada5-3013d96fdaad with identifier: YW88691
2026-03-27 10:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2636e10-6ba9-578c-ada5-3013d96fdaad with identifier: YW88691
2026-03-27 10:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2636e10-6ba9-578c-ada5-3013d96fdaad with identifier: YW88691 to the API
2026-03-27 10:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_e311c87d0b895945583945ef71d58369.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:23:03Z',
'fuel_type': 'diesel',
'id': 'e2636e10-6ba9-578c-ada5-3013d96fdaad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW88691',
'listing': 'auction',
'location': 'DE, Beckum',
'make': 'Ford',
'model': 'S-Max',
'odometer': 220940,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2728050,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_e311c87d0b895945583945ef71d58369.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_91aa59e93aaa1bd64cb50b8f08f74986.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2791953,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_4333fcf6635963eaea9477ee1a6cc6d7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73273,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_c40d41634330ea66055aa08a62e36667.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74665,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_78a363d97ea2487175d1c04427ddb4dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2856147,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_0a984d17813f0479eb41edb6b1f7a755.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72147,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_1653935775a896116793745054ba0824.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2695256,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_422e72e217ac01ff8861c13a343162f0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_e7a19637928d944dbdf0fd2cbbc61b5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2636e10-6ba9-578c-ada5-3013d96fdaad/e2636e10-6ba9-578c-ada5-3013d96fdaad_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105216,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/be/3dbec2a00c5b40175f0a21ecb0ebcf1a/pa/YW88691_b76dac533aed6b216f125bd2cb4c1894.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-05-18',
'seats_number': 5,
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2016}
2026-03-27 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW88691%27 HTTP/1.1" 200 None
2026-03-27 10:38:00 [auto1.de] INFO: Saving data for YW88691: {'created_time': 1774607879.999749, 'last_price_update_time': 1774607879.999763, 'auction_closing_time': 1774714983.0}
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW88691') HTTP/1.1" 204 0
2026-03-27 10:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55f72f66-aea8-5595-8cbf-0e9fd7ed591b with identifier: GT54447
2026-03-27 10:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55f72f66-aea8-5595-8cbf-0e9fd7ed591b with identifier: GT54447
2026-03-27 10:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55f72f66-aea8-5595-8cbf-0e9fd7ed591b with identifier: GT54447 to the API
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:44:19Z',
'fuel_type': 'petrol',
'id': '55f72f66-aea8-5595-8cbf-0e9fd7ed591b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT54447',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 50856,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-16',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2021}
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54447%27 HTTP/1.1" 200 None
2026-03-27 10:38:00 [auto1.de] INFO: Saving data for GT54447: {'auction_closing_time': 1774716259.0, 'created_time': 1772726386.234366, 'last_price_update_time': 1774607880.39881}
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT54447') HTTP/1.1" 204 0
2026-03-27 10:38:00 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-27 10:38:00 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN50331%27 HTTP/1.1" 200 None
2026-03-27 10:38:00 [auto1.de] INFO: Scrape type for EN50331: 0
2026-03-27 10:38:00 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-27 10:38:00 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-27 10:38:00 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD80009%27 HTTP/1.1" 200 None
2026-03-27 10:38:00 [auto1.de] INFO: Scrape type for PD80009: 2
2026-03-27 10:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 857ec4fb-2a56-5289-85b9-c2dd0013eb20 with identifier: PD80009
2026-03-27 10:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 857ec4fb-2a56-5289-85b9-c2dd0013eb20 with scrape type 2
2026-03-27 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 857ec4fb-2a56-5289-85b9-c2dd0013eb20 with scrape type 2
2026-03-27 10:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 857ec4fb-2a56-5289-85b9-c2dd0013eb20, identifier: PD80009
2026-03-27 10:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da1032f9-30d9-5536-8bf8-dd10bd336f3e with identifier: MB94614
2026-03-27 10:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da1032f9-30d9-5536-8bf8-dd10bd336f3e with scrape type 1
2026-03-27 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da1032f9-30d9-5536-8bf8-dd10bd336f3e
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa4%252Ff7a4a24fb25fa47a26d622aa6d50124b%252Fpa%252FMB94614_9bc976229b1c45bb0e594668057043f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_9bc976229b1c45bb0e594668057043f4.jpg already downloaded
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa4%252Ff7a4a24fb25fa47a26d622aa6d50124b%252Fpa%252FMB94614_fcaac3939020bfbacac3085e532e2964.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_fcaac3939020bfbacac3085e532e2964.jpg already downloaded
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa4%252Ff7a4a24fb25fa47a26d622aa6d50124b%252Fpa%252FMB94614_be4d1b77b876345aed7d0050ff9e8fc4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_be4d1b77b876345aed7d0050ff9e8fc4.jpg already downloaded
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa4%252Ff7a4a24fb25fa47a26d622aa6d50124b%252Fpa%252FMB94614_a56382a93cad8e03b49a685611d1c45f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_a56382a93cad8e03b49a685611d1c45f.jpg already downloaded
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa4%252Ff7a4a24fb25fa47a26d622aa6d50124b%252Fpa%252FMB94614_43906f0ced51be47342956c3e1721eee.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_43906f0ced51be47342956c3e1721eee.jpg already downloaded
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa4%252Ff7a4a24fb25fa47a26d622aa6d50124b%252Fpa%252FMB94614_387e68c7c658d2b0a46e8f2945ead5a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_387e68c7c658d2b0a46e8f2945ead5a3.jpg already downloaded
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa4%252Ff7a4a24fb25fa47a26d622aa6d50124b%252Fpa%252FMB94614_9f6b82c9a4364b4f71c1fb071ef4119f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_9f6b82c9a4364b4f71c1fb071ef4119f.jpg already downloaded
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa4%252Ff7a4a24fb25fa47a26d622aa6d50124b%252Fpa%252FMB94614_c54f77d5cb7c9b16fda04a88ab48a345.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_c54f77d5cb7c9b16fda04a88ab48a345.jpg already downloaded
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa4%252Ff7a4a24fb25fa47a26d622aa6d50124b%252Fpa%252FMB94614_258db6afa288f0a75534ae46e43e33ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_258db6afa288f0a75534ae46e43e33ba.jpg already downloaded
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa4%252Ff7a4a24fb25fa47a26d622aa6d50124b%252Fpa%252FMB94614_9ad7dee25cdf72e602e9ab1fd910aa73.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_9ad7dee25cdf72e602e9ab1fd910aa73.jpg already downloaded
2026-03-27 10:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da1032f9-30d9-5536-8bf8-dd10bd336f3e, identifier: MB94614
2026-03-27 10:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 857ec4fb-2a56-5289-85b9-c2dd0013eb20 with identifier: PD80009
2026-03-27 10:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 857ec4fb-2a56-5289-85b9-c2dd0013eb20 with identifier: PD80009
2026-03-27 10:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 857ec4fb-2a56-5289-85b9-c2dd0013eb20 with identifier: PD80009 to the API
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-28T16:57:42Z',
'fuel_type': 'diesel',
'id': '857ec4fb-2a56-5289-85b9-c2dd0013eb20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD80009',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 252762,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-21',
'seller_name': None,
'title': 'Audi A4 3.0 V6 TDI quattro S line Sportpaket plus',
'transmission': 'automatic',
'trim': 'quattro S line Sportpaket plus',
'year': 2013}
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD80009%27 HTTP/1.1" 200 None
2026-03-27 10:38:02 [auto1.de] INFO: Saving data for PD80009: {'auction_closing_time': 1774717062.0, 'created_time': 1774294710.373887, 'last_price_update_time': 1774607882.89625}
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD80009') HTTP/1.1" 204 0
2026-03-27 10:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP35313> (referer: https://www.auto1.com/v1/car-details-view/WP35313/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da1032f9-30d9-5536-8bf8-dd10bd336f3e with identifier: MB94614
2026-03-27 10:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da1032f9-30d9-5536-8bf8-dd10bd336f3e with identifier: MB94614
2026-03-27 10:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da1032f9-30d9-5536-8bf8-dd10bd336f3e with identifier: MB94614 to the API
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MB94614>
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:48:09Z',
'fuel_type': 'petrol',
'id': 'da1032f9-30d9-5536-8bf8-dd10bd336f3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB94614',
'listing': 'auction',
'location': 'DE, Ketzin',
'make': 'Kia',
'model': "cee'd",
'odometer': 173801,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_9bc976229b1c45bb0e594668057043f4.jpg',
'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_fcaac3939020bfbacac3085e532e2964.jpg',
'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_be4d1b77b876345aed7d0050ff9e8fc4.jpg',
'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_a56382a93cad8e03b49a685611d1c45f.jpg',
'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_43906f0ced51be47342956c3e1721eee.jpg',
'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_387e68c7c658d2b0a46e8f2945ead5a3.jpg',
'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_9f6b82c9a4364b4f71c1fb071ef4119f.jpg',
'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_c54f77d5cb7c9b16fda04a88ab48a345.jpg',
'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_258db6afa288f0a75534ae46e43e33ba.jpg',
'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_9ad7dee25cdf72e602e9ab1fd910aa73.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1032f9-30d9-5536-8bf8-dd10bd336f3e/da1032f9-30d9-5536-8bf8-dd10bd336f3e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75083,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_9bc976229b1c45bb0e594668057043f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1032f9-30d9-5536-8bf8-dd10bd336f3e/da1032f9-30d9-5536-8bf8-dd10bd336f3e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_fcaac3939020bfbacac3085e532e2964.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1032f9-30d9-5536-8bf8-dd10bd336f3e/da1032f9-30d9-5536-8bf8-dd10bd336f3e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_be4d1b77b876345aed7d0050ff9e8fc4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1032f9-30d9-5536-8bf8-dd10bd336f3e/da1032f9-30d9-5536-8bf8-dd10bd336f3e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57343,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_a56382a93cad8e03b49a685611d1c45f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1032f9-30d9-5536-8bf8-dd10bd336f3e/da1032f9-30d9-5536-8bf8-dd10bd336f3e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_43906f0ced51be47342956c3e1721eee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1032f9-30d9-5536-8bf8-dd10bd336f3e/da1032f9-30d9-5536-8bf8-dd10bd336f3e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69726,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_387e68c7c658d2b0a46e8f2945ead5a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1032f9-30d9-5536-8bf8-dd10bd336f3e/da1032f9-30d9-5536-8bf8-dd10bd336f3e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_9f6b82c9a4364b4f71c1fb071ef4119f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1032f9-30d9-5536-8bf8-dd10bd336f3e/da1032f9-30d9-5536-8bf8-dd10bd336f3e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77343,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_c54f77d5cb7c9b16fda04a88ab48a345.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1032f9-30d9-5536-8bf8-dd10bd336f3e/da1032f9-30d9-5536-8bf8-dd10bd336f3e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70444,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_258db6afa288f0a75534ae46e43e33ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da1032f9-30d9-5536-8bf8-dd10bd336f3e/da1032f9-30d9-5536-8bf8-dd10bd336f3e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a4/f7a4a24fb25fa47a26d622aa6d50124b/pa/MB94614_9ad7dee25cdf72e602e9ab1fd910aa73.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-26',
'seats_number': 5,
'seller_name': None,
'title': "Kia cee'd 1.4 Edition 7 Emotion",
'transmission': 'manual',
'trim': 'Edition 7 Emotion',
'year': 2018}
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB94614%27 HTTP/1.1" 200 None
2026-03-27 10:38:03 [auto1.de] INFO: Saving data for MB94614: {'created_time': 1774607883.928163, 'last_price_update_time': 1774607883.928175, 'auction_closing_time': 1774716489.0}
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB94614') HTTP/1.1" 204 0
2026-03-27 10:38:03 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-27 10:38:03 [auto1.de] INFO: Found listing with ID: TW84588
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW84588%27 HTTP/1.1" 200 None
2026-03-27 10:38:03 [auto1.de] INFO: Scrape type for TW84588: 2
2026-03-27 10:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62e6f6a0-ab5c-5798-a1ef-186f7adcaa7d with identifier: TW84588
2026-03-27 10:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62e6f6a0-ab5c-5798-a1ef-186f7adcaa7d with scrape type 2
2026-03-27 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62e6f6a0-ab5c-5798-a1ef-186f7adcaa7d with scrape type 2
2026-03-27 10:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62e6f6a0-ab5c-5798-a1ef-186f7adcaa7d, identifier: TW84588
2026-03-27 10:38:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4fb910>
2026-03-27 10:38:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F96%252Ff29662d284bfb2ac6dd7666625b2b53e%252Fpa%252FMN30127_9ac7eeb2b8664b43ade003e02add992d.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_9ac7eeb2b8664b43ade003e02add992d.jpg saved to cache
2026-03-27 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7279628-8c27-54c7-a514-a6c484547c0b
2026-03-27 10:38:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7279628-8c27-54c7-a514-a6c484547c0b, skipping ID generation
2026-03-27 10:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7279628-8c27-54c7-a514-a6c484547c0b with scrape type 1
2026-03-27 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7279628-8c27-54c7-a514-a6c484547c0b sending to next pipeline
2026-03-27 10:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7279628-8c27-54c7-a514-a6c484547c0b, identifier: MN30127
2026-03-27 10:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62e6f6a0-ab5c-5798-a1ef-186f7adcaa7d with identifier: TW84588
2026-03-27 10:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62e6f6a0-ab5c-5798-a1ef-186f7adcaa7d with identifier: TW84588
2026-03-27 10:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62e6f6a0-ab5c-5798-a1ef-186f7adcaa7d with identifier: TW84588 to the API
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:01:17Z',
'fuel_type': 'petrol',
'id': '62e6f6a0-ab5c-5798-a1ef-186f7adcaa7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW84588',
'listing': 'auction',
'make': 'Kia',
'model': "cee'd",
'odometer': 94913,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-11',
'seller_name': None,
'title': "Kia cee'd 1.6 GDI FIFA World Cup Edition",
'transmission': 'manual',
'trim': 'FIFA World Cup Edition',
'year': 2013}
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW84588%27 HTTP/1.1" 200 None
2026-03-27 10:38:04 [auto1.de] INFO: Saving data for TW84588: {'auction_closing_time': 1774713677.0, 'created_time': 1773308333.631254, 'last_price_update_time': 1774607884.596288}
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW84588') HTTP/1.1" 204 0
2026-03-27 10:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7279628-8c27-54c7-a514-a6c484547c0b with identifier: MN30127
2026-03-27 10:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7279628-8c27-54c7-a514-a6c484547c0b with identifier: MN30127
2026-03-27 10:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7279628-8c27-54c7-a514-a6c484547c0b with identifier: MN30127 to the API
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_9ac7eeb2b8664b43ade003e02add992d.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:51:33Z',
'fuel_type': 'petrol',
'id': 'd7279628-8c27-54c7-a514-a6c484547c0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN30127',
'listing': 'auction',
'location': 'DE',
'make': 'Opel',
'model': 'Astra GTC',
'odometer': 189708,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87298,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_9b5c32d21275d244b671edb0789eec4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_50f1512a06b0bc497170baa6f9e1b862.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_fcc9cf4c467a01e9ca8a1df1f0566b70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75028,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_90a3e6e28fd8fcdb16e908241205a0c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80133,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_c6b5b614cae23561a3a32c22370190db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_5072db9a5dc1f7ff4819449c6079ebcb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_bff34a99a7c55b160bc713d317c24cc3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101628,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_bdae8df7f8eb15bd6f2f303de690ae5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81831,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_5159a6b00090f725de0e8e48f32928ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7279628-8c27-54c7-a514-a6c484547c0b/d7279628-8c27-54c7-a514-a6c484547c0b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77900,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/96/f29662d284bfb2ac6dd7666625b2b53e/pa/MN30127_9ac7eeb2b8664b43ade003e02add992d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Astra GTC 1.6 SIDI Turbo Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2014}
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30127%27 HTTP/1.1" 200 None
2026-03-27 10:38:05 [auto1.de] INFO: Saving data for MN30127: {'created_time': 1774607885.211317, 'last_price_update_time': 1774607885.21133, 'auction_closing_time': 1774716693.0}
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN30127') HTTP/1.1" 204 0
2026-03-27 10:38:05 [auto1.de] INFO: Found listing with ID: VM43459
2026-03-27 10:38:05 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ11168%27 HTTP/1.1" 200 None
2026-03-27 10:38:05 [auto1.de] INFO: Scrape type for PZ11168: 2
2026-03-27 10:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e91493f5-bed5-598c-b340-804c782350b3 with identifier: PZ11168
2026-03-27 10:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e91493f5-bed5-598c-b340-804c782350b3 with scrape type 2
2026-03-27 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e91493f5-bed5-598c-b340-804c782350b3 with scrape type 2
2026-03-27 10:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e91493f5-bed5-598c-b340-804c782350b3, identifier: PZ11168
2026-03-27 10:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG00954> (referer: https://www.auto1.com/v1/car-details-view/WG00954/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e91493f5-bed5-598c-b340-804c782350b3 with identifier: PZ11168
2026-03-27 10:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e91493f5-bed5-598c-b340-804c782350b3 with identifier: PZ11168
2026-03-27 10:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e91493f5-bed5-598c-b340-804c782350b3 with identifier: PZ11168 to the API
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:35:04Z',
'fuel_type': 'petrol',
'id': 'e91493f5-bed5-598c-b340-804c782350b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ11168',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 182524,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-15',
'seller_name': None,
'title': 'Audi A1 Sportback 1.4 TFSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2013}
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ11168%27 HTTP/1.1" 200 None
2026-03-27 10:38:05 [auto1.de] INFO: Saving data for PZ11168: {'auction_closing_time': 1774715704.0, 'created_time': 1773466755.781098, 'last_price_update_time': 1774607885.724767}
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ11168') HTTP/1.1" 204 0
2026-03-27 10:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2050306c-95eb-53e7-84ef-119a1cccb941 with identifier: WP35313
2026-03-27 10:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2050306c-95eb-53e7-84ef-119a1cccb941 with scrape type 1
2026-03-27 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2050306c-95eb-53e7-84ef-119a1cccb941
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Ffb%252Fbdfb1c31eddc9ba78cc749078cdfa8d4%252Fpa%252FWP35313_ab975f4967f5bb9c761a8267d4e1ef7b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_ab975f4967f5bb9c761a8267d4e1ef7b.jpg not downloaded yet
2026-03-27 10:38:05 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB22457%27 HTTP/1.1" 200 None
2026-03-27 10:38:05 [auto1.de] INFO: Scrape type for LB22457: 2
2026-03-27 10:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8896f62-3846-5f03-86a5-8c9a4ec8e05d with identifier: LB22457
2026-03-27 10:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8896f62-3846-5f03-86a5-8c9a4ec8e05d with scrape type 2
2026-03-27 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8896f62-3846-5f03-86a5-8c9a4ec8e05d with scrape type 2
2026-03-27 10:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8896f62-3846-5f03-86a5-8c9a4ec8e05d, identifier: LB22457
2026-03-27 10:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8896f62-3846-5f03-86a5-8c9a4ec8e05d with identifier: LB22457
2026-03-27 10:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8896f62-3846-5f03-86a5-8c9a4ec8e05d with identifier: LB22457
2026-03-27 10:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8896f62-3846-5f03-86a5-8c9a4ec8e05d with identifier: LB22457 to the API
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-28T16:53:04Z',
'fuel_type': 'diesel',
'id': 'd8896f62-3846-5f03-86a5-8c9a4ec8e05d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB22457',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 175198,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-26',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Nakama Intense AWD',
'transmission': 'automatic',
'trim': 'Nakama Intense AWD',
'year': 2016}
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB22457%27 HTTP/1.1" 200 None
2026-03-27 10:38:06 [auto1.de] INFO: Saving data for LB22457: {'auction_closing_time': 1774716784.0, 'created_time': 1773134852.845, 'last_price_update_time': 1774607886.230857}
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB22457') HTTP/1.1" 204 0
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Ffb%252Fbdfb1c31eddc9ba78cc749078cdfa8d4%252Fpa%252FWP35313_e8f232c938b76f1dd95730727368869e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_e8f232c938b76f1dd95730727368869e.jpg not downloaded yet
2026-03-27 10:38:06 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE19276%27 HTTP/1.1" 200 None
2026-03-27 10:38:06 [auto1.de] INFO: Scrape type for EE19276: 2
2026-03-27 10:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6 with identifier: EE19276
2026-03-27 10:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6 with scrape type 2
2026-03-27 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6 with scrape type 2
2026-03-27 10:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6, identifier: EE19276
2026-03-27 10:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6 with identifier: EE19276
2026-03-27 10:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6 with identifier: EE19276
2026-03-27 10:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6 with identifier: EE19276 to the API
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 211,
'expiration_date': '2026-03-28T16:40:50Z',
'fuel_type': 'hybrid',
'id': 'bbf0e21d-b94e-5c6d-94ea-ebd580a25ba6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE19276',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC40',
'odometer': 32219,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-25',
'seller_name': None,
'title': 'Volvo XC40 1.5 T5 Recharge Plug-in Hybrid Inscription 2WD',
'transmission': 'automatic',
'trim': 'Inscription 2WD',
'year': 2020}
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE19276%27 HTTP/1.1" 200 None
2026-03-27 10:38:06 [auto1.de] INFO: Saving data for EE19276: {'auction_closing_time': 1774716050.0, 'created_time': 1773466752.636531, 'last_price_update_time': 1774607886.701908}
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE19276') HTTP/1.1" 204 0
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Ffb%252Fbdfb1c31eddc9ba78cc749078cdfa8d4%252Fpa%252FWP35313_9af28329a47aba7844a56a6081ea1a6a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_9af28329a47aba7844a56a6081ea1a6a.jpg not downloaded yet
2026-03-27 10:38:06 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR18814%27 HTTP/1.1" 200 None
2026-03-27 10:38:06 [auto1.de] INFO: Scrape type for RR18814: 2
2026-03-27 10:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af41d659-135e-542f-9d13-d19c9a1f9681 with identifier: RR18814
2026-03-27 10:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af41d659-135e-542f-9d13-d19c9a1f9681 with scrape type 2
2026-03-27 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af41d659-135e-542f-9d13-d19c9a1f9681 with scrape type 2
2026-03-27 10:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af41d659-135e-542f-9d13-d19c9a1f9681, identifier: RR18814
2026-03-27 10:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LV46830> (referer: https://www.auto1.com/v1/car-details-view/LV46830/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fe462a8-b767-5b35-b861-127b922df1d7 with identifier: WG00954
2026-03-27 10:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fe462a8-b767-5b35-b861-127b922df1d7 with scrape type 1
2026-03-27 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6fe462a8-b767-5b35-b861-127b922df1d7
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F8e%252F928e29e9bddef83ef939f8dab77ae0a4%252Fpa%252FWG00954_057125170306248810a155a9f6342a4d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_057125170306248810a155a9f6342a4d.jpg not downloaded yet
2026-03-27 10:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af41d659-135e-542f-9d13-d19c9a1f9681 with identifier: RR18814
2026-03-27 10:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af41d659-135e-542f-9d13-d19c9a1f9681 with identifier: RR18814
2026-03-27 10:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af41d659-135e-542f-9d13-d19c9a1f9681 with identifier: RR18814 to the API
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-28T16:28:14Z',
'fuel_type': 'petrol',
'id': 'af41d659-135e-542f-9d13-d19c9a1f9681',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR18814',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLB-Klasse',
'odometer': 49483,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-09',
'seller_name': None,
'title': 'Mercedes-Benz GLB-Klasse GLB 35 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2020}
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR18814%27 HTTP/1.1" 200 None
2026-03-27 10:38:07 [auto1.de] INFO: Saving data for RR18814: {'auction_closing_time': 1774715294.0, 'created_time': 1773308123.177025, 'last_price_update_time': 1774607887.249425}
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR18814') HTTP/1.1" 204 0
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Ffb%252Fbdfb1c31eddc9ba78cc749078cdfa8d4%252Fpa%252FWP35313_145dbcc6e31648f20dcd22d928063875.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_145dbcc6e31648f20dcd22d928063875.jpg not downloaded yet
2026-03-27 10:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_ab975f4967f5bb9c761a8267d4e1ef7b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:07 [scrapy.extensions.logstats] INFO: Crawled 302 pages (at 17 pages/min), scraped 313 items (at 90 items/min)
2026-03-27 10:38:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-27 10:38:07 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-27 10:38:07 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA68492%27 HTTP/1.1" 200 None
2026-03-27 10:38:07 [auto1.de] INFO: Scrape type for YA68492: 2
2026-03-27 10:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85bbabfd-dd83-5302-a9a9-740c6d226387 with identifier: YA68492
2026-03-27 10:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85bbabfd-dd83-5302-a9a9-740c6d226387 with scrape type 2
2026-03-27 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85bbabfd-dd83-5302-a9a9-740c6d226387 with scrape type 2
2026-03-27 10:38:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85bbabfd-dd83-5302-a9a9-740c6d226387, identifier: YA68492
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F8e%252F928e29e9bddef83ef939f8dab77ae0a4%252Fpa%252FWG00954_9ace18e0d53305fd5939b125b1f7c4f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_9ace18e0d53305fd5939b125b1f7c4f3.jpg not downloaded yet
2026-03-27 10:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85bbabfd-dd83-5302-a9a9-740c6d226387 with identifier: YA68492
2026-03-27 10:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85bbabfd-dd83-5302-a9a9-740c6d226387 with identifier: YA68492
2026-03-27 10:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85bbabfd-dd83-5302-a9a9-740c6d226387 with identifier: YA68492 to the API
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:00:04Z',
'fuel_type': 'petrol',
'id': '85bbabfd-dd83-5302-a9a9-740c6d226387',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA68492',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Jetta',
'odometer': 50564,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-12',
'seller_name': None,
'title': 'Volkswagen Jetta 1.4 TSI Highline',
'transmission': 'automatic',
'trim': 'Highline',
'year': 2014}
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA68492%27 HTTP/1.1" 200 None
2026-03-27 10:38:07 [auto1.de] INFO: Saving data for YA68492: {'auction_closing_time': 1774713604.0, 'created_time': 1773345120.763248, 'last_price_update_time': 1774607887.742711}
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA68492') HTTP/1.1" 204 0
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Ffb%252Fbdfb1c31eddc9ba78cc749078cdfa8d4%252Fpa%252FWP35313_0535335b2aeedf088f2a0dc1e1066ee9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_0535335b2aeedf088f2a0dc1e1066ee9.jpg not downloaded yet
2026-03-27 10:38:07 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC26510%27 HTTP/1.1" 200 None
2026-03-27 10:38:07 [auto1.de] INFO: Scrape type for TC26510: 2
2026-03-27 10:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce01dc7d-9804-5e8d-85aa-6c26279a8344 with identifier: TC26510
2026-03-27 10:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce01dc7d-9804-5e8d-85aa-6c26279a8344 with scrape type 2
2026-03-27 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce01dc7d-9804-5e8d-85aa-6c26279a8344 with scrape type 2
2026-03-27 10:38:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce01dc7d-9804-5e8d-85aa-6c26279a8344, identifier: TC26510
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F8e%252F928e29e9bddef83ef939f8dab77ae0a4%252Fpa%252FWG00954_030df1cd13133f546c4a191d6d6a7e9c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_030df1cd13133f546c4a191d6d6a7e9c.jpg not downloaded yet
2026-03-27 10:38:07 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 10505 | hits on page: 40
2026-03-27 10:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 776ee6ce-a36f-5af4-b35f-51c5d3d387ff with identifier: LV46830
2026-03-27 10:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 776ee6ce-a36f-5af4-b35f-51c5d3d387ff with scrape type 1
2026-03-27 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 776ee6ce-a36f-5af4-b35f-51c5d3d387ff
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_435a17dd2b7a8210a8363623b84d0ce3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_435a17dd2b7a8210a8363623b84d0ce3.jpg not downloaded yet
2026-03-27 10:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce01dc7d-9804-5e8d-85aa-6c26279a8344 with identifier: TC26510
2026-03-27 10:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce01dc7d-9804-5e8d-85aa-6c26279a8344 with identifier: TC26510
2026-03-27 10:38:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce01dc7d-9804-5e8d-85aa-6c26279a8344 with identifier: TC26510 to the API
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:22:43Z',
'fuel_type': 'diesel',
'id': 'ce01dc7d-9804-5e8d-85aa-6c26279a8344',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC26510',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 239286,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-25',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2015}
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC26510%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [auto1.de] INFO: Saving data for TC26510: {'auction_closing_time': 1774714963.0, 'created_time': 1773685901.418214, 'last_price_update_time': 1774607888.315494}
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TC26510') HTTP/1.1" 204 0
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Ffb%252Fbdfb1c31eddc9ba78cc749078cdfa8d4%252Fpa%252FWP35313_65c3aa9cd3d5a91eb4a71f9580c3e036.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_65c3aa9cd3d5a91eb4a71f9580c3e036.jpg not downloaded yet
2026-03-27 10:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be283c10>
2026-03-27 10:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2050306c-95eb-53e7-84ef-119a1cccb941/2050306c-95eb-53e7-84ef-119a1cccb941_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Ffb%252Fbdfb1c31eddc9ba78cc749078cdfa8d4%252Fpa%252FWP35313_ab975f4967f5bb9c761a8267d4e1ef7b.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_ab975f4967f5bb9c761a8267d4e1ef7b.jpg saved to cache
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2050306c-95eb-53e7-84ef-119a1cccb941
2026-03-27 10:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_9af28329a47aba7844a56a6081ea1a6a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_e8f232c938b76f1dd95730727368869e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:08 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD72910%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [auto1.de] INFO: Scrape type for BD72910: 2
2026-03-27 10:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with identifier: BD72910
2026-03-27 10:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with scrape type 2
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with scrape type 2
2026-03-27 10:38:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91, identifier: BD72910
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F8e%252F928e29e9bddef83ef939f8dab77ae0a4%252Fpa%252FWG00954_0eac8b9fc1ab12d9d7862ed53f462059.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_0eac8b9fc1ab12d9d7862ed53f462059.jpg not downloaded yet
2026-03-27 10:38:08 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC26510%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [auto1.de] INFO: Scrape type for TC26510: 0
2026-03-27 10:38:08 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD72910%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [auto1.de] INFO: Scrape type for BD72910: 2
2026-03-27 10:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with scrape type 2
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with scrape type 2
2026-03-27 10:38:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91, identifier: BD72910
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_5ab0adc0e61cc432c9bc63cfec291b9d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_5ab0adc0e61cc432c9bc63cfec291b9d.jpg not downloaded yet
2026-03-27 10:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_057125170306248810a155a9f6342a4d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with identifier: BD72910
2026-03-27 10:38:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with identifier: BD72910
2026-03-27 10:38:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with identifier: BD72910 to the API
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:15:15Z',
'fuel_type': 'diesel',
'id': 'c572a2fd-c4e0-5c41-acf1-9272a0e8ad91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD72910',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 197843,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-03',
'seller_name': None,
'title': 'Audi A4 2.0 TDI quattro S line Sportpaket plus',
'transmission': 'automatic',
'trim': 'quattro S line Sportpaket plus',
'year': 2013}
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD72910%27 HTTP/1.1" 200 None
2026-03-27 10:38:09 [auto1.de] INFO: Saving data for BD72910: {'auction_closing_time': 1774714515.0, 'created_time': 1773469081.61321, 'last_price_update_time': 1774607889.068326}
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD72910') HTTP/1.1" 204 0
2026-03-27 10:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with identifier: BD72910
2026-03-27 10:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with identifier: BD72910
2026-03-27 10:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c572a2fd-c4e0-5c41-acf1-9272a0e8ad91 with identifier: BD72910 to the API
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:15:15Z',
'fuel_type': 'diesel',
'id': 'c572a2fd-c4e0-5c41-acf1-9272a0e8ad91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD72910',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 197843,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-03',
'seller_name': None,
'title': 'Audi A4 2.0 TDI quattro S line Sportpaket plus',
'transmission': 'automatic',
'trim': 'quattro S line Sportpaket plus',
'year': 2013}
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD72910%27 HTTP/1.1" 200 None
2026-03-27 10:38:09 [auto1.de] INFO: Saving data for BD72910: {'auction_closing_time': 1774714515.0, 'created_time': 1773469081.61321, 'last_price_update_time': 1774607889.488405}
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD72910') HTTP/1.1" 204 0
2026-03-27 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_145dbcc6e31648f20dcd22d928063875.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:09 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR67134%27 HTTP/1.1" 200 None
2026-03-27 10:38:09 [auto1.de] INFO: Scrape type for NR67134: 2
2026-03-27 10:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with identifier: NR67134
2026-03-27 10:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with scrape type 2
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with scrape type 2
2026-03-27 10:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abcf5d86-8e35-53fe-84a9-cfa0b17efef7, identifier: NR67134
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F8e%252F928e29e9bddef83ef939f8dab77ae0a4%252Fpa%252FWG00954_174326d73eb2f603dd276d9a54857953.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_174326d73eb2f603dd276d9a54857953.jpg not downloaded yet
2026-03-27 10:38:09 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR67134%27 HTTP/1.1" 200 None
2026-03-27 10:38:09 [auto1.de] INFO: Scrape type for NR67134: 2
2026-03-27 10:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with scrape type 2
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with scrape type 2
2026-03-27 10:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abcf5d86-8e35-53fe-84a9-cfa0b17efef7, identifier: NR67134
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_0b8ac1d71f71dd696c08bfa57e1ab558.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_0b8ac1d71f71dd696c08bfa57e1ab558.jpg not downloaded yet
2026-03-27 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_9ace18e0d53305fd5939b125b1f7c4f3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with identifier: NR67134
2026-03-27 10:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with identifier: NR67134
2026-03-27 10:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with identifier: NR67134 to the API
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:40:14Z',
'fuel_type': 'petrol',
'id': 'abcf5d86-8e35-53fe-84a9-cfa0b17efef7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR67134',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 77732,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-10',
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Basis passion',
'transmission': 'manual',
'trim': 'Basis passion',
'year': 2016}
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR67134%27 HTTP/1.1" 200 None
2026-03-27 10:38:10 [auto1.de] INFO: Saving data for NR67134: {'auction_closing_time': 1774716014.0, 'created_time': 1773830926.891913, 'last_price_update_time': 1774607890.132853}
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR67134') HTTP/1.1" 204 0
2026-03-27 10:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with identifier: NR67134
2026-03-27 10:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with identifier: NR67134
2026-03-27 10:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abcf5d86-8e35-53fe-84a9-cfa0b17efef7 with identifier: NR67134 to the API
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:40:14Z',
'fuel_type': 'petrol',
'id': 'abcf5d86-8e35-53fe-84a9-cfa0b17efef7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR67134',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 77732,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-10',
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Basis passion',
'transmission': 'manual',
'trim': 'Basis passion',
'year': 2016}
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR67134%27 HTTP/1.1" 200 None
2026-03-27 10:38:10 [auto1.de] INFO: Saving data for NR67134: {'auction_closing_time': 1774716014.0, 'created_time': 1773830926.891913, 'last_price_update_time': 1774607890.426995}
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR67134') HTTP/1.1" 204 0
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be226690>
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2050306c-95eb-53e7-84ef-119a1cccb941/2050306c-95eb-53e7-84ef-119a1cccb941_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Ffb%252Fbdfb1c31eddc9ba78cc749078cdfa8d4%252Fpa%252FWP35313_9af28329a47aba7844a56a6081ea1a6a.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_9af28329a47aba7844a56a6081ea1a6a.jpg saved to cache
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2050306c-95eb-53e7-84ef-119a1cccb941
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be265150>
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2050306c-95eb-53e7-84ef-119a1cccb941/2050306c-95eb-53e7-84ef-119a1cccb941_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Ffb%252Fbdfb1c31eddc9ba78cc749078cdfa8d4%252Fpa%252FWP35313_e8f232c938b76f1dd95730727368869e.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_e8f232c938b76f1dd95730727368869e.jpg saved to cache
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2050306c-95eb-53e7-84ef-119a1cccb941
2026-03-27 10:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_0535335b2aeedf088f2a0dc1e1066ee9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:10 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-27 10:38:10 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ33462%27 HTTP/1.1" 200 None
2026-03-27 10:38:10 [auto1.de] INFO: Scrape type for UJ33462: 2
2026-03-27 10:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1aea173f-8d29-55f9-bff2-23473d024d4c with identifier: UJ33462
2026-03-27 10:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aea173f-8d29-55f9-bff2-23473d024d4c with scrape type 2
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1aea173f-8d29-55f9-bff2-23473d024d4c with scrape type 2
2026-03-27 10:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1aea173f-8d29-55f9-bff2-23473d024d4c, identifier: UJ33462
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_d55cc06d00d42173672c57199e9653c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_d55cc06d00d42173672c57199e9653c8.jpg not downloaded yet
2026-03-27 10:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_030df1cd13133f546c4a191d6d6a7e9c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1aea173f-8d29-55f9-bff2-23473d024d4c with identifier: UJ33462
2026-03-27 10:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1aea173f-8d29-55f9-bff2-23473d024d4c with identifier: UJ33462
2026-03-27 10:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1aea173f-8d29-55f9-bff2-23473d024d4c with identifier: UJ33462 to the API
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-28T16:57:25Z',
'fuel_type': 'petrol',
'id': '1aea173f-8d29-55f9-bff2-23473d024d4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ33462',
'listing': 'auction',
'make': 'Ford',
'model': 'Fusion',
'odometer': 149615,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-30',
'seller_name': None,
'title': 'Ford Fusion 1.4 Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2011}
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ33462%27 HTTP/1.1" 200 None
2026-03-27 10:38:10 [auto1.de] INFO: Saving data for UJ33462: {'auction_closing_time': 1774717045.0, 'created_time': 1773138689.244776, 'last_price_update_time': 1774607890.984432}
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ33462') HTTP/1.1" 204 0
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4d9e50>
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fe462a8-b767-5b35-b861-127b922df1d7/6fe462a8-b767-5b35-b861-127b922df1d7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F8e%252F928e29e9bddef83ef939f8dab77ae0a4%252Fpa%252FWG00954_057125170306248810a155a9f6342a4d.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_057125170306248810a155a9f6342a4d.jpg saved to cache
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6fe462a8-b767-5b35-b861-127b922df1d7
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be226b90>
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2050306c-95eb-53e7-84ef-119a1cccb941/2050306c-95eb-53e7-84ef-119a1cccb941_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Ffb%252Fbdfb1c31eddc9ba78cc749078cdfa8d4%252Fpa%252FWP35313_145dbcc6e31648f20dcd22d928063875.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_145dbcc6e31648f20dcd22d928063875.jpg saved to cache
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2050306c-95eb-53e7-84ef-119a1cccb941
2026-03-27 10:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_65c3aa9cd3d5a91eb4a71f9580c3e036.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:11 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-27 10:38:11 [auto1.de] INFO: Found listing with ID: HV11819
2026-03-27 10:38:11 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA53807%27 HTTP/1.1" 200 None
2026-03-27 10:38:11 [auto1.de] INFO: Scrape type for NA53807: 1
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_ee0b7a55cbe37d387eb0a842d52787c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_ee0b7a55cbe37d387eb0a842d52787c4.jpg not downloaded yet
2026-03-27 10:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_0eac8b9fc1ab12d9d7862ed53f462059.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2a8d10>
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fe462a8-b767-5b35-b861-127b922df1d7/6fe462a8-b767-5b35-b861-127b922df1d7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F8e%252F928e29e9bddef83ef939f8dab77ae0a4%252Fpa%252FWG00954_9ace18e0d53305fd5939b125b1f7c4f3.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_9ace18e0d53305fd5939b125b1f7c4f3.jpg saved to cache
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6fe462a8-b767-5b35-b861-127b922df1d7
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf44ce10>
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2050306c-95eb-53e7-84ef-119a1cccb941/2050306c-95eb-53e7-84ef-119a1cccb941_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Ffb%252Fbdfb1c31eddc9ba78cc749078cdfa8d4%252Fpa%252FWP35313_0535335b2aeedf088f2a0dc1e1066ee9.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_0535335b2aeedf088f2a0dc1e1066ee9.jpg saved to cache
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2050306c-95eb-53e7-84ef-119a1cccb941
2026-03-27 10:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_5ab0adc0e61cc432c9bc63cfec291b9d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:11 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-27 10:38:11 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ26894%27 HTTP/1.1" 200 None
2026-03-27 10:38:11 [auto1.de] INFO: Scrape type for MZ26894: 2
2026-03-27 10:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9687abe6-7ee1-5d7a-a821-4c58d61c0379 with identifier: MZ26894
2026-03-27 10:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9687abe6-7ee1-5d7a-a821-4c58d61c0379 with scrape type 2
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9687abe6-7ee1-5d7a-a821-4c58d61c0379 with scrape type 2
2026-03-27 10:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9687abe6-7ee1-5d7a-a821-4c58d61c0379, identifier: MZ26894
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_7ff5b05786bce145174137886eabbdeb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_7ff5b05786bce145174137886eabbdeb.jpg not downloaded yet
2026-03-27 10:38:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1f7850>
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fe462a8-b767-5b35-b861-127b922df1d7/6fe462a8-b767-5b35-b861-127b922df1d7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F8e%252F928e29e9bddef83ef939f8dab77ae0a4%252Fpa%252FWG00954_030df1cd13133f546c4a191d6d6a7e9c.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_030df1cd13133f546c4a191d6d6a7e9c.jpg saved to cache
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6fe462a8-b767-5b35-b861-127b922df1d7
2026-03-27 10:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9687abe6-7ee1-5d7a-a821-4c58d61c0379 with identifier: MZ26894
2026-03-27 10:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9687abe6-7ee1-5d7a-a821-4c58d61c0379 with identifier: MZ26894
2026-03-27 10:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9687abe6-7ee1-5d7a-a821-4c58d61c0379 with identifier: MZ26894 to the API
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:18:23Z',
'fuel_type': 'petrol',
'id': '9687abe6-7ee1-5d7a-a821-4c58d61c0379',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ26894',
'listing': 'auction',
'make': 'Skoda',
'model': 'Roomster',
'odometer': 139556,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-26',
'seller_name': None,
'title': 'Skoda Roomster 1.2 TSI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2012}
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ26894%27 HTTP/1.1" 200 None
2026-03-27 10:38:11 [auto1.de] INFO: Saving data for MZ26894: {'auction_closing_time': 1774714703.0, 'created_time': 1773686256.30235, 'last_price_update_time': 1774607891.800793}
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ26894') HTTP/1.1" 204 0
2026-03-27 10:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_174326d73eb2f603dd276d9a54857953.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:11 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-27 10:38:11 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX10113%27 HTTP/1.1" 200 None
2026-03-27 10:38:11 [auto1.de] INFO: Scrape type for UX10113: 2
2026-03-27 10:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3889fa25-cc75-583f-8264-4a13d76c1e8a with identifier: UX10113
2026-03-27 10:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3889fa25-cc75-583f-8264-4a13d76c1e8a with scrape type 2
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3889fa25-cc75-583f-8264-4a13d76c1e8a with scrape type 2
2026-03-27 10:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3889fa25-cc75-583f-8264-4a13d76c1e8a, identifier: UX10113
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_6c61153c7f9e74682ea2607e9dd7a00b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_6c61153c7f9e74682ea2607e9dd7a00b.jpg not downloaded yet
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0b1350>
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2050306c-95eb-53e7-84ef-119a1cccb941/2050306c-95eb-53e7-84ef-119a1cccb941_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Ffb%252Fbdfb1c31eddc9ba78cc749078cdfa8d4%252Fpa%252FWP35313_65c3aa9cd3d5a91eb4a71f9580c3e036.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_65c3aa9cd3d5a91eb4a71f9580c3e036.jpg saved to cache
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2050306c-95eb-53e7-84ef-119a1cccb941
2026-03-27 10:38:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2050306c-95eb-53e7-84ef-119a1cccb941, skipping ID generation
2026-03-27 10:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2050306c-95eb-53e7-84ef-119a1cccb941 with scrape type 1
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2050306c-95eb-53e7-84ef-119a1cccb941 sending to next pipeline
2026-03-27 10:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2050306c-95eb-53e7-84ef-119a1cccb941, identifier: WP35313
2026-03-27 10:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3889fa25-cc75-583f-8264-4a13d76c1e8a with identifier: UX10113
2026-03-27 10:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3889fa25-cc75-583f-8264-4a13d76c1e8a with identifier: UX10113
2026-03-27 10:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3889fa25-cc75-583f-8264-4a13d76c1e8a with identifier: UX10113 to the API
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:42:07Z',
'fuel_type': 'petrol',
'id': '3889fa25-cc75-583f-8264-4a13d76c1e8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX10113',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 79272,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-21',
'seller_name': None,
'title': 'Dacia Duster 1.6 Ice 4x2',
'transmission': 'manual',
'trim': 'Ice 4x2',
'year': 2015}
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX10113%27 HTTP/1.1" 200 None
2026-03-27 10:38:12 [auto1.de] INFO: Saving data for UX10113: {'auction_closing_time': 1774716127.0, 'created_time': 1773859798.68633, 'last_price_update_time': 1774607892.434859}
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX10113') HTTP/1.1" 204 0
2026-03-27 10:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2050306c-95eb-53e7-84ef-119a1cccb941 with identifier: WP35313
2026-03-27 10:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2050306c-95eb-53e7-84ef-119a1cccb941 with identifier: WP35313
2026-03-27 10:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2050306c-95eb-53e7-84ef-119a1cccb941 with identifier: WP35313 to the API
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_65c3aa9cd3d5a91eb4a71f9580c3e036.jpg>
{'auction_title': '',
'c_o_2_emission_value': 165,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 73,
'expiration_date': '2026-03-28T16:09:56Z',
'fuel_type': 'petrol',
'id': '2050306c-95eb-53e7-84ef-119a1cccb941',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP35313',
'listing': 'auction',
'location': 'DE, Ingolstadt',
'make': 'Fiat',
'model': 'Qubo',
'odometer': 188366,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2050306c-95eb-53e7-84ef-119a1cccb941/2050306c-95eb-53e7-84ef-119a1cccb941_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_ab975f4967f5bb9c761a8267d4e1ef7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2050306c-95eb-53e7-84ef-119a1cccb941/2050306c-95eb-53e7-84ef-119a1cccb941_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_e8f232c938b76f1dd95730727368869e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2050306c-95eb-53e7-84ef-119a1cccb941/2050306c-95eb-53e7-84ef-119a1cccb941_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_9af28329a47aba7844a56a6081ea1a6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2050306c-95eb-53e7-84ef-119a1cccb941/2050306c-95eb-53e7-84ef-119a1cccb941_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72254,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_145dbcc6e31648f20dcd22d928063875.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2050306c-95eb-53e7-84ef-119a1cccb941/2050306c-95eb-53e7-84ef-119a1cccb941_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_0535335b2aeedf088f2a0dc1e1066ee9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2050306c-95eb-53e7-84ef-119a1cccb941/2050306c-95eb-53e7-84ef-119a1cccb941_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/fb/bdfb1c31eddc9ba78cc749078cdfa8d4/pa/WP35313_65c3aa9cd3d5a91eb4a71f9580c3e036.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Qubo 1.4 Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2008}
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP35313%27 HTTP/1.1" 200 None
2026-03-27 10:38:12 [auto1.de] INFO: Saving data for WP35313: {'created_time': 1774607892.983124, 'last_price_update_time': 1774607892.983136, 'auction_closing_time': 1774714196.0}
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP35313') HTTP/1.1" 204 0
2026-03-27 10:38:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf359190>
2026-03-27 10:38:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fe462a8-b767-5b35-b861-127b922df1d7/6fe462a8-b767-5b35-b861-127b922df1d7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F8e%252F928e29e9bddef83ef939f8dab77ae0a4%252Fpa%252FWG00954_0eac8b9fc1ab12d9d7862ed53f462059.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_0eac8b9fc1ab12d9d7862ed53f462059.jpg saved to cache
2026-03-27 10:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6fe462a8-b767-5b35-b861-127b922df1d7
2026-03-27 10:38:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1bb210>
2026-03-27 10:38:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_5ab0adc0e61cc432c9bc63cfec291b9d.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_5ab0adc0e61cc432c9bc63cfec291b9d.jpg saved to cache
2026-03-27 10:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 776ee6ce-a36f-5af4-b35f-51c5d3d387ff
2026-03-27 10:38:13 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-27 10:38:13 [auto1.de] INFO: Found listing with ID: NE66332
2026-03-27 10:38:13 [auto1.de] INFO: Found listing with ID: FU30780
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU30780%27 HTTP/1.1" 200 None
2026-03-27 10:38:13 [auto1.de] INFO: Scrape type for FU30780: 2
2026-03-27 10:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9beb85a-7c2e-5443-9472-47daa9b91745 with identifier: FU30780
2026-03-27 10:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9beb85a-7c2e-5443-9472-47daa9b91745 with scrape type 2
2026-03-27 10:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9beb85a-7c2e-5443-9472-47daa9b91745 with scrape type 2
2026-03-27 10:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9beb85a-7c2e-5443-9472-47daa9b91745, identifier: FU30780
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_c13b8ed979ea80532e3ada9f058789b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_c13b8ed979ea80532e3ada9f058789b6.jpg not downloaded yet
2026-03-27 10:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_ee0b7a55cbe37d387eb0a842d52787c4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9beb85a-7c2e-5443-9472-47daa9b91745 with identifier: FU30780
2026-03-27 10:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9beb85a-7c2e-5443-9472-47daa9b91745 with identifier: FU30780
2026-03-27 10:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9beb85a-7c2e-5443-9472-47daa9b91745 with identifier: FU30780 to the API
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:18:07Z',
'fuel_type': 'diesel',
'id': 'd9beb85a-7c2e-5443-9472-47daa9b91745',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU30780',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 61634,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-06',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi 320 L1 Tourneo Titanium',
'transmission': 'automatic',
'trim': '320 L1 Tourneo Titanium',
'year': 2020}
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU30780%27 HTTP/1.1" 200 None
2026-03-27 10:38:13 [auto1.de] INFO: Saving data for FU30780: {'auction_closing_time': 1774714687.0, 'created_time': 1774294891.976081, 'last_price_update_time': 1774607893.569239}
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU30780') HTTP/1.1" 204 0
2026-03-27 10:38:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be262190>
2026-03-27 10:38:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fe462a8-b767-5b35-b861-127b922df1d7/6fe462a8-b767-5b35-b861-127b922df1d7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F8e%252F928e29e9bddef83ef939f8dab77ae0a4%252Fpa%252FWG00954_174326d73eb2f603dd276d9a54857953.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_174326d73eb2f603dd276d9a54857953.jpg saved to cache
2026-03-27 10:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6fe462a8-b767-5b35-b861-127b922df1d7
2026-03-27 10:38:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fe462a8-b767-5b35-b861-127b922df1d7, skipping ID generation
2026-03-27 10:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fe462a8-b767-5b35-b861-127b922df1d7 with scrape type 1
2026-03-27 10:38:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6fe462a8-b767-5b35-b861-127b922df1d7 sending to next pipeline
2026-03-27 10:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fe462a8-b767-5b35-b861-127b922df1d7, identifier: WG00954
2026-03-27 10:38:13 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ15430%27 HTTP/1.1" 200 None
2026-03-27 10:38:13 [auto1.de] INFO: Scrape type for RJ15430: 2
2026-03-27 10:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0 with identifier: RJ15430
2026-03-27 10:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0 with scrape type 2
2026-03-27 10:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0 with scrape type 2
2026-03-27 10:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0, identifier: RJ15430
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_cb15aae6262427e92f61ce9bf76e44cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_cb15aae6262427e92f61ce9bf76e44cc.jpg not downloaded yet
2026-03-27 10:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fe462a8-b767-5b35-b861-127b922df1d7 with identifier: WG00954
2026-03-27 10:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fe462a8-b767-5b35-b861-127b922df1d7 with identifier: WG00954
2026-03-27 10:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fe462a8-b767-5b35-b861-127b922df1d7 with identifier: WG00954 to the API
2026-03-27 10:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_174326d73eb2f603dd276d9a54857953.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:56:32Z',
'fuel_type': 'petrol',
'id': '6fe462a8-b767-5b35-b861-127b922df1d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG00954',
'listing': 'auction',
'location': 'DE, Oberhausen',
'make': 'Opel',
'model': 'Corsa',
'odometer': 120213,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe462a8-b767-5b35-b861-127b922df1d7/6fe462a8-b767-5b35-b861-127b922df1d7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80553,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_057125170306248810a155a9f6342a4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe462a8-b767-5b35-b861-127b922df1d7/6fe462a8-b767-5b35-b861-127b922df1d7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_9ace18e0d53305fd5939b125b1f7c4f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe462a8-b767-5b35-b861-127b922df1d7/6fe462a8-b767-5b35-b861-127b922df1d7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80489,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_030df1cd13133f546c4a191d6d6a7e9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe462a8-b767-5b35-b861-127b922df1d7/6fe462a8-b767-5b35-b861-127b922df1d7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_0eac8b9fc1ab12d9d7862ed53f462059.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fe462a8-b767-5b35-b861-127b922df1d7/6fe462a8-b767-5b35-b861-127b922df1d7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94837,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/8e/928e29e9bddef83ef939f8dab77ae0a4/pa/WG00954_174326d73eb2f603dd276d9a54857953.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-01-20',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 Edition "111 Jahre"',
'transmission': 'manual',
'trim': 'Edition "111 Jahre"',
'year': 2011}
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG00954%27 HTTP/1.1" 200 None
2026-03-27 10:38:14 [auto1.de] INFO: Saving data for WG00954: {'created_time': 1774607894.251306, 'last_price_update_time': 1774607894.251316, 'auction_closing_time': 1774716992.0}
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG00954') HTTP/1.1" 204 0
2026-03-27 10:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0 with identifier: RJ15430
2026-03-27 10:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0 with identifier: RJ15430
2026-03-27 10:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0 with identifier: RJ15430 to the API
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:05:27Z',
'fuel_type': 'diesel',
'id': '7d8ae24e-7ba3-5d57-81d0-3cada9ec2ba0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ15430',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 243645,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-26',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 CDI T BlueEfficiency',
'transmission': 'manual',
'trim': 'T BlueEfficiency',
'year': 2012}
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ15430%27 HTTP/1.1" 200 None
2026-03-27 10:38:14 [auto1.de] INFO: Saving data for RJ15430: {'auction_closing_time': 1774713927.0, 'created_time': 1773858706.705225, 'last_price_update_time': 1774607894.603888}
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ15430') HTTP/1.1" 204 0
2026-03-27 10:38:14 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-27 10:38:14 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-27 10:38:14 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD12559%27 HTTP/1.1" 200 None
2026-03-27 10:38:14 [auto1.de] INFO: Scrape type for BD12559: 2
2026-03-27 10:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e13ac1d5-2b60-5704-b8fc-7a2602846219 with identifier: BD12559
2026-03-27 10:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e13ac1d5-2b60-5704-b8fc-7a2602846219 with scrape type 2
2026-03-27 10:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e13ac1d5-2b60-5704-b8fc-7a2602846219 with scrape type 2
2026-03-27 10:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e13ac1d5-2b60-5704-b8fc-7a2602846219, identifier: BD12559
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_aa808c5ec1baefb28731da9209ff5b96.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_aa808c5ec1baefb28731da9209ff5b96.jpg not downloaded yet
2026-03-27 10:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e13ac1d5-2b60-5704-b8fc-7a2602846219 with identifier: BD12559
2026-03-27 10:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e13ac1d5-2b60-5704-b8fc-7a2602846219 with identifier: BD12559
2026-03-27 10:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e13ac1d5-2b60-5704-b8fc-7a2602846219 with identifier: BD12559 to the API
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:37:57Z',
'fuel_type': 'diesel',
'id': 'e13ac1d5-2b60-5704-b8fc-7a2602846219',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD12559',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 146014,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-06',
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi ST',
'transmission': 'automatic',
'trim': 'ST',
'year': 2017}
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD12559%27 HTTP/1.1" 200 None
2026-03-27 10:38:15 [auto1.de] INFO: Saving data for BD12559: {'auction_closing_time': 1774715877.0, 'created_time': 1773860716.854447, 'last_price_update_time': 1774607895.10151}
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD12559') HTTP/1.1" 204 0
2026-03-27 10:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1f1610>
2026-03-27 10:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_ee0b7a55cbe37d387eb0a842d52787c4.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_ee0b7a55cbe37d387eb0a842d52787c4.jpg saved to cache
2026-03-27 10:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 776ee6ce-a36f-5af4-b35f-51c5d3d387ff
2026-03-27 10:38:15 [auto1.de] INFO: Found listing with ID: HE81981
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE81981%27 HTTP/1.1" 200 None
2026-03-27 10:38:15 [auto1.de] INFO: Scrape type for HE81981: 2
2026-03-27 10:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8031733d-74bb-5c7a-8057-8b7a6c5b67f1 with identifier: HE81981
2026-03-27 10:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8031733d-74bb-5c7a-8057-8b7a6c5b67f1 with scrape type 2
2026-03-27 10:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8031733d-74bb-5c7a-8057-8b7a6c5b67f1 with scrape type 2
2026-03-27 10:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8031733d-74bb-5c7a-8057-8b7a6c5b67f1, identifier: HE81981
2026-03-27 10:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8031733d-74bb-5c7a-8057-8b7a6c5b67f1 with identifier: HE81981
2026-03-27 10:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8031733d-74bb-5c7a-8057-8b7a6c5b67f1 with identifier: HE81981
2026-03-27 10:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8031733d-74bb-5c7a-8057-8b7a6c5b67f1 with identifier: HE81981 to the API
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 88,
'expiration_date': '2026-03-28T16:09:31Z',
'fuel_type': 'petrol',
'id': '8031733d-74bb-5c7a-8057-8b7a6c5b67f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE81981',
'listing': 'auction',
'make': 'Nissan',
'model': 'Note',
'odometer': 173000,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-02-28',
'seller_name': None,
'title': 'Nissan Note 1.4 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2007}
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE81981%27 HTTP/1.1" 200 None
2026-03-27 10:38:15 [auto1.de] INFO: Saving data for HE81981: {'auction_closing_time': 1774714171.0, 'created_time': 1774089196.476957, 'last_price_update_time': 1774607895.585522}
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE81981') HTTP/1.1" 204 0
2026-03-27 10:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_c13b8ed979ea80532e3ada9f058789b6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:15 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-27 10:38:15 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF33157%27 HTTP/1.1" 200 None
2026-03-27 10:38:15 [auto1.de] INFO: Scrape type for RF33157: 2
2026-03-27 10:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2b92293-3558-573a-893f-6fb8b8f4a7d9 with identifier: RF33157
2026-03-27 10:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2b92293-3558-573a-893f-6fb8b8f4a7d9 with scrape type 2
2026-03-27 10:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2b92293-3558-573a-893f-6fb8b8f4a7d9 with scrape type 2
2026-03-27 10:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2b92293-3558-573a-893f-6fb8b8f4a7d9, identifier: RF33157
2026-03-27 10:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2b92293-3558-573a-893f-6fb8b8f4a7d9 with identifier: RF33157
2026-03-27 10:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2b92293-3558-573a-893f-6fb8b8f4a7d9 with identifier: RF33157
2026-03-27 10:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2b92293-3558-573a-893f-6fb8b8f4a7d9 with identifier: RF33157 to the API
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:08:17Z',
'fuel_type': 'petrol',
'id': 'e2b92293-3558-573a-893f-6fb8b8f4a7d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF33157',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 137869,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-08',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.0 eTSI Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2020}
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF33157%27 HTTP/1.1" 200 None
2026-03-27 10:38:16 [auto1.de] INFO: Saving data for RF33157: {'auction_closing_time': 1774714097.0, 'created_time': 1773305292.94173, 'last_price_update_time': 1774607896.053369}
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF33157') HTTP/1.1" 204 0
2026-03-27 10:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_cb15aae6262427e92f61ce9bf76e44cc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:16 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-27 10:38:16 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB46013%27 HTTP/1.1" 200 None
2026-03-27 10:38:16 [auto1.de] INFO: Scrape type for DB46013: 2
2026-03-27 10:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88abe614-304a-51eb-8deb-bc8dcfc5f306 with identifier: DB46013
2026-03-27 10:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88abe614-304a-51eb-8deb-bc8dcfc5f306 with scrape type 2
2026-03-27 10:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88abe614-304a-51eb-8deb-bc8dcfc5f306 with scrape type 2
2026-03-27 10:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88abe614-304a-51eb-8deb-bc8dcfc5f306, identifier: DB46013
2026-03-27 10:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88abe614-304a-51eb-8deb-bc8dcfc5f306 with identifier: DB46013
2026-03-27 10:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88abe614-304a-51eb-8deb-bc8dcfc5f306 with identifier: DB46013
2026-03-27 10:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88abe614-304a-51eb-8deb-bc8dcfc5f306 with identifier: DB46013 to the API
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:41:23Z',
'fuel_type': 'petrol',
'id': '88abe614-304a-51eb-8deb-bc8dcfc5f306',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB46013',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 170400,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-29',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB46013%27 HTTP/1.1" 200 None
2026-03-27 10:38:16 [auto1.de] INFO: Saving data for DB46013: {'auction_closing_time': 1774716083.0, 'created_time': 1774118784.130635, 'last_price_update_time': 1774607896.570153}
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB46013') HTTP/1.1" 204 0
2026-03-27 10:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be12c950>
2026-03-27 10:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_c13b8ed979ea80532e3ada9f058789b6.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_c13b8ed979ea80532e3ada9f058789b6.jpg saved to cache
2026-03-27 10:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 776ee6ce-a36f-5af4-b35f-51c5d3d387ff
2026-03-27 10:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_aa808c5ec1baefb28731da9209ff5b96.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:16 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-27 10:38:16 [auto1.de] INFO: Found listing with ID: ZN02812
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN02812%27 HTTP/1.1" 200 None
2026-03-27 10:38:16 [auto1.de] INFO: Scrape type for ZN02812: 2
2026-03-27 10:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0a518c9-8f96-5cf6-941c-aafadf099f61 with identifier: ZN02812
2026-03-27 10:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0a518c9-8f96-5cf6-941c-aafadf099f61 with scrape type 2
2026-03-27 10:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0a518c9-8f96-5cf6-941c-aafadf099f61 with scrape type 2
2026-03-27 10:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0a518c9-8f96-5cf6-941c-aafadf099f61, identifier: ZN02812
2026-03-27 10:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0a518c9-8f96-5cf6-941c-aafadf099f61 with identifier: ZN02812
2026-03-27 10:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0a518c9-8f96-5cf6-941c-aafadf099f61 with identifier: ZN02812
2026-03-27 10:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0a518c9-8f96-5cf6-941c-aafadf099f61 with identifier: ZN02812 to the API
2026-03-27 10:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:22:59Z',
'fuel_type': 'petrol',
'id': 'a0a518c9-8f96-5cf6-941c-aafadf099f61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN02812',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Picasso',
'odometer': 183182,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-30',
'seller_name': None,
'title': 'Citroen C3 Picasso 1.4 VTi Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2011}
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN02812%27 HTTP/1.1" 200 None
2026-03-27 10:38:17 [auto1.de] INFO: Saving data for ZN02812: {'auction_closing_time': 1774714979.0, 'created_time': 1773138866.989903, 'last_price_update_time': 1774607897.187985}
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN02812') HTTP/1.1" 204 0
2026-03-27 10:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be114790>
2026-03-27 10:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_cb15aae6262427e92f61ce9bf76e44cc.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_cb15aae6262427e92f61ce9bf76e44cc.jpg saved to cache
2026-03-27 10:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 776ee6ce-a36f-5af4-b35f-51c5d3d387ff
2026-03-27 10:38:17 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-27 10:38:17 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49272%27 HTTP/1.1" 200 None
2026-03-27 10:38:17 [auto1.de] INFO: Scrape type for AB49272: 2
2026-03-27 10:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50c864d2-f226-5120-a71e-75bfa3f07747 with identifier: AB49272
2026-03-27 10:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50c864d2-f226-5120-a71e-75bfa3f07747 with scrape type 2
2026-03-27 10:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50c864d2-f226-5120-a71e-75bfa3f07747 with scrape type 2
2026-03-27 10:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50c864d2-f226-5120-a71e-75bfa3f07747, identifier: AB49272
2026-03-27 10:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50c864d2-f226-5120-a71e-75bfa3f07747 with identifier: AB49272
2026-03-27 10:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50c864d2-f226-5120-a71e-75bfa3f07747 with identifier: AB49272
2026-03-27 10:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50c864d2-f226-5120-a71e-75bfa3f07747 with identifier: AB49272 to the API
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:01:05Z',
'fuel_type': 'diesel',
'id': '50c864d2-f226-5120-a71e-75bfa3f07747',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB49272',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 194424,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-11',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI First Edition',
'transmission': 'automatic',
'trim': 'First Edition',
'year': 2021}
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49272%27 HTTP/1.1" 200 None
2026-03-27 10:38:17 [auto1.de] INFO: Saving data for AB49272: {'auction_closing_time': 1774713665.0, 'created_time': 1773134489.569824, 'last_price_update_time': 1774607897.693026}
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB49272') HTTP/1.1" 204 0
2026-03-27 10:38:17 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 10506 | hits on page: 40
2026-03-27 10:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5fb650>
2026-03-27 10:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_aa808c5ec1baefb28731da9209ff5b96.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_aa808c5ec1baefb28731da9209ff5b96.jpg saved to cache
2026-03-27 10:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 776ee6ce-a36f-5af4-b35f-51c5d3d387ff
2026-03-27 10:38:17 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18754%27 HTTP/1.1" 200 None
2026-03-27 10:38:17 [auto1.de] INFO: Scrape type for BW18754: 2
2026-03-27 10:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 817b8bd8-7ade-5c1c-9197-da2b177c3918 with identifier: BW18754
2026-03-27 10:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 817b8bd8-7ade-5c1c-9197-da2b177c3918 with scrape type 2
2026-03-27 10:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 817b8bd8-7ade-5c1c-9197-da2b177c3918 with scrape type 2
2026-03-27 10:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 817b8bd8-7ade-5c1c-9197-da2b177c3918, identifier: BW18754
2026-03-27 10:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 817b8bd8-7ade-5c1c-9197-da2b177c3918 with identifier: BW18754
2026-03-27 10:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 817b8bd8-7ade-5c1c-9197-da2b177c3918 with identifier: BW18754
2026-03-27 10:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 817b8bd8-7ade-5c1c-9197-da2b177c3918 with identifier: BW18754 to the API
2026-03-27 10:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:19:11Z',
'fuel_type': 'petrol',
'id': '817b8bd8-7ade-5c1c-9197-da2b177c3918',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW18754',
'listing': 'auction',
'make': 'Honda',
'model': 'Accord',
'odometer': 138476,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-11-11',
'seller_name': None,
'title': 'Honda Accord 2.4 VTEC Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2009}
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18754%27 HTTP/1.1" 200 None
2026-03-27 10:38:18 [auto1.de] INFO: Saving data for BW18754: {'auction_closing_time': 1774714751.0, 'created_time': 1772544544.427147, 'last_price_update_time': 1774607898.225505}
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW18754') HTTP/1.1" 204 0
2026-03-27 10:38:18 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-27 10:38:18 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG89012%27 HTTP/1.1" 200 None
2026-03-27 10:38:18 [auto1.de] INFO: Scrape type for GG89012: 2
2026-03-27 10:38:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64215c5a-ab4d-5350-a044-f3423f6f20ea with identifier: GG89012
2026-03-27 10:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64215c5a-ab4d-5350-a044-f3423f6f20ea with scrape type 2
2026-03-27 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64215c5a-ab4d-5350-a044-f3423f6f20ea with scrape type 2
2026-03-27 10:38:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64215c5a-ab4d-5350-a044-f3423f6f20ea, identifier: GG89012
2026-03-27 10:38:18 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF02392%27 HTTP/1.1" 200 None
2026-03-27 10:38:18 [auto1.de] INFO: Scrape type for MF02392: 0
2026-03-27 10:38:18 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN30919%27 HTTP/1.1" 200 None
2026-03-27 10:38:18 [auto1.de] INFO: Scrape type for BN30919: 2
2026-03-27 10:38:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62e4f9f8-8432-506d-bea7-8fe86bb0cc68 with identifier: BN30919
2026-03-27 10:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62e4f9f8-8432-506d-bea7-8fe86bb0cc68 with scrape type 2
2026-03-27 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62e4f9f8-8432-506d-bea7-8fe86bb0cc68 with scrape type 2
2026-03-27 10:38:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62e4f9f8-8432-506d-bea7-8fe86bb0cc68, identifier: BN30919
2026-03-27 10:38:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64215c5a-ab4d-5350-a044-f3423f6f20ea with identifier: GG89012
2026-03-27 10:38:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64215c5a-ab4d-5350-a044-f3423f6f20ea with identifier: GG89012
2026-03-27 10:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64215c5a-ab4d-5350-a044-f3423f6f20ea with identifier: GG89012 to the API
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:08:35Z',
'fuel_type': 'petrol',
'id': '64215c5a-ab4d-5350-a044-f3423f6f20ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG89012',
'listing': 'auction',
'make': 'Kia',
'model': "pro_cee'd",
'odometer': 57076,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-05',
'seller_name': None,
'title': "Kia pro_cee'd 1.6 GDI Edition 7",
'transmission': 'manual',
'trim': 'Edition 7',
'year': 2013}
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG89012%27 HTTP/1.1" 200 None
2026-03-27 10:38:18 [auto1.de] INFO: Saving data for GG89012: {'auction_closing_time': 1774714115.0, 'created_time': 1773859450.64307, 'last_price_update_time': 1774607898.808743}
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG89012') HTTP/1.1" 204 0
2026-03-27 10:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62e4f9f8-8432-506d-bea7-8fe86bb0cc68 with identifier: BN30919
2026-03-27 10:38:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62e4f9f8-8432-506d-bea7-8fe86bb0cc68 with identifier: BN30919
2026-03-27 10:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62e4f9f8-8432-506d-bea7-8fe86bb0cc68 with identifier: BN30919 to the API
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:27:44Z',
'fuel_type': 'diesel',
'id': '62e4f9f8-8432-506d-bea7-8fe86bb0cc68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN30919',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Arteon Shooting Brake',
'odometer': 75199,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-09',
'seller_name': None,
'title': 'Volkswagen Arteon Shooting Brake 2.0 TDI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2022}
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN30919%27 HTTP/1.1" 200 None
2026-03-27 10:38:19 [auto1.de] INFO: Saving data for BN30919: {'auction_closing_time': 1774715264.0, 'created_time': 1774294623.900487, 'last_price_update_time': 1774607899.141055}
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN30919') HTTP/1.1" 204 0
2026-03-27 10:38:19 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB86141%27 HTTP/1.1" 200 None
2026-03-27 10:38:19 [auto1.de] INFO: Scrape type for JB86141: 2
2026-03-27 10:38:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5c1fd9e-d176-56bd-ad90-46043809d1e1 with identifier: JB86141
2026-03-27 10:38:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5c1fd9e-d176-56bd-ad90-46043809d1e1 with scrape type 2
2026-03-27 10:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5c1fd9e-d176-56bd-ad90-46043809d1e1 with scrape type 2
2026-03-27 10:38:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5c1fd9e-d176-56bd-ad90-46043809d1e1, identifier: JB86141
2026-03-27 10:38:19 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-27 10:38:19 [auto1.de] INFO: Found listing with ID: UN34708
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN34708%27 HTTP/1.1" 200 None
2026-03-27 10:38:19 [auto1.de] INFO: Scrape type for UN34708: 2
2026-03-27 10:38:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81577de7-eb3a-5463-9639-51d493d36a3a with identifier: UN34708
2026-03-27 10:38:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81577de7-eb3a-5463-9639-51d493d36a3a with scrape type 2
2026-03-27 10:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81577de7-eb3a-5463-9639-51d493d36a3a with scrape type 2
2026-03-27 10:38:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81577de7-eb3a-5463-9639-51d493d36a3a, identifier: UN34708
2026-03-27 10:38:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5c1fd9e-d176-56bd-ad90-46043809d1e1 with identifier: JB86141
2026-03-27 10:38:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5c1fd9e-d176-56bd-ad90-46043809d1e1 with identifier: JB86141
2026-03-27 10:38:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5c1fd9e-d176-56bd-ad90-46043809d1e1 with identifier: JB86141 to the API
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-28T16:12:02Z',
'fuel_type': 'diesel',
'id': 'd5c1fd9e-d176-56bd-ad90-46043809d1e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB86141',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 252922,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-06',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2016}
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB86141%27 HTTP/1.1" 200 None
2026-03-27 10:38:19 [auto1.de] INFO: Saving data for JB86141: {'auction_closing_time': 1774714322.0, 'created_time': 1773303080.55393, 'last_price_update_time': 1774607899.722241}
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB86141') HTTP/1.1" 204 0
2026-03-27 10:38:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81577de7-eb3a-5463-9639-51d493d36a3a with identifier: UN34708
2026-03-27 10:38:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81577de7-eb3a-5463-9639-51d493d36a3a with identifier: UN34708
2026-03-27 10:38:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81577de7-eb3a-5463-9639-51d493d36a3a with identifier: UN34708 to the API
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:59:59Z',
'fuel_type': 'diesel',
'id': '81577de7-eb3a-5463-9639-51d493d36a3a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN34708',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 286962,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-05-18',
'seller_name': None,
'title': 'Kia Sportage 2.0 CRDi Cup 2WD',
'transmission': 'manual',
'trim': 'Cup 2WD',
'year': 2008}
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN34708%27 HTTP/1.1" 200 None
2026-03-27 10:38:20 [auto1.de] INFO: Saving data for UN34708: {'auction_closing_time': 1774717199.0, 'created_time': 1773773678.231912, 'last_price_update_time': 1774607900.154375}
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN34708') HTTP/1.1" 204 0
2026-03-27 10:38:20 [auto1.de] INFO: Found listing with ID: LG78390
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG78390%27 HTTP/1.1" 200 None
2026-03-27 10:38:20 [auto1.de] INFO: Scrape type for LG78390: 2
2026-03-27 10:38:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88256312-a852-5775-867a-2264f0d900c7 with identifier: LG78390
2026-03-27 10:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88256312-a852-5775-867a-2264f0d900c7 with scrape type 2
2026-03-27 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88256312-a852-5775-867a-2264f0d900c7 with scrape type 2
2026-03-27 10:38:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88256312-a852-5775-867a-2264f0d900c7, identifier: LG78390
2026-03-27 10:38:20 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28437%27 HTTP/1.1" 200 None
2026-03-27 10:38:20 [auto1.de] INFO: Scrape type for SG28437: 2
2026-03-27 10:38:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 748b6df4-fbcf-5793-af67-9dae2675bdf7 with identifier: SG28437
2026-03-27 10:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 748b6df4-fbcf-5793-af67-9dae2675bdf7 with scrape type 2
2026-03-27 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 748b6df4-fbcf-5793-af67-9dae2675bdf7 with scrape type 2
2026-03-27 10:38:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 748b6df4-fbcf-5793-af67-9dae2675bdf7, identifier: SG28437
2026-03-27 10:38:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88256312-a852-5775-867a-2264f0d900c7 with identifier: LG78390
2026-03-27 10:38:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88256312-a852-5775-867a-2264f0d900c7 with identifier: LG78390
2026-03-27 10:38:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88256312-a852-5775-867a-2264f0d900c7 with identifier: LG78390 to the API
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 98,
'expiration_date': '2026-03-28T16:05:10Z',
'fuel_type': 'petrol',
'id': '88256312-a852-5775-867a-2264f0d900c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG78390',
'listing': 'auction',
'make': 'Nissan',
'model': 'Micra',
'odometer': 77653,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-06',
'seller_name': None,
'title': 'Nissan Micra 1.2 N-Tec',
'transmission': 'automatic',
'trim': 'N-Tec',
'year': 2016}
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG78390%27 HTTP/1.1" 200 None
2026-03-27 10:38:20 [auto1.de] INFO: Saving data for LG78390: {'auction_closing_time': 1774713910.0, 'created_time': 1774293263.607878, 'last_price_update_time': 1774607900.703813}
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG78390') HTTP/1.1" 204 0
2026-03-27 10:38:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 748b6df4-fbcf-5793-af67-9dae2675bdf7 with identifier: SG28437
2026-03-27 10:38:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 748b6df4-fbcf-5793-af67-9dae2675bdf7 with identifier: SG28437
2026-03-27 10:38:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 748b6df4-fbcf-5793-af67-9dae2675bdf7 with identifier: SG28437 to the API
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:53:04Z',
'fuel_type': 'petrol',
'id': '748b6df4-fbcf-5793-af67-9dae2675bdf7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG28437',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 164065,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-17',
'seller_name': None,
'title': 'Fiat Panda 1.2 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2011}
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28437%27 HTTP/1.1" 200 None
2026-03-27 10:38:21 [auto1.de] INFO: Saving data for SG28437: {'auction_closing_time': 1774716784.0, 'created_time': 1773427268.636839, 'last_price_update_time': 1774607901.067654}
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG28437') HTTP/1.1" 204 0
2026-03-27 10:38:21 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX10295%27 HTTP/1.1" 200 None
2026-03-27 10:38:21 [auto1.de] INFO: Scrape type for BX10295: 2
2026-03-27 10:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 218e7776-a342-5542-9077-b0be9c8ccbf7 with identifier: BX10295
2026-03-27 10:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 218e7776-a342-5542-9077-b0be9c8ccbf7 with scrape type 2
2026-03-27 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 218e7776-a342-5542-9077-b0be9c8ccbf7 with scrape type 2
2026-03-27 10:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 218e7776-a342-5542-9077-b0be9c8ccbf7, identifier: BX10295
2026-03-27 10:38:21 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-27 10:38:21 [auto1.de] INFO: Found listing with ID: SX47208
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX47208%27 HTTP/1.1" 200 None
2026-03-27 10:38:21 [auto1.de] INFO: Scrape type for SX47208: 1
2026-03-27 10:38:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 218e7776-a342-5542-9077-b0be9c8ccbf7 with identifier: BX10295
2026-03-27 10:38:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 218e7776-a342-5542-9077-b0be9c8ccbf7 with identifier: BX10295
2026-03-27 10:38:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 218e7776-a342-5542-9077-b0be9c8ccbf7 with identifier: BX10295 to the API
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 77,
'expiration_date': '2026-03-28T16:04:17Z',
'fuel_type': 'petrol',
'id': '218e7776-a342-5542-9077-b0be9c8ccbf7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX10295',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 174695,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-26',
'seller_name': None,
'title': 'Hyundai i20 1.2 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2012}
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX10295%27 HTTP/1.1" 200 None
2026-03-27 10:38:21 [auto1.de] INFO: Saving data for BX10295: {'auction_closing_time': 1774713857.0, 'created_time': 1773773776.410559, 'last_price_update_time': 1774607901.568765}
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX10295') HTTP/1.1" 204 0
2026-03-27 10:38:21 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-27 10:38:21 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-27 10:38:21 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF82631%27 HTTP/1.1" 200 None
2026-03-27 10:38:21 [auto1.de] INFO: Scrape type for EF82631: 2
2026-03-27 10:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b with identifier: EF82631
2026-03-27 10:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b with scrape type 2
2026-03-27 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b with scrape type 2
2026-03-27 10:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b, identifier: EF82631
2026-03-27 10:38:21 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69910%27 HTTP/1.1" 200 None
2026-03-27 10:38:21 [auto1.de] INFO: Scrape type for DE69910: 2
2026-03-27 10:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1ee61fe-a6d5-513c-bf2d-0e876c11d443 with identifier: DE69910
2026-03-27 10:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ee61fe-a6d5-513c-bf2d-0e876c11d443 with scrape type 2
2026-03-27 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1ee61fe-a6d5-513c-bf2d-0e876c11d443 with scrape type 2
2026-03-27 10:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1ee61fe-a6d5-513c-bf2d-0e876c11d443, identifier: DE69910
2026-03-27 10:38:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b with identifier: EF82631
2026-03-27 10:38:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b with identifier: EF82631
2026-03-27 10:38:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b with identifier: EF82631 to the API
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 77,
'expiration_date': '2026-03-28T16:57:37Z',
'fuel_type': 'petrol',
'id': 'fd68df99-2c8e-54f7-aaa8-cdc455bfdc8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF82631',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto Evo',
'odometer': 74750,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-14',
'seller_name': None,
'title': 'Fiat Punto Evo 1.4 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2010}
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF82631%27 HTTP/1.1" 200 None
2026-03-27 10:38:22 [auto1.de] INFO: Saving data for EF82631: {'auction_closing_time': 1774717057.0, 'created_time': 1773773966.992262, 'last_price_update_time': 1774607902.200882}
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF82631') HTTP/1.1" 204 0
2026-03-27 10:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1ee61fe-a6d5-513c-bf2d-0e876c11d443 with identifier: DE69910
2026-03-27 10:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1ee61fe-a6d5-513c-bf2d-0e876c11d443 with identifier: DE69910
2026-03-27 10:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1ee61fe-a6d5-513c-bf2d-0e876c11d443 with identifier: DE69910 to the API
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:30:05Z',
'fuel_type': 'diesel',
'id': 'a1ee61fe-a6d5-513c-bf2d-0e876c11d443',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE69910',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 145573,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-10',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2016}
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69910%27 HTTP/1.1" 200 None
2026-03-27 10:38:22 [auto1.de] INFO: Saving data for DE69910: {'auction_closing_time': 1774715405.0, 'created_time': 1773859723.229698, 'last_price_update_time': 1774607902.566655}
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE69910') HTTP/1.1" 204 0
2026-03-27 10:38:22 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-27 10:38:22 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU16718%27 HTTP/1.1" 200 None
2026-03-27 10:38:22 [auto1.de] INFO: Scrape type for HU16718: 2
2026-03-27 10:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a74c911e-68c6-58e9-b22d-dc2aa97d03a7 with identifier: HU16718
2026-03-27 10:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a74c911e-68c6-58e9-b22d-dc2aa97d03a7 with scrape type 2
2026-03-27 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a74c911e-68c6-58e9-b22d-dc2aa97d03a7 with scrape type 2
2026-03-27 10:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a74c911e-68c6-58e9-b22d-dc2aa97d03a7, identifier: HU16718
2026-03-27 10:38:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:22 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-27 10:38:22 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-27 10:38:22 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-27 10:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a74c911e-68c6-58e9-b22d-dc2aa97d03a7 with identifier: HU16718
2026-03-27 10:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a74c911e-68c6-58e9-b22d-dc2aa97d03a7 with identifier: HU16718
2026-03-27 10:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a74c911e-68c6-58e9-b22d-dc2aa97d03a7 with identifier: HU16718 to the API
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:28:18Z',
'fuel_type': 'petrol',
'id': 'a74c911e-68c6-58e9-b22d-dc2aa97d03a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU16718',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 152833,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-11',
'seller_name': None,
'title': 'Nissan Qashqai 1.2 Visia',
'transmission': 'manual',
'trim': 'Visia',
'year': 2016}
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU16718%27 HTTP/1.1" 200 None
2026-03-27 10:38:23 [auto1.de] INFO: Saving data for HU16718: {'auction_closing_time': 1774715298.0, 'created_time': 1773306426.214923, 'last_price_update_time': 1774607903.112296}
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU16718') HTTP/1.1" 204 0
2026-03-27 10:38:23 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-27 10:38:23 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-27 10:38:23 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA99169%27 HTTP/1.1" 200 None
2026-03-27 10:38:23 [auto1.de] INFO: Scrape type for HA99169: 2
2026-03-27 10:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d02b93fe-7708-5ebe-aed6-8eccae35fb81 with identifier: HA99169
2026-03-27 10:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d02b93fe-7708-5ebe-aed6-8eccae35fb81 with scrape type 2
2026-03-27 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d02b93fe-7708-5ebe-aed6-8eccae35fb81 with scrape type 2
2026-03-27 10:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d02b93fe-7708-5ebe-aed6-8eccae35fb81, identifier: HA99169
2026-03-27 10:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d02b93fe-7708-5ebe-aed6-8eccae35fb81 with identifier: HA99169
2026-03-27 10:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d02b93fe-7708-5ebe-aed6-8eccae35fb81 with identifier: HA99169
2026-03-27 10:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d02b93fe-7708-5ebe-aed6-8eccae35fb81 with identifier: HA99169 to the API
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 194,
'expiration_date': '2026-03-28T16:14:36Z',
'fuel_type': 'diesel',
'id': 'd02b93fe-7708-5ebe-aed6-8eccae35fb81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA99169',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 85673,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-11',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d T AMG Line',
'transmission': 'automatic',
'trim': 'T AMG Line',
'year': 2019}
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA99169%27 HTTP/1.1" 200 None
2026-03-27 10:38:23 [auto1.de] INFO: Saving data for HA99169: {'auction_closing_time': 1774714476.0, 'created_time': 1773830069.665637, 'last_price_update_time': 1774607903.672436}
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA99169') HTTP/1.1" 204 0
2026-03-27 10:38:23 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY38504%27 HTTP/1.1" 200 None
2026-03-27 10:38:23 [auto1.de] INFO: Scrape type for VY38504: 2
2026-03-27 10:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e6ea5b5-9c84-5faf-bee5-397c07a344e5 with identifier: VY38504
2026-03-27 10:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e6ea5b5-9c84-5faf-bee5-397c07a344e5 with scrape type 2
2026-03-27 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e6ea5b5-9c84-5faf-bee5-397c07a344e5 with scrape type 2
2026-03-27 10:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e6ea5b5-9c84-5faf-bee5-397c07a344e5, identifier: VY38504
2026-03-27 10:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e6ea5b5-9c84-5faf-bee5-397c07a344e5 with identifier: VY38504
2026-03-27 10:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e6ea5b5-9c84-5faf-bee5-397c07a344e5 with identifier: VY38504
2026-03-27 10:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e6ea5b5-9c84-5faf-bee5-397c07a344e5 with identifier: VY38504 to the API
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:56:46Z',
'fuel_type': 'petrol',
'id': '1e6ea5b5-9c84-5faf-bee5-397c07a344e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY38504',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 202407,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-14',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TSI Sport & Style 4Motion',
'transmission': 'automatic',
'trim': 'Sport & Style 4Motion',
'year': 2013}
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY38504%27 HTTP/1.1" 200 None
2026-03-27 10:38:24 [auto1.de] INFO: Saving data for VY38504: {'auction_closing_time': 1774717006.0, 'created_time': 1773469060.326289, 'last_price_update_time': 1774607904.158155}
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY38504') HTTP/1.1" 204 0
2026-03-27 10:38:24 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV25336%27 HTTP/1.1" 200 None
2026-03-27 10:38:24 [auto1.de] INFO: Scrape type for AV25336: 2
2026-03-27 10:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7684311f-9023-5752-ad89-ae2b4edace59 with identifier: AV25336
2026-03-27 10:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7684311f-9023-5752-ad89-ae2b4edace59 with scrape type 2
2026-03-27 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7684311f-9023-5752-ad89-ae2b4edace59 with scrape type 2
2026-03-27 10:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7684311f-9023-5752-ad89-ae2b4edace59, identifier: AV25336
2026-03-27 10:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7684311f-9023-5752-ad89-ae2b4edace59 with identifier: AV25336
2026-03-27 10:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7684311f-9023-5752-ad89-ae2b4edace59 with identifier: AV25336
2026-03-27 10:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7684311f-9023-5752-ad89-ae2b4edace59 with identifier: AV25336 to the API
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:46:35Z',
'fuel_type': 'diesel',
'id': '7684311f-9023-5752-ad89-ae2b4edace59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV25336',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 138703,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-18',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2018}
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV25336%27 HTTP/1.1" 200 None
2026-03-27 10:38:24 [auto1.de] INFO: Saving data for AV25336: {'auction_closing_time': 1774716395.0, 'created_time': 1773468410.629751, 'last_price_update_time': 1774607904.70699}
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV25336') HTTP/1.1" 204 0
2026-03-27 10:38:24 [auto1.de] INFO: Found listing with ID: ZV87570
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV87570%27 HTTP/1.1" 200 None
2026-03-27 10:38:24 [auto1.de] INFO: Scrape type for ZV87570: 1
2026-03-27 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_435a17dd2b7a8210a8363623b84d0ce3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:24 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-27 10:38:24 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV09971%27 HTTP/1.1" 200 None
2026-03-27 10:38:24 [auto1.de] INFO: Scrape type for YV09971: 2
2026-03-27 10:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0ca242c-b1ce-5eb1-b043-e3b0405fc282 with identifier: YV09971
2026-03-27 10:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0ca242c-b1ce-5eb1-b043-e3b0405fc282 with scrape type 2
2026-03-27 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0ca242c-b1ce-5eb1-b043-e3b0405fc282 with scrape type 2
2026-03-27 10:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0ca242c-b1ce-5eb1-b043-e3b0405fc282, identifier: YV09971
2026-03-27 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_0b8ac1d71f71dd696c08bfa57e1ab558.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0ca242c-b1ce-5eb1-b043-e3b0405fc282 with identifier: YV09971
2026-03-27 10:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0ca242c-b1ce-5eb1-b043-e3b0405fc282 with identifier: YV09971
2026-03-27 10:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0ca242c-b1ce-5eb1-b043-e3b0405fc282 with identifier: YV09971 to the API
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:06:37Z',
'fuel_type': 'petrol',
'id': 'd0ca242c-b1ce-5eb1-b043-e3b0405fc282',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV09971',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 89766,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-29',
'seller_name': None,
'title': 'Seat Ibiza 1.0 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2016}
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV09971%27 HTTP/1.1" 200 None
2026-03-27 10:38:25 [auto1.de] INFO: Saving data for YV09971: {'auction_closing_time': 1774713997.0, 'created_time': 1773304612.746314, 'last_price_update_time': 1774607905.184163}
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV09971') HTTP/1.1" 204 0
2026-03-27 10:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_d55cc06d00d42173672c57199e9653c8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:25 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02075%27 HTTP/1.1" 200 None
2026-03-27 10:38:25 [auto1.de] INFO: Scrape type for SJ02075: 2
2026-03-27 10:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec67ed56-0091-57b5-bfad-1c365132b915 with identifier: SJ02075
2026-03-27 10:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec67ed56-0091-57b5-bfad-1c365132b915 with scrape type 2
2026-03-27 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec67ed56-0091-57b5-bfad-1c365132b915 with scrape type 2
2026-03-27 10:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec67ed56-0091-57b5-bfad-1c365132b915, identifier: SJ02075
2026-03-27 10:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec67ed56-0091-57b5-bfad-1c365132b915 with identifier: SJ02075
2026-03-27 10:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec67ed56-0091-57b5-bfad-1c365132b915 with identifier: SJ02075
2026-03-27 10:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec67ed56-0091-57b5-bfad-1c365132b915 with identifier: SJ02075 to the API
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:10:17Z',
'fuel_type': 'diesel',
'id': 'ec67ed56-0091-57b5-bfad-1c365132b915',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ02075',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 186241,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-09',
'seller_name': None,
'title': 'BMW 1er 123d',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02075%27 HTTP/1.1" 200 None
2026-03-27 10:38:25 [auto1.de] INFO: Saving data for SJ02075: {'auction_closing_time': 1774714217.0, 'created_time': 1773305763.373075, 'last_price_update_time': 1774607905.648823}
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ02075') HTTP/1.1" 204 0
2026-03-27 10:38:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4e2c90>
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_435a17dd2b7a8210a8363623b84d0ce3.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_435a17dd2b7a8210a8363623b84d0ce3.jpg saved to cache
2026-03-27 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 776ee6ce-a36f-5af4-b35f-51c5d3d387ff
2026-03-27 10:38:25 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-27 10:38:25 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ09697%27 HTTP/1.1" 200 None
2026-03-27 10:38:25 [auto1.de] INFO: Scrape type for BZ09697: 2
2026-03-27 10:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18ef7598-ba83-523c-89e6-32bc73e121d3 with identifier: BZ09697
2026-03-27 10:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18ef7598-ba83-523c-89e6-32bc73e121d3 with scrape type 2
2026-03-27 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18ef7598-ba83-523c-89e6-32bc73e121d3 with scrape type 2
2026-03-27 10:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18ef7598-ba83-523c-89e6-32bc73e121d3, identifier: BZ09697
2026-03-27 10:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18ef7598-ba83-523c-89e6-32bc73e121d3 with identifier: BZ09697
2026-03-27 10:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18ef7598-ba83-523c-89e6-32bc73e121d3 with identifier: BZ09697
2026-03-27 10:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18ef7598-ba83-523c-89e6-32bc73e121d3 with identifier: BZ09697 to the API
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:45:51Z',
'fuel_type': 'petrol',
'id': '18ef7598-ba83-523c-89e6-32bc73e121d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ09697',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 113182,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-21',
'seller_name': None,
'title': 'Hyundai i20 1.2 Select',
'transmission': 'manual',
'trim': 'Select',
'year': 2018}
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ09697%27 HTTP/1.1" 200 None
2026-03-27 10:38:26 [auto1.de] INFO: Saving data for BZ09697: {'auction_closing_time': 1774716351.0, 'created_time': 1773860086.480419, 'last_price_update_time': 1774607906.353968}
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ09697') HTTP/1.1" 204 0
2026-03-27 10:38:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5b1410>
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_0b8ac1d71f71dd696c08bfa57e1ab558.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_0b8ac1d71f71dd696c08bfa57e1ab558.jpg saved to cache
2026-03-27 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 776ee6ce-a36f-5af4-b35f-51c5d3d387ff
2026-03-27 10:38:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b2290>
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_d55cc06d00d42173672c57199e9653c8.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_d55cc06d00d42173672c57199e9653c8.jpg saved to cache
2026-03-27 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 776ee6ce-a36f-5af4-b35f-51c5d3d387ff
2026-03-27 10:38:26 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27996%27 HTTP/1.1" 200 None
2026-03-27 10:38:26 [auto1.de] INFO: Scrape type for DM27996: 2
2026-03-27 10:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d with identifier: DM27996
2026-03-27 10:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d with scrape type 2
2026-03-27 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d with scrape type 2
2026-03-27 10:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d, identifier: DM27996
2026-03-27 10:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NA53807/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d with identifier: DM27996
2026-03-27 10:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d with identifier: DM27996
2026-03-27 10:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bc00823-3ffb-544d-be7d-5f2e5ea06d2d with identifier: DM27996 to the API
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:51:03Z',
'fuel_type': 'diesel',
'id': '7bc00823-3ffb-544d-be7d-5f2e5ea06d2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM27996',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 111162,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-22',
'seller_name': None,
'title': 'BMW X1 xDrive 18d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2018}
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27996%27 HTTP/1.1" 200 None
2026-03-27 10:38:27 [auto1.de] INFO: Saving data for DM27996: {'auction_closing_time': 1774716663.0, 'created_time': 1773305985.666831, 'last_price_update_time': 1774607907.235449}
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM27996') HTTP/1.1" 204 0
2026-03-27 10:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_7ff5b05786bce145174137886eabbdeb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:27 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53994%27 HTTP/1.1" 200 None
2026-03-27 10:38:27 [auto1.de] INFO: Scrape type for CT53994: 2
2026-03-27 10:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80d2dad0-7181-5cd1-9608-e2d3918173ba with identifier: CT53994
2026-03-27 10:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80d2dad0-7181-5cd1-9608-e2d3918173ba with scrape type 2
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80d2dad0-7181-5cd1-9608-e2d3918173ba with scrape type 2
2026-03-27 10:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80d2dad0-7181-5cd1-9608-e2d3918173ba, identifier: CT53994
2026-03-27 10:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX47208/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80d2dad0-7181-5cd1-9608-e2d3918173ba with identifier: CT53994
2026-03-27 10:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80d2dad0-7181-5cd1-9608-e2d3918173ba with identifier: CT53994
2026-03-27 10:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80d2dad0-7181-5cd1-9608-e2d3918173ba with identifier: CT53994 to the API
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:07:43Z',
'fuel_type': 'petrol',
'id': '80d2dad0-7181-5cd1-9608-e2d3918173ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT53994',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 137039,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-19',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53994%27 HTTP/1.1" 200 None
2026-03-27 10:38:27 [auto1.de] INFO: Saving data for CT53994: {'auction_closing_time': 1774714063.0, 'created_time': 1773859659.327243, 'last_price_update_time': 1774607907.731544}
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT53994') HTTP/1.1" 204 0
2026-03-27 10:38:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:27 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-27 10:38:27 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL87064%27 HTTP/1.1" 200 None
2026-03-27 10:38:27 [auto1.de] INFO: Scrape type for TL87064: 2
2026-03-27 10:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f37a7713-284f-522c-8080-133b27842212 with identifier: TL87064
2026-03-27 10:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f37a7713-284f-522c-8080-133b27842212 with scrape type 2
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f37a7713-284f-522c-8080-133b27842212 with scrape type 2
2026-03-27 10:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f37a7713-284f-522c-8080-133b27842212, identifier: TL87064
2026-03-27 10:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_6c61153c7f9e74682ea2607e9dd7a00b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f37a7713-284f-522c-8080-133b27842212 with identifier: TL87064
2026-03-27 10:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f37a7713-284f-522c-8080-133b27842212 with identifier: TL87064
2026-03-27 10:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f37a7713-284f-522c-8080-133b27842212 with identifier: TL87064 to the API
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:35:26Z',
'fuel_type': 'diesel',
'id': 'f37a7713-284f-522c-8080-133b27842212',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL87064',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 365118,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-03',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Soleil',
'transmission': 'automatic',
'trim': 'Soleil',
'year': 2019}
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL87064%27 HTTP/1.1" 200 None
2026-03-27 10:38:28 [auto1.de] INFO: Saving data for TL87064: {'auction_closing_time': 1774715726.0, 'created_time': 1773384981.848925, 'last_price_update_time': 1774607908.263616}
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL87064') HTTP/1.1" 204 0
2026-03-27 10:38:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3cc2d0>
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_7ff5b05786bce145174137886eabbdeb.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_7ff5b05786bce145174137886eabbdeb.jpg saved to cache
2026-03-27 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 776ee6ce-a36f-5af4-b35f-51c5d3d387ff
2026-03-27 10:38:28 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-27 10:38:28 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS69855%27 HTTP/1.1" 200 None
2026-03-27 10:38:28 [auto1.de] INFO: Scrape type for WS69855: 2
2026-03-27 10:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32af0df3-57f2-5180-b5a1-84e2433f86fc with identifier: WS69855
2026-03-27 10:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32af0df3-57f2-5180-b5a1-84e2433f86fc with scrape type 2
2026-03-27 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32af0df3-57f2-5180-b5a1-84e2433f86fc with scrape type 2
2026-03-27 10:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32af0df3-57f2-5180-b5a1-84e2433f86fc, identifier: WS69855
2026-03-27 10:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32af0df3-57f2-5180-b5a1-84e2433f86fc with identifier: WS69855
2026-03-27 10:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32af0df3-57f2-5180-b5a1-84e2433f86fc with identifier: WS69855
2026-03-27 10:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32af0df3-57f2-5180-b5a1-84e2433f86fc with identifier: WS69855 to the API
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:09:00Z',
'fuel_type': 'petrol',
'id': '32af0df3-57f2-5180-b5a1-84e2433f86fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS69855',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 52108,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-07',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2014}
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS69855%27 HTTP/1.1" 200 None
2026-03-27 10:38:28 [auto1.de] INFO: Saving data for WS69855: {'auction_closing_time': 1774714140.0, 'created_time': 1773308242.602443, 'last_price_update_time': 1774607908.871306}
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS69855') HTTP/1.1" 204 0
2026-03-27 10:38:28 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB25597%27 HTTP/1.1" 200 None
2026-03-27 10:38:28 [auto1.de] INFO: Scrape type for DB25597: 2
2026-03-27 10:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74 with identifier: DB25597
2026-03-27 10:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74 with scrape type 2
2026-03-27 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74 with scrape type 2
2026-03-27 10:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74, identifier: DB25597
2026-03-27 10:38:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74 with identifier: DB25597
2026-03-27 10:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74 with identifier: DB25597
2026-03-27 10:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74 with identifier: DB25597 to the API
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:56:41Z',
'fuel_type': 'diesel',
'id': '0271a3f5-8cb4-5ff7-9f2c-6b5abafc6c74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB25597',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 253231,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-02',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2012}
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB25597%27 HTTP/1.1" 200 None
2026-03-27 10:38:29 [auto1.de] INFO: Saving data for DB25597: {'auction_closing_time': 1774717001.0, 'created_time': 1773898264.840139, 'last_price_update_time': 1774607909.3353}
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB25597') HTTP/1.1" 204 0
2026-03-27 10:38:29 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-27 10:38:29 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-27 10:38:29 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-27 10:38:29 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT47109%27 HTTP/1.1" 200 None
2026-03-27 10:38:29 [auto1.de] INFO: Scrape type for LT47109: 2
2026-03-27 10:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26c0ac4b-95b8-5a8b-968d-df677fc18d31 with identifier: LT47109
2026-03-27 10:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26c0ac4b-95b8-5a8b-968d-df677fc18d31 with scrape type 2
2026-03-27 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26c0ac4b-95b8-5a8b-968d-df677fc18d31 with scrape type 2
2026-03-27 10:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26c0ac4b-95b8-5a8b-968d-df677fc18d31, identifier: LT47109
2026-03-27 10:38:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1c5f10>
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F93%252Fb2934bd478f22785ffb0cbec36dafa88%252Fpa%252FLV46830_6c61153c7f9e74682ea2607e9dd7a00b.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_6c61153c7f9e74682ea2607e9dd7a00b.jpg saved to cache
2026-03-27 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 776ee6ce-a36f-5af4-b35f-51c5d3d387ff
2026-03-27 10:38:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 776ee6ce-a36f-5af4-b35f-51c5d3d387ff, skipping ID generation
2026-03-27 10:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 776ee6ce-a36f-5af4-b35f-51c5d3d387ff with scrape type 1
2026-03-27 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 776ee6ce-a36f-5af4-b35f-51c5d3d387ff sending to next pipeline
2026-03-27 10:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 776ee6ce-a36f-5af4-b35f-51c5d3d387ff, identifier: LV46830
2026-03-27 10:38:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26c0ac4b-95b8-5a8b-968d-df677fc18d31 with identifier: LT47109
2026-03-27 10:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26c0ac4b-95b8-5a8b-968d-df677fc18d31 with identifier: LT47109
2026-03-27 10:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26c0ac4b-95b8-5a8b-968d-df677fc18d31 with identifier: LT47109 to the API
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:45:04Z',
'fuel_type': 'petrol',
'id': '26c0ac4b-95b8-5a8b-968d-df677fc18d31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT47109',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 134954,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-26',
'seller_name': None,
'title': 'Skoda Fabia 1.0 MPI Cool Plus',
'transmission': 'manual',
'trim': 'Cool Plus',
'year': 2018}
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT47109%27 HTTP/1.1" 200 None
2026-03-27 10:38:30 [auto1.de] INFO: Saving data for LT47109: {'auction_closing_time': 1774716304.0, 'created_time': 1773741883.359919, 'last_price_update_time': 1774607910.111856}
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT47109') HTTP/1.1" 204 0
2026-03-27 10:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 776ee6ce-a36f-5af4-b35f-51c5d3d387ff with identifier: LV46830
2026-03-27 10:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 776ee6ce-a36f-5af4-b35f-51c5d3d387ff with identifier: LV46830
2026-03-27 10:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 776ee6ce-a36f-5af4-b35f-51c5d3d387ff with identifier: LV46830 to the API
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_6c61153c7f9e74682ea2607e9dd7a00b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 193,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 340,
'expiration_date': '2026-03-28T16:37:02Z',
'fuel_type': 'petrol',
'id': '776ee6ce-a36f-5af4-b35f-51c5d3d387ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV46830',
'listing': 'auction',
'location': 'DE, Gießen',
'make': 'BMW',
'model': 'Z4',
'odometer': 83825,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2926598,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_435a17dd2b7a8210a8363623b84d0ce3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_5ab0adc0e61cc432c9bc63cfec291b9d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2727250,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_0b8ac1d71f71dd696c08bfa57e1ab558.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2716007,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_d55cc06d00d42173672c57199e9653c8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_ee0b7a55cbe37d387eb0a842d52787c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2865072,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_7ff5b05786bce145174137886eabbdeb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2862842,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_6c61153c7f9e74682ea2607e9dd7a00b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_c13b8ed979ea80532e3ada9f058789b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79809,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_cb15aae6262427e92f61ce9bf76e44cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776ee6ce-a36f-5af4-b35f-51c5d3d387ff/776ee6ce-a36f-5af4-b35f-51c5d3d387ff_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74183,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/93/b2934bd478f22785ffb0cbec36dafa88/pa/LV46830_aa808c5ec1baefb28731da9209ff5b96.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-07',
'seats_number': 2,
'seller_name': None,
'title': 'BMW Z4 M40i',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV46830%27 HTTP/1.1" 200 None
2026-03-27 10:38:30 [auto1.de] INFO: Saving data for LV46830: {'created_time': 1774607910.572714, 'last_price_update_time': 1774607910.572725, 'auction_closing_time': 1774715822.0}
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV46830') HTTP/1.1" 204 0
2026-03-27 10:38:30 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT78140%27 HTTP/1.1" 200 None
2026-03-27 10:38:30 [auto1.de] INFO: Scrape type for ZT78140: 2
2026-03-27 10:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6617bcf8-7d0d-58bc-af17-a622fc461013 with identifier: ZT78140
2026-03-27 10:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6617bcf8-7d0d-58bc-af17-a622fc461013 with scrape type 2
2026-03-27 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6617bcf8-7d0d-58bc-af17-a622fc461013 with scrape type 2
2026-03-27 10:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6617bcf8-7d0d-58bc-af17-a622fc461013, identifier: ZT78140
2026-03-27 10:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6617bcf8-7d0d-58bc-af17-a622fc461013 with identifier: ZT78140
2026-03-27 10:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6617bcf8-7d0d-58bc-af17-a622fc461013 with identifier: ZT78140
2026-03-27 10:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6617bcf8-7d0d-58bc-af17-a622fc461013 with identifier: ZT78140 to the API
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-28T16:26:48Z',
'fuel_type': 'petrol',
'id': '6617bcf8-7d0d-58bc-af17-a622fc461013',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT78140',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 62430,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-26',
'seller_name': None,
'title': 'Renault Megane 1.2 TCe Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2017}
2026-03-27 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT78140%27 HTTP/1.1" 200 None
2026-03-27 10:38:31 [auto1.de] INFO: Saving data for ZT78140: {'auction_closing_time': 1774715208.0, 'created_time': 1774032500.474021, 'last_price_update_time': 1774607911.210185}
2026-03-27 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT78140') HTTP/1.1" 204 0
2026-03-27 10:38:31 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-27 10:38:31 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-27 10:38:31 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-27 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY85938%27 HTTP/1.1" 200 None
2026-03-27 10:38:31 [auto1.de] INFO: Scrape type for SY85938: 2
2026-03-27 10:38:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 142b977a-64dc-5d77-9022-f457bb951ffb with identifier: SY85938
2026-03-27 10:38:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 142b977a-64dc-5d77-9022-f457bb951ffb with scrape type 2
2026-03-27 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 142b977a-64dc-5d77-9022-f457bb951ffb with scrape type 2
2026-03-27 10:38:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 142b977a-64dc-5d77-9022-f457bb951ffb, identifier: SY85938
2026-03-27 10:38:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 142b977a-64dc-5d77-9022-f457bb951ffb with identifier: SY85938
2026-03-27 10:38:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 142b977a-64dc-5d77-9022-f457bb951ffb with identifier: SY85938
2026-03-27 10:38:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 142b977a-64dc-5d77-9022-f457bb951ffb with identifier: SY85938 to the API
2026-03-27 10:38:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-28T16:53:47Z',
'fuel_type': 'petrol',
'id': '142b977a-64dc-5d77-9022-f457bb951ffb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY85938',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 57515,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-08',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-03-27 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY85938%27 HTTP/1.1" 200 None
2026-03-27 10:38:32 [auto1.de] INFO: Saving data for SY85938: {'auction_closing_time': 1774716827.0, 'created_time': 1773427041.458803, 'last_price_update_time': 1774607912.434563}
2026-03-27 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY85938') HTTP/1.1" 204 0
2026-03-27 10:38:32 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-27 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP81367%27 HTTP/1.1" 200 None
2026-03-27 10:38:32 [auto1.de] INFO: Scrape type for WP81367: 2
2026-03-27 10:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0af088b-a073-53fb-9e7e-7eb5823956b9 with identifier: WP81367
2026-03-27 10:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0af088b-a073-53fb-9e7e-7eb5823956b9 with scrape type 2
2026-03-27 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0af088b-a073-53fb-9e7e-7eb5823956b9 with scrape type 2
2026-03-27 10:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0af088b-a073-53fb-9e7e-7eb5823956b9, identifier: WP81367
2026-03-27 10:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0af088b-a073-53fb-9e7e-7eb5823956b9 with identifier: WP81367
2026-03-27 10:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0af088b-a073-53fb-9e7e-7eb5823956b9 with identifier: WP81367
2026-03-27 10:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0af088b-a073-53fb-9e7e-7eb5823956b9 with identifier: WP81367 to the API
2026-03-27 10:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 155,
'expiration_date': '2026-03-28T16:00:58Z',
'fuel_type': 'petrol',
'id': 'a0af088b-a073-53fb-9e7e-7eb5823956b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP81367',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 108086,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-28',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Classic',
'transmission': 'manual',
'trim': 'BlueEfficiency Classic',
'year': 2010}
2026-03-27 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP81367%27 HTTP/1.1" 200 None
2026-03-27 10:38:32 [auto1.de] INFO: Saving data for WP81367: {'auction_closing_time': 1774713658.0, 'created_time': 1773860260.499782, 'last_price_update_time': 1774607912.985197}
2026-03-27 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP81367') HTTP/1.1" 204 0
2026-03-27 10:38:33 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-27 10:38:33 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-27 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU96107%27 HTTP/1.1" 200 None
2026-03-27 10:38:33 [auto1.de] INFO: Scrape type for DU96107: 2
2026-03-27 10:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 431d12da-7f3a-5e79-942f-3b06fcca8ab7 with identifier: DU96107
2026-03-27 10:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 431d12da-7f3a-5e79-942f-3b06fcca8ab7 with scrape type 2
2026-03-27 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 431d12da-7f3a-5e79-942f-3b06fcca8ab7 with scrape type 2
2026-03-27 10:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 431d12da-7f3a-5e79-942f-3b06fcca8ab7, identifier: DU96107
2026-03-27 10:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV87570/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 431d12da-7f3a-5e79-942f-3b06fcca8ab7 with identifier: DU96107
2026-03-27 10:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 431d12da-7f3a-5e79-942f-3b06fcca8ab7 with identifier: DU96107
2026-03-27 10:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 431d12da-7f3a-5e79-942f-3b06fcca8ab7 with identifier: DU96107 to the API
2026-03-27 10:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:09:37Z',
'fuel_type': 'petrol',
'id': '431d12da-7f3a-5e79-942f-3b06fcca8ab7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU96107',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 143658,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-26',
'seller_name': None,
'title': 'Hyundai i30 1.6 GDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2012}
2026-03-27 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU96107%27 HTTP/1.1" 200 None
2026-03-27 10:38:34 [auto1.de] INFO: Saving data for DU96107: {'auction_closing_time': 1774714177.0, 'created_time': 1773811828.120291, 'last_price_update_time': 1774607914.93168}
2026-03-27 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU96107') HTTP/1.1" 204 0
2026-03-27 10:38:34 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-27 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89530%27 HTTP/1.1" 200 None
2026-03-27 10:38:34 [auto1.de] INFO: Scrape type for VS89530: 2
2026-03-27 10:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1 with identifier: VS89530
2026-03-27 10:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1 with scrape type 2
2026-03-27 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1 with scrape type 2
2026-03-27 10:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1, identifier: VS89530
2026-03-27 10:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1 with identifier: VS89530
2026-03-27 10:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1 with identifier: VS89530
2026-03-27 10:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7350c2eb-76a5-5cf0-95b6-65a0c94c46a1 with identifier: VS89530 to the API
2026-03-27 10:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-28T16:28:17Z',
'fuel_type': 'petrol',
'id': '7350c2eb-76a5-5cf0-95b6-65a0c94c46a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS89530',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 150516,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-03',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 Style 2WD',
'transmission': 'manual',
'trim': 'Style 2WD',
'year': 2019}
2026-03-27 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89530%27 HTTP/1.1" 200 None
2026-03-27 10:38:35 [auto1.de] INFO: Saving data for VS89530: {'auction_closing_time': 1774715297.0, 'created_time': 1773513684.443549, 'last_price_update_time': 1774607915.449656}
2026-03-27 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS89530') HTTP/1.1" 204 0
2026-03-27 10:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX47208> (referer: https://www.auto1.com/v1/car-details-view/SX47208/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb70950c-5a36-52fa-8491-cc55d6cac244 with identifier: SX47208
2026-03-27 10:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb70950c-5a36-52fa-8491-cc55d6cac244 with scrape type 1
2026-03-27 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb70950c-5a36-52fa-8491-cc55d6cac244
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_cc8b087a66bf830b7b3b8d2cfa27a686.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_cc8b087a66bf830b7b3b8d2cfa27a686.jpg not downloaded yet
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_92091351e165980817c2e951ca247f3a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_92091351e165980817c2e951ca247f3a.jpg not downloaded yet
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_c7d6afd47d62cd9174ffe9e2a87ebb90.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_c7d6afd47d62cd9174ffe9e2a87ebb90.jpg not downloaded yet
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_7859377ab35b8e7329eeec78454905e9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_7859377ab35b8e7329eeec78454905e9.jpg not downloaded yet
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_0bc7beb340605cef319aa902d498b00b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_0bc7beb340605cef319aa902d498b00b.jpg not downloaded yet
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_4552f42404b55b336ec25d06958ccd3b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_4552f42404b55b336ec25d06958ccd3b.jpg not downloaded yet
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_5b2da6bbd9db3cd619584b7ec478433e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_5b2da6bbd9db3cd619584b7ec478433e.jpg not downloaded yet
2026-03-27 10:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_cc8b087a66bf830b7b3b8d2cfa27a686.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_bca445733ffd53a339032ec96a182cc2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_bca445733ffd53a339032ec96a182cc2.jpg not downloaded yet
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_34cbc2fd0ebda38f8fdd11571125c205.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_34cbc2fd0ebda38f8fdd11571125c205.jpg not downloaded yet
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_e1bae710a8444e6acd751204880d5492.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_e1bae710a8444e6acd751204880d5492.jpg not downloaded yet
2026-03-27 10:38:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be261dd0>
2026-03-27 10:38:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_cc8b087a66bf830b7b3b8d2cfa27a686.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_cc8b087a66bf830b7b3b8d2cfa27a686.jpg saved to cache
2026-03-27 10:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb70950c-5a36-52fa-8491-cc55d6cac244
2026-03-27 10:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_92091351e165980817c2e951ca247f3a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_c7d6afd47d62cd9174ffe9e2a87ebb90.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_7859377ab35b8e7329eeec78454905e9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_0bc7beb340605cef319aa902d498b00b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_34cbc2fd0ebda38f8fdd11571125c205.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf569e90>
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_92091351e165980817c2e951ca247f3a.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_92091351e165980817c2e951ca247f3a.jpg saved to cache
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb70950c-5a36-52fa-8491-cc55d6cac244
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4fbd90>
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_c7d6afd47d62cd9174ffe9e2a87ebb90.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_c7d6afd47d62cd9174ffe9e2a87ebb90.jpg saved to cache
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb70950c-5a36-52fa-8491-cc55d6cac244
2026-03-27 10:38:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be13b050>
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_7859377ab35b8e7329eeec78454905e9.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_7859377ab35b8e7329eeec78454905e9.jpg saved to cache
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb70950c-5a36-52fa-8491-cc55d6cac244
2026-03-27 10:38:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be275290>
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_0bc7beb340605cef319aa902d498b00b.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_0bc7beb340605cef319aa902d498b00b.jpg saved to cache
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb70950c-5a36-52fa-8491-cc55d6cac244
2026-03-27 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_e1bae710a8444e6acd751204880d5492.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf326f90>
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_34cbc2fd0ebda38f8fdd11571125c205.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_34cbc2fd0ebda38f8fdd11571125c205.jpg saved to cache
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb70950c-5a36-52fa-8491-cc55d6cac244
2026-03-27 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_4552f42404b55b336ec25d06958ccd3b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_bca445733ffd53a339032ec96a182cc2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_5b2da6bbd9db3cd619584b7ec478433e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be12dd50>
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_e1bae710a8444e6acd751204880d5492.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_e1bae710a8444e6acd751204880d5492.jpg saved to cache
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb70950c-5a36-52fa-8491-cc55d6cac244
2026-03-27 10:38:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f1dd0>
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_4552f42404b55b336ec25d06958ccd3b.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_4552f42404b55b336ec25d06958ccd3b.jpg saved to cache
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb70950c-5a36-52fa-8491-cc55d6cac244
2026-03-27 10:38:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf326010>
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_bca445733ffd53a339032ec96a182cc2.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_bca445733ffd53a339032ec96a182cc2.jpg saved to cache
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb70950c-5a36-52fa-8491-cc55d6cac244
2026-03-27 10:38:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1072d0>
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fb5%252F1ab5727c6ba5b371ba5836390eef3d84%252Fpa%252FSX47208_5b2da6bbd9db3cd619584b7ec478433e.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_5b2da6bbd9db3cd619584b7ec478433e.jpg saved to cache
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb70950c-5a36-52fa-8491-cc55d6cac244
2026-03-27 10:38:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb70950c-5a36-52fa-8491-cc55d6cac244, skipping ID generation
2026-03-27 10:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb70950c-5a36-52fa-8491-cc55d6cac244 with scrape type 1
2026-03-27 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb70950c-5a36-52fa-8491-cc55d6cac244 sending to next pipeline
2026-03-27 10:38:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb70950c-5a36-52fa-8491-cc55d6cac244, identifier: SX47208
2026-03-27 10:38:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb70950c-5a36-52fa-8491-cc55d6cac244 with identifier: SX47208
2026-03-27 10:38:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb70950c-5a36-52fa-8491-cc55d6cac244 with identifier: SX47208
2026-03-27 10:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb70950c-5a36-52fa-8491-cc55d6cac244 with identifier: SX47208 to the API
2026-03-27 10:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_5b2da6bbd9db3cd619584b7ec478433e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:01:32Z',
'fuel_type': 'diesel',
'id': 'eb70950c-5a36-52fa-8491-cc55d6cac244',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX47208',
'listing': 'auction',
'location': 'DE, Mülheim\xad-Kärlich',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 131787,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76766,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_cc8b087a66bf830b7b3b8d2cfa27a686.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71157,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_92091351e165980817c2e951ca247f3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67900,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_c7d6afd47d62cd9174ffe9e2a87ebb90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2311363,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_7859377ab35b8e7329eeec78454905e9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2664624,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_0bc7beb340605cef319aa902d498b00b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2644328,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_4552f42404b55b336ec25d06958ccd3b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2634697,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_5b2da6bbd9db3cd619584b7ec478433e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2737481,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_bca445733ffd53a339032ec96a182cc2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75616,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_34cbc2fd0ebda38f8fdd11571125c205.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb70950c-5a36-52fa-8491-cc55d6cac244/eb70950c-5a36-52fa-8491-cc55d6cac244_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/b5/1ab5727c6ba5b371ba5836390eef3d84/pa/SX47208_e1bae710a8444e6acd751204880d5492.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-02-16',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.6 dCi Acenta +',
'transmission': 'manual',
'trim': 'Acenta +',
'year': 2014}
2026-03-27 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX47208%27 HTTP/1.1" 200 None
2026-03-27 10:38:38 [auto1.de] INFO: Saving data for SX47208: {'created_time': 1774607918.471404, 'last_price_update_time': 1774607918.471415, 'auction_closing_time': 1774713692.0}
2026-03-27 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX47208') HTTP/1.1" 204 0
2026-03-27 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV87570> (referer: https://www.auto1.com/v1/car-details-view/ZV87570/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b34e2845-5567-540c-9e19-1356d8ef5629 with identifier: ZV87570
2026-03-27 10:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b34e2845-5567-540c-9e19-1356d8ef5629 with scrape type 1
2026-03-27 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-27 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_99a389bc6485232f92c3d70e16c11e77.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_99a389bc6485232f92c3d70e16c11e77.jpg not downloaded yet
2026-03-27 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_97ac59de0a9c0b0df9c38a7168396123.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_97ac59de0a9c0b0df9c38a7168396123.jpg not downloaded yet
2026-03-27 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_c1b18ec43d1c41881f1058048951f96d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_c1b18ec43d1c41881f1058048951f96d.jpg not downloaded yet
2026-03-27 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_13e2026b2a7aa4ccc7f7de9801533f4f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_13e2026b2a7aa4ccc7f7de9801533f4f.jpg not downloaded yet
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_331d35c4d337a1479ec5a499c853402a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_331d35c4d337a1479ec5a499c853402a.jpg not downloaded yet
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_b9c62c6a533f685d1549b05f4ef0a870.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_b9c62c6a533f685d1549b05f4ef0a870.jpg not downloaded yet
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_eef7d84e5964faedc7122d560d5ec81d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_eef7d84e5964faedc7122d560d5ec81d.jpg not downloaded yet
2026-03-27 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_99a389bc6485232f92c3d70e16c11e77.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_382dfde22ce51cf26d7c6ceda153329b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_382dfde22ce51cf26d7c6ceda153329b.jpg not downloaded yet
2026-03-27 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_97ac59de0a9c0b0df9c38a7168396123.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_b0a8c8f6a751afbdd9292c3c88cb1b1f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_b0a8c8f6a751afbdd9292c3c88cb1b1f.jpg not downloaded yet
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_9fa3eee5bcb91f3b31daa8838586c4e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_9fa3eee5bcb91f3b31daa8838586c4e3.jpg not downloaded yet
2026-03-27 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_c1b18ec43d1c41881f1058048951f96d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56d304f290>
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_99a389bc6485232f92c3d70e16c11e77.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_99a389bc6485232f92c3d70e16c11e77.jpg saved to cache
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-27 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_eef7d84e5964faedc7122d560d5ec81d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_b9c62c6a533f685d1549b05f4ef0a870.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_382dfde22ce51cf26d7c6ceda153329b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4f4cd0>
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_97ac59de0a9c0b0df9c38a7168396123.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_97ac59de0a9c0b0df9c38a7168396123.jpg saved to cache
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-27 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_9fa3eee5bcb91f3b31daa8838586c4e3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f7490>
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_c1b18ec43d1c41881f1058048951f96d.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_c1b18ec43d1c41881f1058048951f96d.jpg saved to cache
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-27 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_13e2026b2a7aa4ccc7f7de9801533f4f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5394150>
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_eef7d84e5964faedc7122d560d5ec81d.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_eef7d84e5964faedc7122d560d5ec81d.jpg saved to cache
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b5dd0>
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_b9c62c6a533f685d1549b05f4ef0a870.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_b9c62c6a533f685d1549b05f4ef0a870.jpg saved to cache
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-27 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_331d35c4d337a1479ec5a499c853402a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_b0a8c8f6a751afbdd9292c3c88cb1b1f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b57d0>
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_382dfde22ce51cf26d7c6ceda153329b.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_382dfde22ce51cf26d7c6ceda153329b.jpg saved to cache
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf326350>
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_9fa3eee5bcb91f3b31daa8838586c4e3.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_9fa3eee5bcb91f3b31daa8838586c4e3.jpg saved to cache
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c54c0250>
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_13e2026b2a7aa4ccc7f7de9801533f4f.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_13e2026b2a7aa4ccc7f7de9801533f4f.jpg saved to cache
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be091090>
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_331d35c4d337a1479ec5a499c853402a.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_331d35c4d337a1479ec5a499c853402a.jpg saved to cache
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be074090>
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F5b%252F405bd68e3686710f8dca68af7c5ac7f0%252Fpa%252FZV87570_b0a8c8f6a751afbdd9292c3c88cb1b1f.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_b0a8c8f6a751afbdd9292c3c88cb1b1f.jpg saved to cache
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b34e2845-5567-540c-9e19-1356d8ef5629
2026-03-27 10:38:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b34e2845-5567-540c-9e19-1356d8ef5629, skipping ID generation
2026-03-27 10:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b34e2845-5567-540c-9e19-1356d8ef5629 with scrape type 1
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b34e2845-5567-540c-9e19-1356d8ef5629 sending to next pipeline
2026-03-27 10:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b34e2845-5567-540c-9e19-1356d8ef5629, identifier: ZV87570
2026-03-27 10:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b34e2845-5567-540c-9e19-1356d8ef5629 with identifier: ZV87570
2026-03-27 10:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b34e2845-5567-540c-9e19-1356d8ef5629 with identifier: ZV87570
2026-03-27 10:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b34e2845-5567-540c-9e19-1356d8ef5629 with identifier: ZV87570 to the API
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_b0a8c8f6a751afbdd9292c3c88cb1b1f.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'engine_horse_power': 65,
'expiration_date': '2026-03-28T16:12:05Z',
'fuel_type': 'electro',
'id': 'b34e2845-5567-540c-9e19-1356d8ef5629',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV87570',
'listing': 'auction',
'location': 'DE',
'make': 'Dacia',
'model': 'Spring',
'odometer': 11,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_99a389bc6485232f92c3d70e16c11e77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_97ac59de0a9c0b0df9c38a7168396123.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115813,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_c1b18ec43d1c41881f1058048951f96d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_13e2026b2a7aa4ccc7f7de9801533f4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_331d35c4d337a1479ec5a499c853402a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 127755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_b9c62c6a533f685d1549b05f4ef0a870.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_eef7d84e5964faedc7122d560d5ec81d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121953,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_382dfde22ce51cf26d7c6ceda153329b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85413,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_b0a8c8f6a751afbdd9292c3c88cb1b1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e2845-5567-540c-9e19-1356d8ef5629/b34e2845-5567-540c-9e19-1356d8ef5629_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/5b/405bd68e3686710f8dca68af7c5ac7f0/pa/ZV87570_9fa3eee5bcb91f3b31daa8838586c4e3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2025-12-18',
'seats_number': 4,
'seller_name': None,
'title': 'Dacia Spring electric drive 48 kW Extreme',
'transmission': 'automatic',
'trim': 'Extreme',
'year': 2025}
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV87570%27 HTTP/1.1" 200 None
2026-03-27 10:38:49 [auto1.de] INFO: Saving data for ZV87570: {'created_time': 1774607929.028973, 'last_price_update_time': 1774607929.028985, 'auction_closing_time': 1774714325.0}
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV87570') HTTP/1.1" 204 0
2026-03-27 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NA53807> (referer: https://www.auto1.com/v1/car-details-view/NA53807/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0910a1a-16c2-523b-a9fa-72e8b6d4847a with identifier: NA53807
2026-03-27 10:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0910a1a-16c2-523b-a9fa-72e8b6d4847a with scrape type 1
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0910a1a-16c2-523b-a9fa-72e8b6d4847a
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F7d%252Fdc7d31d8d0f7b3ebb5199b9c59ea4a05%252Fpa%252FNA53807_151717f4b5abf9130b8c75bea92407a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_151717f4b5abf9130b8c75bea92407a5.jpg already downloaded
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F7d%252Fdc7d31d8d0f7b3ebb5199b9c59ea4a05%252Fpa%252FNA53807_6bfc7662acc4966c9de189c5edc60f15.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_6bfc7662acc4966c9de189c5edc60f15.jpg already downloaded
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F7d%252Fdc7d31d8d0f7b3ebb5199b9c59ea4a05%252Fpa%252FNA53807_4d0595064b8c83195f18e2920dc9e4de.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_4d0595064b8c83195f18e2920dc9e4de.jpg already downloaded
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F7d%252Fdc7d31d8d0f7b3ebb5199b9c59ea4a05%252Fpa%252FNA53807_324519fba77c9cbda8ce2aba240bc6de.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_324519fba77c9cbda8ce2aba240bc6de.jpg already downloaded
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F7d%252Fdc7d31d8d0f7b3ebb5199b9c59ea4a05%252Fpa%252FNA53807_4677fcb19fc6c45c262bf7767a6dc693.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_4677fcb19fc6c45c262bf7767a6dc693.jpg already downloaded
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F7d%252Fdc7d31d8d0f7b3ebb5199b9c59ea4a05%252Fpa%252FNA53807_9a37381d621ea53ee10723b354385bc9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_9a37381d621ea53ee10723b354385bc9.jpg already downloaded
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F7d%252Fdc7d31d8d0f7b3ebb5199b9c59ea4a05%252Fpa%252FNA53807_49f46115777357cbda795a5a5463ee1c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_49f46115777357cbda795a5a5463ee1c.jpg already downloaded
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F7d%252Fdc7d31d8d0f7b3ebb5199b9c59ea4a05%252Fpa%252FNA53807_4417b6bc7a37ff3126100b994dc4893d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_4417b6bc7a37ff3126100b994dc4893d.jpg already downloaded
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F7d%252Fdc7d31d8d0f7b3ebb5199b9c59ea4a05%252Fpa%252FNA53807_c26c959b6a45ee11e7d4b7166b832cef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_c26c959b6a45ee11e7d4b7166b832cef.jpg already downloaded
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F7d%252Fdc7d31d8d0f7b3ebb5199b9c59ea4a05%252Fpa%252FNA53807_181df4f1635f7e751ed44221586ea516.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_181df4f1635f7e751ed44221586ea516.jpg already downloaded
2026-03-27 10:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0910a1a-16c2-523b-a9fa-72e8b6d4847a, identifier: NA53807
2026-03-27 10:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0910a1a-16c2-523b-a9fa-72e8b6d4847a with identifier: NA53807
2026-03-27 10:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0910a1a-16c2-523b-a9fa-72e8b6d4847a with identifier: NA53807
2026-03-27 10:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0910a1a-16c2-523b-a9fa-72e8b6d4847a with identifier: NA53807 to the API
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NA53807>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '3.2L',
'engine_horse_power': 270,
'expiration_date': '2026-03-28T16:28:05Z',
'fuel_type': 'petrol',
'id': 'd0910a1a-16c2-523b-a9fa-72e8b6d4847a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA53807',
'listing': 'auction',
'location': 'DE, Ketzin',
'make': 'Audi',
'model': 'Q5',
'odometer': 176178,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_151717f4b5abf9130b8c75bea92407a5.jpg',
'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_6bfc7662acc4966c9de189c5edc60f15.jpg',
'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_4d0595064b8c83195f18e2920dc9e4de.jpg',
'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_324519fba77c9cbda8ce2aba240bc6de.jpg',
'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_4677fcb19fc6c45c262bf7767a6dc693.jpg',
'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_9a37381d621ea53ee10723b354385bc9.jpg',
'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_49f46115777357cbda795a5a5463ee1c.jpg',
'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_4417b6bc7a37ff3126100b994dc4893d.jpg',
'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_c26c959b6a45ee11e7d4b7166b832cef.jpg',
'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_181df4f1635f7e751ed44221586ea516.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0910a1a-16c2-523b-a9fa-72e8b6d4847a/d0910a1a-16c2-523b-a9fa-72e8b6d4847a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_151717f4b5abf9130b8c75bea92407a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0910a1a-16c2-523b-a9fa-72e8b6d4847a/d0910a1a-16c2-523b-a9fa-72e8b6d4847a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2432272,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_6bfc7662acc4966c9de189c5edc60f15.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0910a1a-16c2-523b-a9fa-72e8b6d4847a/d0910a1a-16c2-523b-a9fa-72e8b6d4847a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_4d0595064b8c83195f18e2920dc9e4de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0910a1a-16c2-523b-a9fa-72e8b6d4847a/d0910a1a-16c2-523b-a9fa-72e8b6d4847a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2658642,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_324519fba77c9cbda8ce2aba240bc6de.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0910a1a-16c2-523b-a9fa-72e8b6d4847a/d0910a1a-16c2-523b-a9fa-72e8b6d4847a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_4677fcb19fc6c45c262bf7767a6dc693.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0910a1a-16c2-523b-a9fa-72e8b6d4847a/d0910a1a-16c2-523b-a9fa-72e8b6d4847a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2349989,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_9a37381d621ea53ee10723b354385bc9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0910a1a-16c2-523b-a9fa-72e8b6d4847a/d0910a1a-16c2-523b-a9fa-72e8b6d4847a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_49f46115777357cbda795a5a5463ee1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0910a1a-16c2-523b-a9fa-72e8b6d4847a/d0910a1a-16c2-523b-a9fa-72e8b6d4847a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68217,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_4417b6bc7a37ff3126100b994dc4893d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0910a1a-16c2-523b-a9fa-72e8b6d4847a/d0910a1a-16c2-523b-a9fa-72e8b6d4847a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64856,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_c26c959b6a45ee11e7d4b7166b832cef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0910a1a-16c2-523b-a9fa-72e8b6d4847a/d0910a1a-16c2-523b-a9fa-72e8b6d4847a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2798356,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/7d/dc7d31d8d0f7b3ebb5199b9c59ea4a05/pa/NA53807_181df4f1635f7e751ed44221586ea516.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-10-15',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q5 3.2 V6 FSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2009}
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA53807%27 HTTP/1.1" 200 None
2026-03-27 10:38:50 [auto1.de] INFO: Saving data for NA53807: {'created_time': 1774607930.729029, 'last_price_update_time': 1774607930.729041, 'auction_closing_time': 1774715285.0}
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA53807') HTTP/1.1" 204 0
2026-03-27 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:53 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 10507 | hits on page: 40
2026-03-27 10:38:53 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89530%27 HTTP/1.1" 200 None
2026-03-27 10:38:53 [auto1.de] INFO: Scrape type for VS89530: 0
2026-03-27 10:38:53 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-27 10:38:53 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80862%27 HTTP/1.1" 200 None
2026-03-27 10:38:54 [auto1.de] INFO: Scrape type for EJ80862: 2
2026-03-27 10:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce1b8f8f-310e-5dd9-90ca-39450663815f with identifier: EJ80862
2026-03-27 10:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce1b8f8f-310e-5dd9-90ca-39450663815f with scrape type 2
2026-03-27 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce1b8f8f-310e-5dd9-90ca-39450663815f with scrape type 2
2026-03-27 10:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce1b8f8f-310e-5dd9-90ca-39450663815f, identifier: EJ80862
2026-03-27 10:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce1b8f8f-310e-5dd9-90ca-39450663815f with identifier: EJ80862
2026-03-27 10:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce1b8f8f-310e-5dd9-90ca-39450663815f with identifier: EJ80862
2026-03-27 10:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce1b8f8f-310e-5dd9-90ca-39450663815f with identifier: EJ80862 to the API
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:25:40Z',
'fuel_type': 'diesel',
'id': 'ce1b8f8f-310e-5dd9-90ca-39450663815f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ80862',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 60064,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-18',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic Exclusive',
'transmission': 'automatic',
'trim': '4Matic Exclusive',
'year': 2016}
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80862%27 HTTP/1.1" 200 None
2026-03-27 10:38:54 [auto1.de] INFO: Saving data for EJ80862: {'auction_closing_time': 1774715140.0, 'created_time': 1773306596.062804, 'last_price_update_time': 1774607934.451409}
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ80862') HTTP/1.1" 204 0
2026-03-27 10:38:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:54 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-27 10:38:54 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP65975%27 HTTP/1.1" 200 None
2026-03-27 10:38:54 [auto1.de] INFO: Scrape type for BP65975: 2
2026-03-27 10:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5874bb0-3d59-5c63-aa90-7bfcd5e83901 with identifier: BP65975
2026-03-27 10:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5874bb0-3d59-5c63-aa90-7bfcd5e83901 with scrape type 2
2026-03-27 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5874bb0-3d59-5c63-aa90-7bfcd5e83901 with scrape type 2
2026-03-27 10:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5874bb0-3d59-5c63-aa90-7bfcd5e83901, identifier: BP65975
2026-03-27 10:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5874bb0-3d59-5c63-aa90-7bfcd5e83901 with identifier: BP65975
2026-03-27 10:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5874bb0-3d59-5c63-aa90-7bfcd5e83901 with identifier: BP65975
2026-03-27 10:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5874bb0-3d59-5c63-aa90-7bfcd5e83901 with identifier: BP65975 to the API
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-28T16:15:44Z',
'fuel_type': 'petrol',
'id': 'f5874bb0-3d59-5c63-aa90-7bfcd5e83901',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP65975',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 77072,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-06',
'seller_name': None,
'title': 'Audi Q2 30 TFSI Design',
'transmission': 'manual',
'trim': 'Design',
'year': 2018}
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP65975%27 HTTP/1.1" 200 None
2026-03-27 10:38:55 [auto1.de] INFO: Saving data for BP65975: {'auction_closing_time': 1774714544.0, 'created_time': 1772729716.244316, 'last_price_update_time': 1774607935.07488}
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP65975') HTTP/1.1" 204 0
2026-03-27 10:38:55 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-27 10:38:55 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS06113%27 HTTP/1.1" 200 None
2026-03-27 10:38:55 [auto1.de] INFO: Scrape type for YS06113: 2
2026-03-27 10:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20b4f624-7b43-5d67-96d9-efabbce6d4be with identifier: YS06113
2026-03-27 10:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20b4f624-7b43-5d67-96d9-efabbce6d4be with scrape type 2
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20b4f624-7b43-5d67-96d9-efabbce6d4be with scrape type 2
2026-03-27 10:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20b4f624-7b43-5d67-96d9-efabbce6d4be, identifier: YS06113
2026-03-27 10:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20b4f624-7b43-5d67-96d9-efabbce6d4be with identifier: YS06113
2026-03-27 10:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20b4f624-7b43-5d67-96d9-efabbce6d4be with identifier: YS06113
2026-03-27 10:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20b4f624-7b43-5d67-96d9-efabbce6d4be with identifier: YS06113 to the API
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:58:51Z',
'fuel_type': 'diesel',
'id': '20b4f624-7b43-5d67-96d9-efabbce6d4be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS06113',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 165944,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-11',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 310 L1 Tourneo Titanium',
'transmission': 'manual',
'trim': '310 L1 Tourneo Titanium',
'year': 2016}
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS06113%27 HTTP/1.1" 200 None
2026-03-27 10:38:55 [auto1.de] INFO: Saving data for YS06113: {'auction_closing_time': 1774717131.0, 'created_time': 1773858992.489227, 'last_price_update_time': 1774607935.62758}
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS06113') HTTP/1.1" 204 0
2026-03-27 10:38:55 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-27 10:38:55 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-27 10:38:55 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ30367%27 HTTP/1.1" 200 None
2026-03-27 10:38:55 [auto1.de] INFO: Scrape type for VJ30367: 2
2026-03-27 10:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f2fff70-2fd9-5ab4-9025-64876178bbdc with identifier: VJ30367
2026-03-27 10:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f2fff70-2fd9-5ab4-9025-64876178bbdc with scrape type 2
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f2fff70-2fd9-5ab4-9025-64876178bbdc with scrape type 2
2026-03-27 10:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f2fff70-2fd9-5ab4-9025-64876178bbdc, identifier: VJ30367
2026-03-27 10:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f2fff70-2fd9-5ab4-9025-64876178bbdc with identifier: VJ30367
2026-03-27 10:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f2fff70-2fd9-5ab4-9025-64876178bbdc with identifier: VJ30367
2026-03-27 10:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f2fff70-2fd9-5ab4-9025-64876178bbdc with identifier: VJ30367 to the API
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:38:43Z',
'fuel_type': 'diesel',
'id': '6f2fff70-2fd9-5ab4-9025-64876178bbdc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ30367',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 158168,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-20',
'seller_name': None,
'title': 'Peugeot 308 1.5 Blue-HDi Active Business',
'transmission': 'manual',
'trim': 'Active Business',
'year': 2021}
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ30367%27 HTTP/1.1" 200 None
2026-03-27 10:38:56 [auto1.de] INFO: Saving data for VJ30367: {'auction_closing_time': 1774715923.0, 'created_time': 1774293750.358969, 'last_price_update_time': 1774607936.087631}
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ30367') HTTP/1.1" 204 0
2026-03-27 10:38:56 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-27 10:38:56 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ95706%27 HTTP/1.1" 200 None
2026-03-27 10:38:56 [auto1.de] INFO: Scrape type for JJ95706: 2
2026-03-27 10:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 792a383f-5ada-5cad-aff3-20fca48a9ef3 with identifier: JJ95706
2026-03-27 10:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 792a383f-5ada-5cad-aff3-20fca48a9ef3 with scrape type 2
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 792a383f-5ada-5cad-aff3-20fca48a9ef3 with scrape type 2
2026-03-27 10:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 792a383f-5ada-5cad-aff3-20fca48a9ef3, identifier: JJ95706
2026-03-27 10:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 792a383f-5ada-5cad-aff3-20fca48a9ef3 with identifier: JJ95706
2026-03-27 10:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 792a383f-5ada-5cad-aff3-20fca48a9ef3 with identifier: JJ95706
2026-03-27 10:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 792a383f-5ada-5cad-aff3-20fca48a9ef3 with identifier: JJ95706 to the API
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:47:05Z',
'fuel_type': 'petrol',
'id': '792a383f-5ada-5cad-aff3-20fca48a9ef3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ95706',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 134490,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-28',
'seller_name': None,
'title': 'Seat Leon 1.4 TSI ACT FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2016}
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ95706%27 HTTP/1.1" 200 None
2026-03-27 10:38:56 [auto1.de] INFO: Saving data for JJ95706: {'auction_closing_time': 1774716425.0, 'created_time': 1773306242.316934, 'last_price_update_time': 1774607936.615964}
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ95706') HTTP/1.1" 204 0
2026-03-27 10:38:56 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ05854%27 HTTP/1.1" 200 None
2026-03-27 10:38:56 [auto1.de] INFO: Scrape type for RJ05854: 2
2026-03-27 10:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed86ad48-c4c3-5949-b718-5af2115b333b with identifier: RJ05854
2026-03-27 10:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed86ad48-c4c3-5949-b718-5af2115b333b with scrape type 2
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed86ad48-c4c3-5949-b718-5af2115b333b with scrape type 2
2026-03-27 10:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed86ad48-c4c3-5949-b718-5af2115b333b, identifier: RJ05854
2026-03-27 10:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed86ad48-c4c3-5949-b718-5af2115b333b with identifier: RJ05854
2026-03-27 10:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed86ad48-c4c3-5949-b718-5af2115b333b with identifier: RJ05854
2026-03-27 10:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed86ad48-c4c3-5949-b718-5af2115b333b with identifier: RJ05854 to the API
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:36:46Z',
'fuel_type': 'petrol',
'id': 'ed86ad48-c4c3-5949-b718-5af2115b333b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ05854',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 139140,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-28',
'seller_name': None,
'title': 'Opel Astra 1.0 Turbo Edition Start/Stop',
'transmission': 'manual',
'trim': 'Edition Start/Stop',
'year': 2016}
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ05854%27 HTTP/1.1" 200 None
2026-03-27 10:38:57 [auto1.de] INFO: Saving data for RJ05854: {'auction_closing_time': 1774715806.0, 'created_time': 1773662083.307689, 'last_price_update_time': 1774607937.128548}
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ05854') HTTP/1.1" 204 0
2026-03-27 10:38:57 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97280%27 HTTP/1.1" 200 None
2026-03-27 10:38:57 [auto1.de] INFO: Scrape type for SD97280: 2
2026-03-27 10:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b5963f9-ef84-5b9f-a541-c9a37890e0a9 with identifier: SD97280
2026-03-27 10:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b5963f9-ef84-5b9f-a541-c9a37890e0a9 with scrape type 2
2026-03-27 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b5963f9-ef84-5b9f-a541-c9a37890e0a9 with scrape type 2
2026-03-27 10:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b5963f9-ef84-5b9f-a541-c9a37890e0a9, identifier: SD97280
2026-03-27 10:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b5963f9-ef84-5b9f-a541-c9a37890e0a9 with identifier: SD97280
2026-03-27 10:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b5963f9-ef84-5b9f-a541-c9a37890e0a9 with identifier: SD97280
2026-03-27 10:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b5963f9-ef84-5b9f-a541-c9a37890e0a9 with identifier: SD97280 to the API
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:32:43Z',
'fuel_type': 'diesel',
'id': '7b5963f9-ef84-5b9f-a541-c9a37890e0a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD97280',
'listing': 'auction',
'make': 'Volvo',
'model': 'S60',
'odometer': 185187,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-31',
'seller_name': None,
'title': 'Volvo S60 2.0 D3 Linje Business',
'transmission': 'manual',
'trim': 'Linje Business',
'year': 2015}
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97280%27 HTTP/1.1" 200 None
2026-03-27 10:38:57 [auto1.de] INFO: Saving data for SD97280: {'auction_closing_time': 1774715563.0, 'created_time': 1773134171.075775, 'last_price_update_time': 1774607937.677819}
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD97280') HTTP/1.1" 204 0
2026-03-27 10:38:57 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG31546%27 HTTP/1.1" 200 None
2026-03-27 10:38:57 [auto1.de] INFO: Scrape type for SG31546: 2
2026-03-27 10:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97721150-39b3-508d-bcd7-3425d0af4042 with identifier: SG31546
2026-03-27 10:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97721150-39b3-508d-bcd7-3425d0af4042 with scrape type 2
2026-03-27 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97721150-39b3-508d-bcd7-3425d0af4042 with scrape type 2
2026-03-27 10:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97721150-39b3-508d-bcd7-3425d0af4042, identifier: SG31546
2026-03-27 10:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97721150-39b3-508d-bcd7-3425d0af4042 with identifier: SG31546
2026-03-27 10:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97721150-39b3-508d-bcd7-3425d0af4042 with identifier: SG31546
2026-03-27 10:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97721150-39b3-508d-bcd7-3425d0af4042 with identifier: SG31546 to the API
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 87,
'expiration_date': '2026-03-28T16:04:40Z',
'fuel_type': 'petrol',
'id': '97721150-39b3-508d-bcd7-3425d0af4042',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG31546',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 215543,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-26',
'seller_name': None,
'title': 'Opel Corsa 1.4 Satellite',
'transmission': 'manual',
'trim': 'Satellite',
'year': 2011}
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG31546%27 HTTP/1.1" 200 None
2026-03-27 10:38:58 [auto1.de] INFO: Saving data for SG31546: {'auction_closing_time': 1774713880.0, 'created_time': 1774089225.127555, 'last_price_update_time': 1774607938.32831}
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG31546') HTTP/1.1" 204 0
2026-03-27 10:38:58 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE92439%27 HTTP/1.1" 200 None
2026-03-27 10:38:58 [auto1.de] INFO: Scrape type for HE92439: 2
2026-03-27 10:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bef224bb-6015-537b-9b19-ef4e79c364e7 with identifier: HE92439
2026-03-27 10:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bef224bb-6015-537b-9b19-ef4e79c364e7 with scrape type 2
2026-03-27 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bef224bb-6015-537b-9b19-ef4e79c364e7 with scrape type 2
2026-03-27 10:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bef224bb-6015-537b-9b19-ef4e79c364e7, identifier: HE92439
2026-03-27 10:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bef224bb-6015-537b-9b19-ef4e79c364e7 with identifier: HE92439
2026-03-27 10:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bef224bb-6015-537b-9b19-ef4e79c364e7 with identifier: HE92439
2026-03-27 10:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bef224bb-6015-537b-9b19-ef4e79c364e7 with identifier: HE92439 to the API
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 367,
'expiration_date': '2026-03-28T16:32:16Z',
'fuel_type': 'petrol',
'id': 'bef224bb-6015-537b-9b19-ef4e79c364e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE92439',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 84871,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-22',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 43 AMG T 4Matic',
'transmission': 'automatic',
'trim': 'T 4Matic',
'year': 2017}
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE92439%27 HTTP/1.1" 200 None
2026-03-27 10:38:58 [auto1.de] INFO: Saving data for HE92439: {'auction_closing_time': 1774715536.0, 'created_time': 1774330261.393096, 'last_price_update_time': 1774607938.798956}
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE92439') HTTP/1.1" 204 0
2026-03-27 10:38:58 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-27 10:38:58 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT67181%27 HTTP/1.1" 200 None
2026-03-27 10:38:58 [auto1.de] INFO: Scrape type for YT67181: 2
2026-03-27 10:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9 with identifier: YT67181
2026-03-27 10:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9 with scrape type 2
2026-03-27 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9 with scrape type 2
2026-03-27 10:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9, identifier: YT67181
2026-03-27 10:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9 with identifier: YT67181
2026-03-27 10:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9 with identifier: YT67181
2026-03-27 10:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9 with identifier: YT67181 to the API
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 98,
'expiration_date': '2026-03-28T16:00:47Z',
'fuel_type': 'petrol',
'id': 'fd3a4a06-c56a-52b4-b082-cf7d7e1ccfa9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT67181',
'listing': 'auction',
'make': 'Nissan',
'model': 'Note',
'odometer': 178672,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-24',
'seller_name': None,
'title': 'Nissan Note 1.2 Black Edition',
'transmission': 'automatic',
'trim': 'Black Edition',
'year': 2016}
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT67181%27 HTTP/1.1" 200 None
2026-03-27 10:38:59 [auto1.de] INFO: Saving data for YT67181: {'auction_closing_time': 1774713647.0, 'created_time': 1774293944.070075, 'last_price_update_time': 1774607939.26457}
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT67181') HTTP/1.1" 204 0
2026-03-27 10:38:59 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-27 10:38:59 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-27 10:38:59 [auto1.de] INFO: Found listing with ID: RZ61544
2026-03-27 10:38:59 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-27 10:38:59 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV99753%27 HTTP/1.1" 200 None
2026-03-27 10:38:59 [auto1.de] INFO: Scrape type for RV99753: 2
2026-03-27 10:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe with identifier: RV99753
2026-03-27 10:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe with scrape type 2
2026-03-27 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe with scrape type 2
2026-03-27 10:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe, identifier: RV99753
2026-03-27 10:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe with identifier: RV99753
2026-03-27 10:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe with identifier: RV99753
2026-03-27 10:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe with identifier: RV99753 to the API
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-28T16:48:12Z',
'fuel_type': 'petrol',
'id': 'fb2c7caf-3d6a-5ea2-8594-99bbf1d895fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV99753',
'listing': 'auction',
'make': 'Infiniti',
'model': 'QX70',
'odometer': 164895,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-17',
'seller_name': None,
'title': 'Infiniti QX70 3.7 V6 S Design',
'transmission': 'automatic',
'trim': 'S Design',
'year': 2017}
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV99753%27 HTTP/1.1" 200 None
2026-03-27 10:38:59 [auto1.de] INFO: Saving data for RV99753: {'auction_closing_time': 1774716492.0, 'created_time': 1774294730.078686, 'last_price_update_time': 1774607939.748789}
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV99753') HTTP/1.1" 204 0
2026-03-27 10:38:59 [auto1.de] INFO: Found listing with ID: FP37093
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP37093%27 HTTP/1.1" 200 None
2026-03-27 10:38:59 [auto1.de] INFO: Scrape type for FP37093: 2
2026-03-27 10:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a7a68fd-8b8f-5eff-b0bc-0d89ea7b7194 with identifier: FP37093
2026-03-27 10:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a7a68fd-8b8f-5eff-b0bc-0d89ea7b7194 with scrape type 2
2026-03-27 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a7a68fd-8b8f-5eff-b0bc-0d89ea7b7194 with scrape type 2
2026-03-27 10:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a7a68fd-8b8f-5eff-b0bc-0d89ea7b7194, identifier: FP37093
2026-03-27 10:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a7a68fd-8b8f-5eff-b0bc-0d89ea7b7194 with identifier: FP37093
2026-03-27 10:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a7a68fd-8b8f-5eff-b0bc-0d89ea7b7194 with identifier: FP37093
2026-03-27 10:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a7a68fd-8b8f-5eff-b0bc-0d89ea7b7194 with identifier: FP37093 to the API
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:46:44Z',
'fuel_type': 'petrol',
'id': '9a7a68fd-8b8f-5eff-b0bc-0d89ea7b7194',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP37093',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 113695,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-27',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.2 TSI Cup BlueMotion Tech',
'transmission': 'manual',
'trim': 'Cup BlueMotion Tech',
'year': 2014}
2026-03-27 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP37093%27 HTTP/1.1" 200 None
2026-03-27 10:39:00 [auto1.de] INFO: Saving data for FP37093: {'auction_closing_time': 1774716404.0, 'created_time': 1774292914.669988, 'last_price_update_time': 1774607940.196166}
2026-03-27 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP37093') HTTP/1.1" 204 0
2026-03-27 10:39:00 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-27 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT39177%27 HTTP/1.1" 200 None
2026-03-27 10:39:00 [auto1.de] INFO: Scrape type for HT39177: 2
2026-03-27 10:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89f24e68-8bfa-54b5-ba08-7183d096ae6c with identifier: HT39177
2026-03-27 10:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89f24e68-8bfa-54b5-ba08-7183d096ae6c with scrape type 2
2026-03-27 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89f24e68-8bfa-54b5-ba08-7183d096ae6c with scrape type 2
2026-03-27 10:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89f24e68-8bfa-54b5-ba08-7183d096ae6c, identifier: HT39177
2026-03-27 10:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89f24e68-8bfa-54b5-ba08-7183d096ae6c with identifier: HT39177
2026-03-27 10:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89f24e68-8bfa-54b5-ba08-7183d096ae6c with identifier: HT39177
2026-03-27 10:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89f24e68-8bfa-54b5-ba08-7183d096ae6c with identifier: HT39177 to the API
2026-03-27 10:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:30:47Z',
'fuel_type': 'petrol',
'id': '89f24e68-8bfa-54b5-ba08-7183d096ae6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT39177',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 89412,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-20',
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
'transmission': 'automatic',
'trim': 'Sport 4Motion',
'year': 2017}
2026-03-27 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT39177%27 HTTP/1.1" 200 None
2026-03-27 10:39:00 [auto1.de] INFO: Saving data for HT39177: {'auction_closing_time': 1774715447.0, 'created_time': 1773775723.47669, 'last_price_update_time': 1774607940.649089}
2026-03-27 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT39177') HTTP/1.1" 204 0
2026-03-27 10:39:00 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-27 10:39:00 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-27 10:39:00 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-27 10:39:00 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-27 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT86563%27 HTTP/1.1" 200 None
2026-03-27 10:39:00 [auto1.de] INFO: Scrape type for WT86563: 2
2026-03-27 10:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 609db12b-2ba2-51fd-88b4-fb8ddb490b57 with identifier: WT86563
2026-03-27 10:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 609db12b-2ba2-51fd-88b4-fb8ddb490b57 with scrape type 2
2026-03-27 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 609db12b-2ba2-51fd-88b4-fb8ddb490b57 with scrape type 2
2026-03-27 10:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 609db12b-2ba2-51fd-88b4-fb8ddb490b57, identifier: WT86563
2026-03-27 10:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 609db12b-2ba2-51fd-88b4-fb8ddb490b57 with identifier: WT86563
2026-03-27 10:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 609db12b-2ba2-51fd-88b4-fb8ddb490b57 with identifier: WT86563
2026-03-27 10:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 609db12b-2ba2-51fd-88b4-fb8ddb490b57 with identifier: WT86563 to the API
2026-03-27 10:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 195,
'expiration_date': '2026-03-28T16:42:46Z',
'fuel_type': 'diesel',
'id': '609db12b-2ba2-51fd-88b4-fb8ddb490b57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT86563',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 191953,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-28',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Sport 4x4',
'transmission': 'manual',
'trim': 'Sport 4x4',
'year': 2012}
2026-03-27 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT86563%27 HTTP/1.1" 200 None
2026-03-27 10:39:01 [auto1.de] INFO: Saving data for WT86563: {'auction_closing_time': 1774716166.0, 'created_time': 1774294028.121884, 'last_price_update_time': 1774607941.292652}
2026-03-27 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT86563') HTTP/1.1" 204 0
2026-03-27 10:39:01 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 10507 | hits on page: 40
2026-03-27 10:39:01 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-27 10:39:01 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-27 10:39:01 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-27 10:39:01 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-27 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44518%27 HTTP/1.1" 200 None
2026-03-27 10:39:01 [auto1.de] INFO: Scrape type for YH44518: 2
2026-03-27 10:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7b33f1f-bbf1-5f55-928b-1d4c8b426094 with identifier: YH44518
2026-03-27 10:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7b33f1f-bbf1-5f55-928b-1d4c8b426094 with scrape type 2
2026-03-27 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7b33f1f-bbf1-5f55-928b-1d4c8b426094 with scrape type 2
2026-03-27 10:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7b33f1f-bbf1-5f55-928b-1d4c8b426094, identifier: YH44518
2026-03-27 10:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7b33f1f-bbf1-5f55-928b-1d4c8b426094 with identifier: YH44518
2026-03-27 10:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7b33f1f-bbf1-5f55-928b-1d4c8b426094 with identifier: YH44518
2026-03-27 10:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7b33f1f-bbf1-5f55-928b-1d4c8b426094 with identifier: YH44518 to the API
2026-03-27 10:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:22:54Z',
'fuel_type': 'petrol',
'id': 'd7b33f1f-bbf1-5f55-928b-1d4c8b426094',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH44518',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 11414,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-02-09',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2025}
2026-03-27 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44518%27 HTTP/1.1" 200 None
2026-03-27 10:39:01 [auto1.de] INFO: Saving data for YH44518: {'auction_closing_time': 1774714974.0, 'created_time': 1773858701.891021, 'last_price_update_time': 1774607941.747389}
2026-03-27 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH44518') HTTP/1.1" 204 0
2026-03-27 10:39:01 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-27 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM34350%27 HTTP/1.1" 200 None
2026-03-27 10:39:01 [auto1.de] INFO: Scrape type for NM34350: 2
2026-03-27 10:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 469b614c-03f3-5918-9632-ebdc8c3a0485 with identifier: NM34350
2026-03-27 10:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 469b614c-03f3-5918-9632-ebdc8c3a0485 with scrape type 2
2026-03-27 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 469b614c-03f3-5918-9632-ebdc8c3a0485 with scrape type 2
2026-03-27 10:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 469b614c-03f3-5918-9632-ebdc8c3a0485, identifier: NM34350
2026-03-27 10:39:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:01 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-27 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF11415%27 HTTP/1.1" 200 None
2026-03-27 10:39:01 [auto1.de] INFO: Scrape type for TF11415: 2
2026-03-27 10:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e13dba2c-13a0-548b-921d-6f253b3f702b with identifier: TF11415
2026-03-27 10:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e13dba2c-13a0-548b-921d-6f253b3f702b with scrape type 2
2026-03-27 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e13dba2c-13a0-548b-921d-6f253b3f702b with scrape type 2
2026-03-27 10:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e13dba2c-13a0-548b-921d-6f253b3f702b, identifier: TF11415
2026-03-27 10:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 469b614c-03f3-5918-9632-ebdc8c3a0485 with identifier: NM34350
2026-03-27 10:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 469b614c-03f3-5918-9632-ebdc8c3a0485 with identifier: NM34350
2026-03-27 10:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 469b614c-03f3-5918-9632-ebdc8c3a0485 with identifier: NM34350 to the API
2026-03-27 10:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:06:24Z',
'fuel_type': 'diesel',
'id': '469b614c-03f3-5918-9632-ebdc8c3a0485',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM34350',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Viano',
'odometer': 121559,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-13',
'seller_name': None,
'title': 'Mercedes-Benz Viano 2.1 CDI kompakt Trend Edition',
'transmission': 'automatic',
'trim': 'kompakt Trend Edition',
'year': 2012}
2026-03-27 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM34350%27 HTTP/1.1" 200 None
2026-03-27 10:39:02 [auto1.de] INFO: Saving data for NM34350: {'auction_closing_time': 1774713984.0, 'created_time': 1773399879.682511, 'last_price_update_time': 1774607942.917541}
2026-03-27 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM34350') HTTP/1.1" 204 0
2026-03-27 10:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e13dba2c-13a0-548b-921d-6f253b3f702b with identifier: TF11415
2026-03-27 10:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e13dba2c-13a0-548b-921d-6f253b3f702b with identifier: TF11415
2026-03-27 10:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e13dba2c-13a0-548b-921d-6f253b3f702b with identifier: TF11415 to the API
2026-03-27 10:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:18:04Z',
'fuel_type': 'diesel',
'id': 'e13dba2c-13a0-548b-921d-6f253b3f702b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF11415',
'listing': 'auction',
'make': 'Nissan',
'model': 'Note',
'odometer': 64319,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-26',
'seller_name': None,
'title': 'Nissan Note 1.5 dCi I-Way',
'transmission': 'manual',
'trim': 'I-Way',
'year': 2013}
2026-03-27 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF11415%27 HTTP/1.1" 200 None
2026-03-27 10:39:03 [auto1.de] INFO: Saving data for TF11415: {'auction_closing_time': 1774714684.0, 'created_time': 1773858984.851893, 'last_price_update_time': 1774607943.266034}
2026-03-27 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF11415') HTTP/1.1" 204 0
2026-03-27 10:39:03 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-27 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ89308%27 HTTP/1.1" 200 None
2026-03-27 10:39:03 [auto1.de] INFO: Scrape type for FZ89308: 2
2026-03-27 10:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a58b375-3a87-59f9-ae00-7f403ab98cf2 with identifier: FZ89308
2026-03-27 10:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a58b375-3a87-59f9-ae00-7f403ab98cf2 with scrape type 2
2026-03-27 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a58b375-3a87-59f9-ae00-7f403ab98cf2 with scrape type 2
2026-03-27 10:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a58b375-3a87-59f9-ae00-7f403ab98cf2, identifier: FZ89308
2026-03-27 10:39:03 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-27 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS26933%27 HTTP/1.1" 200 None
2026-03-27 10:39:03 [auto1.de] INFO: Scrape type for PS26933: 2
2026-03-27 10:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af54d5ef-77e0-5dd9-832a-db5628a4e2ee with identifier: PS26933
2026-03-27 10:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af54d5ef-77e0-5dd9-832a-db5628a4e2ee with scrape type 2
2026-03-27 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af54d5ef-77e0-5dd9-832a-db5628a4e2ee with scrape type 2
2026-03-27 10:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af54d5ef-77e0-5dd9-832a-db5628a4e2ee, identifier: PS26933
2026-03-27 10:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a58b375-3a87-59f9-ae00-7f403ab98cf2 with identifier: FZ89308
2026-03-27 10:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a58b375-3a87-59f9-ae00-7f403ab98cf2 with identifier: FZ89308
2026-03-27 10:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a58b375-3a87-59f9-ae00-7f403ab98cf2 with identifier: FZ89308 to the API
2026-03-27 10:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 380,
'expiration_date': '2026-03-28T16:10:33Z',
'fuel_type': 'petrol',
'id': '1a58b375-3a87-59f9-ae00-7f403ab98cf2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ89308',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 90524,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-24',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 45 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2015}
2026-03-27 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ89308%27 HTTP/1.1" 200 None
2026-03-27 10:39:03 [auto1.de] INFO: Saving data for FZ89308: {'auction_closing_time': 1774714233.0, 'created_time': 1773402633.913659, 'last_price_update_time': 1774607943.922599}
2026-03-27 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ89308') HTTP/1.1" 204 0
2026-03-27 10:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af54d5ef-77e0-5dd9-832a-db5628a4e2ee with identifier: PS26933
2026-03-27 10:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af54d5ef-77e0-5dd9-832a-db5628a4e2ee with identifier: PS26933
2026-03-27 10:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af54d5ef-77e0-5dd9-832a-db5628a4e2ee with identifier: PS26933 to the API
2026-03-27 10:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-28T16:15:27Z',
'fuel_type': 'diesel',
'id': 'af54d5ef-77e0-5dd9-832a-db5628a4e2ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS26933',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 227541,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-05',
'seller_name': None,
'title': 'BMW X1 xDrive 18d',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-27 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS26933%27 HTTP/1.1" 200 None
2026-03-27 10:39:04 [auto1.de] INFO: Saving data for PS26933: {'auction_closing_time': 1774714527.0, 'created_time': 1773399285.810597, 'last_price_update_time': 1774607944.391435}
2026-03-27 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS26933') HTTP/1.1" 204 0
2026-03-27 10:39:04 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-27 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE41516%27 HTTP/1.1" 200 None
2026-03-27 10:39:04 [auto1.de] INFO: Scrape type for CE41516: 2
2026-03-27 10:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8368a6a4-80d7-56a6-8792-967a3273d302 with identifier: CE41516
2026-03-27 10:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8368a6a4-80d7-56a6-8792-967a3273d302 with scrape type 2
2026-03-27 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8368a6a4-80d7-56a6-8792-967a3273d302 with scrape type 2
2026-03-27 10:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8368a6a4-80d7-56a6-8792-967a3273d302, identifier: CE41516
2026-03-27 10:39:04 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-27 10:39:04 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-27 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER78775%27 HTTP/1.1" 200 None
2026-03-27 10:39:04 [auto1.de] INFO: Scrape type for ER78775: 2
2026-03-27 10:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 831a3654-c90d-5d42-87ba-34576e961bd9 with identifier: ER78775
2026-03-27 10:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 831a3654-c90d-5d42-87ba-34576e961bd9 with scrape type 2
2026-03-27 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 831a3654-c90d-5d42-87ba-34576e961bd9 with scrape type 2
2026-03-27 10:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 831a3654-c90d-5d42-87ba-34576e961bd9, identifier: ER78775
2026-03-27 10:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8368a6a4-80d7-56a6-8792-967a3273d302 with identifier: CE41516
2026-03-27 10:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8368a6a4-80d7-56a6-8792-967a3273d302 with identifier: CE41516
2026-03-27 10:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8368a6a4-80d7-56a6-8792-967a3273d302 with identifier: CE41516 to the API
2026-03-27 10:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:30:51Z',
'fuel_type': 'diesel',
'id': '8368a6a4-80d7-56a6-8792-967a3273d302',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE41516',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 200728,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-02',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Cup BlueMotion Tech',
'transmission': 'manual',
'trim': 'Cup BlueMotion Tech',
'year': 2014}
2026-03-27 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE41516%27 HTTP/1.1" 200 None
2026-03-27 10:39:04 [auto1.de] INFO: Saving data for CE41516: {'auction_closing_time': 1774715451.0, 'created_time': 1773305258.71597, 'last_price_update_time': 1774607944.994401}
2026-03-27 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE41516') HTTP/1.1" 204 0
2026-03-27 10:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 831a3654-c90d-5d42-87ba-34576e961bd9 with identifier: ER78775
2026-03-27 10:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 831a3654-c90d-5d42-87ba-34576e961bd9 with identifier: ER78775
2026-03-27 10:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 831a3654-c90d-5d42-87ba-34576e961bd9 with identifier: ER78775 to the API
2026-03-27 10:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:46:32Z',
'fuel_type': 'diesel',
'id': '831a3654-c90d-5d42-87ba-34576e961bd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER78775',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 200541,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-24',
'seller_name': None,
'title': 'Skoda Fabia 1.6 TDI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2012}
2026-03-27 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER78775%27 HTTP/1.1" 200 None
2026-03-27 10:39:05 [auto1.de] INFO: Saving data for ER78775: {'auction_closing_time': 1774716392.0, 'created_time': 1773303078.609264, 'last_price_update_time': 1774607945.371001}
2026-03-27 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER78775') HTTP/1.1" 204 0
2026-03-27 10:39:05 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-27 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT79830%27 HTTP/1.1" 200 None
2026-03-27 10:39:05 [auto1.de] INFO: Scrape type for TT79830: 2
2026-03-27 10:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e04542-d2c8-52f1-a0e2-68ba5702e980 with identifier: TT79830
2026-03-27 10:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e04542-d2c8-52f1-a0e2-68ba5702e980 with scrape type 2
2026-03-27 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2e04542-d2c8-52f1-a0e2-68ba5702e980 with scrape type 2
2026-03-27 10:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2e04542-d2c8-52f1-a0e2-68ba5702e980, identifier: TT79830
2026-03-27 10:39:05 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-27 10:39:05 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-27 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ59930%27 HTTP/1.1" 200 None
2026-03-27 10:39:05 [auto1.de] INFO: Scrape type for ZZ59930: 2
2026-03-27 10:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1519479c-f49e-5f48-a2b2-a37769cd0ed4 with identifier: ZZ59930
2026-03-27 10:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1519479c-f49e-5f48-a2b2-a37769cd0ed4 with scrape type 2
2026-03-27 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1519479c-f49e-5f48-a2b2-a37769cd0ed4 with scrape type 2
2026-03-27 10:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1519479c-f49e-5f48-a2b2-a37769cd0ed4, identifier: ZZ59930
2026-03-27 10:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2e04542-d2c8-52f1-a0e2-68ba5702e980 with identifier: TT79830
2026-03-27 10:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2e04542-d2c8-52f1-a0e2-68ba5702e980 with identifier: TT79830
2026-03-27 10:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2e04542-d2c8-52f1-a0e2-68ba5702e980 with identifier: TT79830 to the API
2026-03-27 10:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:36:53Z',
'fuel_type': 'petrol',
'id': 'e2e04542-d2c8-52f1-a0e2-68ba5702e980',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT79830',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 98225,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-22',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 160 Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2010}
2026-03-27 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT79830%27 HTTP/1.1" 200 None
2026-03-27 10:39:05 [auto1.de] INFO: Saving data for TT79830: {'auction_closing_time': 1774715813.0, 'created_time': 1773467974.405456, 'last_price_update_time': 1774607945.977224}
2026-03-27 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT79830') HTTP/1.1" 204 0
2026-03-27 10:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1519479c-f49e-5f48-a2b2-a37769cd0ed4 with identifier: ZZ59930
2026-03-27 10:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1519479c-f49e-5f48-a2b2-a37769cd0ed4 with identifier: ZZ59930
2026-03-27 10:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1519479c-f49e-5f48-a2b2-a37769cd0ed4 with identifier: ZZ59930 to the API
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:43:20Z',
'fuel_type': 'petrol',
'id': '1519479c-f49e-5f48-a2b2-a37769cd0ed4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ59930',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kamiq',
'odometer': 150118,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-10',
'seller_name': None,
'title': 'Skoda Kamiq 1.5 TSI ACT Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2020}
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ59930%27 HTTP/1.1" 200 None
2026-03-27 10:39:06 [auto1.de] INFO: Saving data for ZZ59930: {'auction_closing_time': 1774716200.0, 'created_time': 1773859271.207919, 'last_price_update_time': 1774607946.308105}
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ59930') HTTP/1.1" 204 0
2026-03-27 10:39:06 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-27 10:39:06 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM12066%27 HTTP/1.1" 200 None
2026-03-27 10:39:06 [auto1.de] INFO: Scrape type for GM12066: 0
2026-03-27 10:39:06 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC74122%27 HTTP/1.1" 200 None
2026-03-27 10:39:06 [auto1.de] INFO: Scrape type for EC74122: 2
2026-03-27 10:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f7f938c-6705-56f6-8369-1a2c88126fb1 with identifier: EC74122
2026-03-27 10:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f7f938c-6705-56f6-8369-1a2c88126fb1 with scrape type 2
2026-03-27 10:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f7f938c-6705-56f6-8369-1a2c88126fb1 with scrape type 2
2026-03-27 10:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f7f938c-6705-56f6-8369-1a2c88126fb1, identifier: EC74122
2026-03-27 10:39:06 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-27 10:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f7f938c-6705-56f6-8369-1a2c88126fb1 with identifier: EC74122
2026-03-27 10:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f7f938c-6705-56f6-8369-1a2c88126fb1 with identifier: EC74122
2026-03-27 10:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f7f938c-6705-56f6-8369-1a2c88126fb1 with identifier: EC74122 to the API
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:12:07Z',
'fuel_type': 'diesel',
'id': '4f7f938c-6705-56f6-8369-1a2c88126fb1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC74122',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 200627,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-23',
'seller_name': None,
'title': 'BMW 1er 120d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC74122%27 HTTP/1.1" 200 None
2026-03-27 10:39:06 [auto1.de] INFO: Saving data for EC74122: {'auction_closing_time': 1774714327.0, 'created_time': 1773775452.361819, 'last_price_update_time': 1774607946.781473}
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC74122') HTTP/1.1" 204 0
2026-03-27 10:39:06 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH09734%27 HTTP/1.1" 200 None
2026-03-27 10:39:06 [auto1.de] INFO: Scrape type for LH09734: 2
2026-03-27 10:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4c443d6-9323-5407-b7d9-0540c9b1d9f4 with identifier: LH09734
2026-03-27 10:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4c443d6-9323-5407-b7d9-0540c9b1d9f4 with scrape type 2
2026-03-27 10:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4c443d6-9323-5407-b7d9-0540c9b1d9f4 with scrape type 2
2026-03-27 10:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4c443d6-9323-5407-b7d9-0540c9b1d9f4, identifier: LH09734
2026-03-27 10:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4c443d6-9323-5407-b7d9-0540c9b1d9f4 with identifier: LH09734
2026-03-27 10:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4c443d6-9323-5407-b7d9-0540c9b1d9f4 with identifier: LH09734
2026-03-27 10:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4c443d6-9323-5407-b7d9-0540c9b1d9f4 with identifier: LH09734 to the API
2026-03-27 10:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:33:17Z',
'fuel_type': 'diesel',
'id': 'd4c443d6-9323-5407-b7d9-0540c9b1d9f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH09734',
'listing': 'auction',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 31533,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-24',
'seller_name': None,
'title': 'Seat Tarraco 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2023}
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH09734%27 HTTP/1.1" 200 None
2026-03-27 10:39:07 [auto1.de] INFO: Saving data for LH09734: {'auction_closing_time': 1774715597.0, 'created_time': 1773427264.380778, 'last_price_update_time': 1774607947.232857}
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH09734') HTTP/1.1" 204 0
2026-03-27 10:39:07 [scrapy.extensions.logstats] INFO: Crawled 310 pages (at 8 pages/min), scraped 389 items (at 76 items/min)
2026-03-27 10:39:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-27 10:39:07 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-27 10:39:07 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-27 10:39:07 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-27 10:39:07 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-27 10:39:07 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-27 10:39:07 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU64075%27 HTTP/1.1" 200 None
2026-03-27 10:39:07 [auto1.de] INFO: Scrape type for XU64075: 2
2026-03-27 10:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b601aab1-2b2d-58d2-aff6-7f7f8b39a580 with identifier: XU64075
2026-03-27 10:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b601aab1-2b2d-58d2-aff6-7f7f8b39a580 with scrape type 2
2026-03-27 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b601aab1-2b2d-58d2-aff6-7f7f8b39a580 with scrape type 2
2026-03-27 10:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b601aab1-2b2d-58d2-aff6-7f7f8b39a580, identifier: XU64075
2026-03-27 10:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b601aab1-2b2d-58d2-aff6-7f7f8b39a580 with identifier: XU64075
2026-03-27 10:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b601aab1-2b2d-58d2-aff6-7f7f8b39a580 with identifier: XU64075
2026-03-27 10:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b601aab1-2b2d-58d2-aff6-7f7f8b39a580 with identifier: XU64075 to the API
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:35:26Z',
'fuel_type': 'diesel',
'id': 'b601aab1-2b2d-58d2-aff6-7f7f8b39a580',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU64075',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 328288,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-30',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.0 TDI Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2013}
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU64075%27 HTTP/1.1" 200 None
2026-03-27 10:39:07 [auto1.de] INFO: Saving data for XU64075: {'auction_closing_time': 1774715726.0, 'created_time': 1773304017.773538, 'last_price_update_time': 1774607947.801233}
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU64075') HTTP/1.1" 204 0
2026-03-27 10:39:07 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU33695%27 HTTP/1.1" 200 None
2026-03-27 10:39:07 [auto1.de] INFO: Scrape type for MU33695: 2
2026-03-27 10:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d33d2238-88ae-5a7a-85d8-0d819d5ede91 with identifier: MU33695
2026-03-27 10:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d33d2238-88ae-5a7a-85d8-0d819d5ede91 with scrape type 2
2026-03-27 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d33d2238-88ae-5a7a-85d8-0d819d5ede91 with scrape type 2
2026-03-27 10:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d33d2238-88ae-5a7a-85d8-0d819d5ede91, identifier: MU33695
2026-03-27 10:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d33d2238-88ae-5a7a-85d8-0d819d5ede91 with identifier: MU33695
2026-03-27 10:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d33d2238-88ae-5a7a-85d8-0d819d5ede91 with identifier: MU33695
2026-03-27 10:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d33d2238-88ae-5a7a-85d8-0d819d5ede91 with identifier: MU33695 to the API
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:46:20Z',
'fuel_type': 'petrol',
'id': 'd33d2238-88ae-5a7a-85d8-0d819d5ede91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU33695',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 214685,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-10',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2018}
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU33695%27 HTTP/1.1" 200 None
2026-03-27 10:39:08 [auto1.de] INFO: Saving data for MU33695: {'auction_closing_time': 1774716380.0, 'created_time': 1773774702.208202, 'last_price_update_time': 1774607948.260945}
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU33695') HTTP/1.1" 204 0
2026-03-27 10:39:08 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU00556%27 HTTP/1.1" 200 None
2026-03-27 10:39:08 [auto1.de] INFO: Scrape type for LU00556: 2
2026-03-27 10:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c72a94ab-7559-5825-80dc-ac144a55c6fb with identifier: LU00556
2026-03-27 10:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c72a94ab-7559-5825-80dc-ac144a55c6fb with scrape type 2
2026-03-27 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c72a94ab-7559-5825-80dc-ac144a55c6fb with scrape type 2
2026-03-27 10:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c72a94ab-7559-5825-80dc-ac144a55c6fb, identifier: LU00556
2026-03-27 10:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c72a94ab-7559-5825-80dc-ac144a55c6fb with identifier: LU00556
2026-03-27 10:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c72a94ab-7559-5825-80dc-ac144a55c6fb with identifier: LU00556
2026-03-27 10:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c72a94ab-7559-5825-80dc-ac144a55c6fb with identifier: LU00556 to the API
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:52:43Z',
'fuel_type': 'diesel',
'id': 'c72a94ab-7559-5825-80dc-ac144a55c6fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU00556',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Rifter',
'odometer': 144636,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-28',
'seller_name': None,
'title': 'Peugeot Rifter 1.5 Blue-HDi Active L1',
'transmission': 'manual',
'trim': 'Active L1',
'year': 2020}
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU00556%27 HTTP/1.1" 200 None
2026-03-27 10:39:08 [auto1.de] INFO: Saving data for LU00556: {'auction_closing_time': 1774716763.0, 'created_time': 1773402613.122351, 'last_price_update_time': 1774607948.721306}
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU00556') HTTP/1.1" 204 0
2026-03-27 10:39:08 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-27 10:39:08 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU75285%27 HTTP/1.1" 200 None
2026-03-27 10:39:08 [auto1.de] INFO: Scrape type for LU75285: 2
2026-03-27 10:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2ab30ba-586e-50e6-a31c-16bf841dba46 with identifier: LU75285
2026-03-27 10:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2ab30ba-586e-50e6-a31c-16bf841dba46 with scrape type 2
2026-03-27 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2ab30ba-586e-50e6-a31c-16bf841dba46 with scrape type 2
2026-03-27 10:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2ab30ba-586e-50e6-a31c-16bf841dba46, identifier: LU75285
2026-03-27 10:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2ab30ba-586e-50e6-a31c-16bf841dba46 with identifier: LU75285
2026-03-27 10:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2ab30ba-586e-50e6-a31c-16bf841dba46 with identifier: LU75285
2026-03-27 10:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2ab30ba-586e-50e6-a31c-16bf841dba46 with identifier: LU75285 to the API
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:00:26Z',
'fuel_type': 'petrol',
'id': 'f2ab30ba-586e-50e6-a31c-16bf841dba46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU75285',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Space Star',
'odometer': 84656,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-27',
'seller_name': None,
'title': 'Mitsubishi Space Star 1.0 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2017}
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU75285%27 HTTP/1.1" 200 None
2026-03-27 10:39:09 [auto1.de] INFO: Saving data for LU75285: {'auction_closing_time': 1774713626.0, 'created_time': 1773513939.245053, 'last_price_update_time': 1774607949.165675}
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU75285') HTTP/1.1" 204 0
2026-03-27 10:39:09 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH51780%27 HTTP/1.1" 200 None
2026-03-27 10:39:09 [auto1.de] INFO: Scrape type for LH51780: 2
2026-03-27 10:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32a8b10d-fbc0-59e5-8207-1759ab8fc68f with identifier: LH51780
2026-03-27 10:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32a8b10d-fbc0-59e5-8207-1759ab8fc68f with scrape type 2
2026-03-27 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32a8b10d-fbc0-59e5-8207-1759ab8fc68f with scrape type 2
2026-03-27 10:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32a8b10d-fbc0-59e5-8207-1759ab8fc68f, identifier: LH51780
2026-03-27 10:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32a8b10d-fbc0-59e5-8207-1759ab8fc68f with identifier: LH51780
2026-03-27 10:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32a8b10d-fbc0-59e5-8207-1759ab8fc68f with identifier: LH51780
2026-03-27 10:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32a8b10d-fbc0-59e5-8207-1759ab8fc68f with identifier: LH51780 to the API
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-28T16:12:32Z',
'fuel_type': 'petrol',
'id': '32a8b10d-fbc0-59e5-8207-1759ab8fc68f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH51780',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 27165,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-26',
'seller_name': None,
'title': 'Audi A6 45 TFSI Mild-Hybrid quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH51780%27 HTTP/1.1" 200 None
2026-03-27 10:39:10 [auto1.de] INFO: Saving data for LH51780: {'auction_closing_time': 1774714352.0, 'created_time': 1773773688.207965, 'last_price_update_time': 1774607950.048075}
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH51780') HTTP/1.1" 204 0
2026-03-27 10:39:10 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-27 10:39:10 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG52113%27 HTTP/1.1" 200 None
2026-03-27 10:39:10 [auto1.de] INFO: Scrape type for VG52113: 2
2026-03-27 10:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a063b2c-7622-504b-8065-89a3b3ca6eea with identifier: VG52113
2026-03-27 10:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a063b2c-7622-504b-8065-89a3b3ca6eea with scrape type 2
2026-03-27 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a063b2c-7622-504b-8065-89a3b3ca6eea with scrape type 2
2026-03-27 10:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a063b2c-7622-504b-8065-89a3b3ca6eea, identifier: VG52113
2026-03-27 10:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a063b2c-7622-504b-8065-89a3b3ca6eea with identifier: VG52113
2026-03-27 10:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a063b2c-7622-504b-8065-89a3b3ca6eea with identifier: VG52113
2026-03-27 10:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a063b2c-7622-504b-8065-89a3b3ca6eea with identifier: VG52113 to the API
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:32:26Z',
'fuel_type': 'diesel',
'id': '9a063b2c-7622-504b-8065-89a3b3ca6eea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG52113',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 230400,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-22',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line AWD',
'transmission': 'automatic',
'trim': 'Exclusive-Line AWD',
'year': 2015}
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG52113%27 HTTP/1.1" 200 None
2026-03-27 10:39:10 [auto1.de] INFO: Saving data for VG52113: {'auction_closing_time': 1774715546.0, 'created_time': 1773307526.762141, 'last_price_update_time': 1774607950.595635}
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG52113') HTTP/1.1" 204 0
2026-03-27 10:39:10 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-27 10:39:10 [auto1.de] INFO: Found listing with ID: CH61883
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH61883%27 HTTP/1.1" 200 None
2026-03-27 10:39:10 [auto1.de] INFO: Scrape type for CH61883: 2
2026-03-27 10:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6827502-9748-5ffa-82d2-b1efd8b2a7bb with identifier: CH61883
2026-03-27 10:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6827502-9748-5ffa-82d2-b1efd8b2a7bb with scrape type 2
2026-03-27 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6827502-9748-5ffa-82d2-b1efd8b2a7bb with scrape type 2
2026-03-27 10:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6827502-9748-5ffa-82d2-b1efd8b2a7bb, identifier: CH61883
2026-03-27 10:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6827502-9748-5ffa-82d2-b1efd8b2a7bb with identifier: CH61883
2026-03-27 10:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6827502-9748-5ffa-82d2-b1efd8b2a7bb with identifier: CH61883
2026-03-27 10:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6827502-9748-5ffa-82d2-b1efd8b2a7bb with identifier: CH61883 to the API
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:10:28Z',
'fuel_type': 'diesel',
'id': 'f6827502-9748-5ffa-82d2-b1efd8b2a7bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH61883',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 54299,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-28',
'seller_name': None,
'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2016}
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH61883%27 HTTP/1.1" 200 None
2026-03-27 10:39:11 [auto1.de] INFO: Saving data for CH61883: {'auction_closing_time': 1774714228.0, 'created_time': 1773223359.013735, 'last_price_update_time': 1774607951.123346}
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH61883') HTTP/1.1" 204 0
2026-03-27 10:39:11 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 10507 | hits on page: 40
2026-03-27 10:39:11 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ71122%27 HTTP/1.1" 200 None
2026-03-27 10:39:11 [auto1.de] INFO: Scrape type for AJ71122: 2
2026-03-27 10:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68e623ff-fe03-5500-8a70-06d78fa7c337 with identifier: AJ71122
2026-03-27 10:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68e623ff-fe03-5500-8a70-06d78fa7c337 with scrape type 2
2026-03-27 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68e623ff-fe03-5500-8a70-06d78fa7c337 with scrape type 2
2026-03-27 10:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68e623ff-fe03-5500-8a70-06d78fa7c337, identifier: AJ71122
2026-03-27 10:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68e623ff-fe03-5500-8a70-06d78fa7c337 with identifier: AJ71122
2026-03-27 10:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68e623ff-fe03-5500-8a70-06d78fa7c337 with identifier: AJ71122
2026-03-27 10:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68e623ff-fe03-5500-8a70-06d78fa7c337 with identifier: AJ71122 to the API
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 262,
'expiration_date': '2026-03-28T16:15:12Z',
'fuel_type': 'diesel',
'id': '68e623ff-fe03-5500-8a70-06d78fa7c337',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ71122',
'listing': 'auction',
'make': 'Porsche',
'model': 'Cayenne',
'odometer': 141585,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-11',
'seller_name': None,
'title': 'Porsche Cayenne Diesel Platinum Edition',
'transmission': 'automatic',
'trim': 'Platinum Edition',
'year': 2017}
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ71122%27 HTTP/1.1" 200 None
2026-03-27 10:39:11 [auto1.de] INFO: Saving data for AJ71122: {'auction_closing_time': 1774714512.0, 'created_time': 1774290715.357785, 'last_price_update_time': 1774607951.602385}
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ71122') HTTP/1.1" 204 0
2026-03-27 10:39:11 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-27 10:39:11 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX79678%27 HTTP/1.1" 200 None
2026-03-27 10:39:11 [auto1.de] INFO: Scrape type for KX79678: 2
2026-03-27 10:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4207b5d9-b583-5de5-a664-8aa73e57ada5 with identifier: KX79678
2026-03-27 10:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4207b5d9-b583-5de5-a664-8aa73e57ada5 with scrape type 2
2026-03-27 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4207b5d9-b583-5de5-a664-8aa73e57ada5 with scrape type 2
2026-03-27 10:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4207b5d9-b583-5de5-a664-8aa73e57ada5, identifier: KX79678
2026-03-27 10:39:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:11 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-27 10:39:11 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69616%27 HTTP/1.1" 200 None
2026-03-27 10:39:11 [auto1.de] INFO: Scrape type for SV69616: 2
2026-03-27 10:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59508b96-73c2-5cd2-9114-4b2a79eea019 with identifier: SV69616
2026-03-27 10:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59508b96-73c2-5cd2-9114-4b2a79eea019 with scrape type 2
2026-03-27 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59508b96-73c2-5cd2-9114-4b2a79eea019 with scrape type 2
2026-03-27 10:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59508b96-73c2-5cd2-9114-4b2a79eea019, identifier: SV69616
2026-03-27 10:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4207b5d9-b583-5de5-a664-8aa73e57ada5 with identifier: KX79678
2026-03-27 10:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4207b5d9-b583-5de5-a664-8aa73e57ada5 with identifier: KX79678
2026-03-27 10:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4207b5d9-b583-5de5-a664-8aa73e57ada5 with identifier: KX79678 to the API
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:14:57Z',
'fuel_type': 'petrol',
'id': '4207b5d9-b583-5de5-a664-8aa73e57ada5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX79678',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 96029,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-21',
'seller_name': None,
'title': 'Opel Mokka 1.4 Turbo Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2015}
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX79678%27 HTTP/1.1" 200 None
2026-03-27 10:39:12 [auto1.de] INFO: Saving data for KX79678: {'auction_closing_time': 1774714497.0, 'created_time': 1773306116.14845, 'last_price_update_time': 1774607952.202398}
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX79678') HTTP/1.1" 204 0
2026-03-27 10:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59508b96-73c2-5cd2-9114-4b2a79eea019 with identifier: SV69616
2026-03-27 10:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59508b96-73c2-5cd2-9114-4b2a79eea019 with identifier: SV69616
2026-03-27 10:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59508b96-73c2-5cd2-9114-4b2a79eea019 with identifier: SV69616 to the API
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:04:46Z',
'fuel_type': 'petrol',
'id': '59508b96-73c2-5cd2-9114-4b2a79eea019',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV69616',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 164705,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-24',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69616%27 HTTP/1.1" 200 None
2026-03-27 10:39:12 [auto1.de] INFO: Saving data for SV69616: {'auction_closing_time': 1774713886.0, 'created_time': 1773688144.745135, 'last_price_update_time': 1774607952.543182}
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV69616') HTTP/1.1" 204 0
2026-03-27 10:39:12 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-27 10:39:12 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-27 10:39:12 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-27 10:39:12 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-27 10:39:12 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-27 10:39:12 [auto1.de] INFO: Found listing with ID: VV98645
2026-03-27 10:39:12 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-27 10:39:12 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY04435%27 HTTP/1.1" 200 None
2026-03-27 10:39:12 [auto1.de] INFO: Scrape type for JY04435: 2
2026-03-27 10:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd2b0f88-1c5e-585c-8b03-0fc35bb792b6 with identifier: JY04435
2026-03-27 10:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd2b0f88-1c5e-585c-8b03-0fc35bb792b6 with scrape type 2
2026-03-27 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd2b0f88-1c5e-585c-8b03-0fc35bb792b6 with scrape type 2
2026-03-27 10:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd2b0f88-1c5e-585c-8b03-0fc35bb792b6, identifier: JY04435
2026-03-27 10:39:12 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-27 10:39:12 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN63350%27 HTTP/1.1" 200 None
2026-03-27 10:39:12 [auto1.de] INFO: Scrape type for ZN63350: 2
2026-03-27 10:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5255c63-9d44-5f4d-8c46-71e9682a5d9e with identifier: ZN63350
2026-03-27 10:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5255c63-9d44-5f4d-8c46-71e9682a5d9e with scrape type 2
2026-03-27 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5255c63-9d44-5f4d-8c46-71e9682a5d9e with scrape type 2
2026-03-27 10:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5255c63-9d44-5f4d-8c46-71e9682a5d9e, identifier: ZN63350
2026-03-27 10:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd2b0f88-1c5e-585c-8b03-0fc35bb792b6 with identifier: JY04435
2026-03-27 10:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd2b0f88-1c5e-585c-8b03-0fc35bb792b6 with identifier: JY04435
2026-03-27 10:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd2b0f88-1c5e-585c-8b03-0fc35bb792b6 with identifier: JY04435 to the API
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:57:00Z',
'fuel_type': 'diesel',
'id': 'dd2b0f88-1c5e-585c-8b03-0fc35bb792b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY04435',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 74296,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-11',
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TDI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2020}
2026-03-27 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY04435%27 HTTP/1.1" 200 None
2026-03-27 10:39:13 [auto1.de] INFO: Saving data for JY04435: {'auction_closing_time': 1774717020.0, 'created_time': 1773306973.136709, 'last_price_update_time': 1774607953.163853}
2026-03-27 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY04435') HTTP/1.1" 204 0
2026-03-27 10:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5255c63-9d44-5f4d-8c46-71e9682a5d9e with identifier: ZN63350
2026-03-27 10:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5255c63-9d44-5f4d-8c46-71e9682a5d9e with identifier: ZN63350
2026-03-27 10:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5255c63-9d44-5f4d-8c46-71e9682a5d9e with identifier: ZN63350 to the API
2026-03-27 10:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:28:42Z',
'fuel_type': 'petrol',
'id': 'b5255c63-9d44-5f4d-8c46-71e9682a5d9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN63350',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 204047,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-25',
'seller_name': None,
'title': 'Skoda Octavia 1.6 Tour',
'transmission': 'manual',
'trim': 'Tour',
'year': 2010}
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN63350%27 HTTP/1.1" 200 None
2026-03-27 10:39:14 [auto1.de] INFO: Saving data for ZN63350: {'auction_closing_time': 1774715322.0, 'created_time': 1773304071.171059, 'last_price_update_time': 1774607954.052621}
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN63350') HTTP/1.1" 204 0
2026-03-27 10:39:14 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-27 10:39:14 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-27 10:39:14 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-27 10:39:14 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-27 10:39:14 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-27 10:39:14 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ23133%27 HTTP/1.1" 200 None
2026-03-27 10:39:14 [auto1.de] INFO: Scrape type for YJ23133: 2
2026-03-27 10:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1778f9b5-1d04-5f33-aa04-973d57a1dde1 with identifier: YJ23133
2026-03-27 10:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1778f9b5-1d04-5f33-aa04-973d57a1dde1 with scrape type 2
2026-03-27 10:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1778f9b5-1d04-5f33-aa04-973d57a1dde1 with scrape type 2
2026-03-27 10:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1778f9b5-1d04-5f33-aa04-973d57a1dde1, identifier: YJ23133
2026-03-27 10:39:14 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-27 10:39:14 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-27 10:39:14 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91046%27 HTTP/1.1" 200 None
2026-03-27 10:39:14 [auto1.de] INFO: Scrape type for GV91046: 2
2026-03-27 10:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ba1abf2-d22f-5f6b-9b6d-ee032405443d with identifier: GV91046
2026-03-27 10:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ba1abf2-d22f-5f6b-9b6d-ee032405443d with scrape type 2
2026-03-27 10:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ba1abf2-d22f-5f6b-9b6d-ee032405443d with scrape type 2
2026-03-27 10:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ba1abf2-d22f-5f6b-9b6d-ee032405443d, identifier: GV91046
2026-03-27 10:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1778f9b5-1d04-5f33-aa04-973d57a1dde1 with identifier: YJ23133
2026-03-27 10:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1778f9b5-1d04-5f33-aa04-973d57a1dde1 with identifier: YJ23133
2026-03-27 10:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1778f9b5-1d04-5f33-aa04-973d57a1dde1 with identifier: YJ23133 to the API
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:16:51Z',
'fuel_type': 'petrol',
'id': '1778f9b5-1d04-5f33-aa04-973d57a1dde1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ23133',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 58565,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-12',
'seller_name': None,
'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
'transmission': 'manual',
'trim': 'Highline BlueMotion',
'year': 2022}
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ23133%27 HTTP/1.1" 200 None
2026-03-27 10:39:14 [auto1.de] INFO: Saving data for YJ23133: {'auction_closing_time': 1774714611.0, 'created_time': 1774294148.388859, 'last_price_update_time': 1774607954.669847}
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ23133') HTTP/1.1" 204 0
2026-03-27 10:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ba1abf2-d22f-5f6b-9b6d-ee032405443d with identifier: GV91046
2026-03-27 10:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ba1abf2-d22f-5f6b-9b6d-ee032405443d with identifier: GV91046
2026-03-27 10:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ba1abf2-d22f-5f6b-9b6d-ee032405443d with identifier: GV91046 to the API
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:48:30Z',
'fuel_type': 'diesel',
'id': '4ba1abf2-d22f-5f6b-9b6d-ee032405443d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV91046',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 342414,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-02',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2014}
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91046%27 HTTP/1.1" 200 None
2026-03-27 10:39:15 [auto1.de] INFO: Saving data for GV91046: {'auction_closing_time': 1774716510.0, 'created_time': 1773308234.094236, 'last_price_update_time': 1774607955.064008}
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV91046') HTTP/1.1" 204 0
2026-03-27 10:39:15 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-27 10:39:15 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD67792%27 HTTP/1.1" 200 None
2026-03-27 10:39:15 [auto1.de] INFO: Scrape type for SD67792: 1
2026-03-27 10:39:15 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW59742%27 HTTP/1.1" 200 None
2026-03-27 10:39:15 [auto1.de] INFO: Scrape type for CW59742: 2
2026-03-27 10:39:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc7c1e35-d42d-5997-bd20-ad05c7b63589 with identifier: CW59742
2026-03-27 10:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc7c1e35-d42d-5997-bd20-ad05c7b63589 with scrape type 2
2026-03-27 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc7c1e35-d42d-5997-bd20-ad05c7b63589 with scrape type 2
2026-03-27 10:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc7c1e35-d42d-5997-bd20-ad05c7b63589, identifier: CW59742
2026-03-27 10:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc7c1e35-d42d-5997-bd20-ad05c7b63589 with identifier: CW59742
2026-03-27 10:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc7c1e35-d42d-5997-bd20-ad05c7b63589 with identifier: CW59742
2026-03-27 10:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc7c1e35-d42d-5997-bd20-ad05c7b63589 with identifier: CW59742 to the API
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:22:47Z',
'fuel_type': 'diesel',
'id': 'fc7c1e35-d42d-5997-bd20-ad05c7b63589',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW59742',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 274134,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-22',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
'transmission': 'manual',
'trim': 'Highline BlueMotion',
'year': 2014}
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW59742%27 HTTP/1.1" 200 None
2026-03-27 10:39:15 [auto1.de] INFO: Saving data for CW59742: {'auction_closing_time': 1774714967.0, 'created_time': 1773467233.793212, 'last_price_update_time': 1774607955.550447}
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW59742') HTTP/1.1" 204 0
2026-03-27 10:39:15 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-27 10:39:15 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW09174%27 HTTP/1.1" 200 None
2026-03-27 10:39:15 [auto1.de] INFO: Scrape type for JW09174: 2
2026-03-27 10:39:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5 with identifier: JW09174
2026-03-27 10:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5 with scrape type 2
2026-03-27 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5 with scrape type 2
2026-03-27 10:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5, identifier: JW09174
2026-03-27 10:39:15 [auto1.de] INFO: Found listing with ID: LK48428
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK48428%27 HTTP/1.1" 200 None
2026-03-27 10:39:15 [auto1.de] INFO: Scrape type for LK48428: 2
2026-03-27 10:39:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 675f2836-9cde-5ead-b747-720b04f8b9e0 with identifier: LK48428
2026-03-27 10:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 675f2836-9cde-5ead-b747-720b04f8b9e0 with scrape type 2
2026-03-27 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 675f2836-9cde-5ead-b747-720b04f8b9e0 with scrape type 2
2026-03-27 10:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 675f2836-9cde-5ead-b747-720b04f8b9e0, identifier: LK48428
2026-03-27 10:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5 with identifier: JW09174
2026-03-27 10:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5 with identifier: JW09174
2026-03-27 10:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5 with identifier: JW09174 to the API
2026-03-27 10:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:15:25Z',
'fuel_type': 'petrol',
'id': '6a21f52a-0a4f-5b6f-856c-cd3fe48e8ac5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW09174',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 169299,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-18',
'seller_name': None,
'title': 'Opel Astra 1.4 Turbo Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2011}
2026-03-27 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW09174%27 HTTP/1.1" 200 None
2026-03-27 10:39:16 [auto1.de] INFO: Saving data for JW09174: {'auction_closing_time': 1774714525.0, 'created_time': 1773303435.256022, 'last_price_update_time': 1774607956.268939}
2026-03-27 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW09174') HTTP/1.1" 204 0
2026-03-27 10:39:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 675f2836-9cde-5ead-b747-720b04f8b9e0 with identifier: LK48428
2026-03-27 10:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 675f2836-9cde-5ead-b747-720b04f8b9e0 with identifier: LK48428
2026-03-27 10:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 675f2836-9cde-5ead-b747-720b04f8b9e0 with identifier: LK48428 to the API
2026-03-27 10:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 143,
'expiration_date': '2026-03-28T16:53:47Z',
'fuel_type': 'petrol',
'id': '675f2836-9cde-5ead-b747-720b04f8b9e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK48428',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 324842,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1996-06-16',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 230 Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 1996}
2026-03-27 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK48428%27 HTTP/1.1" 200 None
2026-03-27 10:39:16 [auto1.de] INFO: Saving data for LK48428: {'auction_closing_time': 1774716827.0, 'created_time': 1773513702.724251, 'last_price_update_time': 1774607956.635934}
2026-03-27 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK48428') HTTP/1.1" 204 0
2026-03-27 10:39:16 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-27 10:39:16 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-27 10:39:16 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-27 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET35150%27 HTTP/1.1" 200 None
2026-03-27 10:39:16 [auto1.de] INFO: Scrape type for ET35150: 2
2026-03-27 10:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1d8ca13-d359-5298-b3a1-bfe5fc64df8e with identifier: ET35150
2026-03-27 10:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1d8ca13-d359-5298-b3a1-bfe5fc64df8e with scrape type 2
2026-03-27 10:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1d8ca13-d359-5298-b3a1-bfe5fc64df8e with scrape type 2
2026-03-27 10:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1d8ca13-d359-5298-b3a1-bfe5fc64df8e, identifier: ET35150
2026-03-27 10:39:16 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-27 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP61796%27 HTTP/1.1" 200 None
2026-03-27 10:39:16 [auto1.de] INFO: Scrape type for WP61796: 2
2026-03-27 10:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5fb3c71-baf8-57b0-b50a-36aa058df703 with identifier: WP61796
2026-03-27 10:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5fb3c71-baf8-57b0-b50a-36aa058df703 with scrape type 2
2026-03-27 10:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5fb3c71-baf8-57b0-b50a-36aa058df703 with scrape type 2
2026-03-27 10:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5fb3c71-baf8-57b0-b50a-36aa058df703, identifier: WP61796
2026-03-27 10:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1d8ca13-d359-5298-b3a1-bfe5fc64df8e with identifier: ET35150
2026-03-27 10:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1d8ca13-d359-5298-b3a1-bfe5fc64df8e with identifier: ET35150
2026-03-27 10:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1d8ca13-d359-5298-b3a1-bfe5fc64df8e with identifier: ET35150 to the API
2026-03-27 10:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:25:29Z',
'fuel_type': 'diesel',
'id': 'f1d8ca13-d359-5298-b3a1-bfe5fc64df8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET35150',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 213103,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-21',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI BlueMotion',
'transmission': 'manual',
'trim': 'BlueMotion',
'year': 2012}
2026-03-27 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET35150%27 HTTP/1.1" 200 None
2026-03-27 10:39:17 [auto1.de] INFO: Saving data for ET35150: {'auction_closing_time': 1774715129.0, 'created_time': 1773306993.706408, 'last_price_update_time': 1774607957.223337}
2026-03-27 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET35150') HTTP/1.1" 204 0
2026-03-27 10:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5fb3c71-baf8-57b0-b50a-36aa058df703 with identifier: WP61796
2026-03-27 10:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5fb3c71-baf8-57b0-b50a-36aa058df703 with identifier: WP61796
2026-03-27 10:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5fb3c71-baf8-57b0-b50a-36aa058df703 with identifier: WP61796 to the API
2026-03-27 10:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-28T16:27:07Z',
'fuel_type': 'diesel',
'id': 'e5fb3c71-baf8-57b0-b50a-36aa058df703',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP61796',
'listing': 'auction',
'make': 'Porsche',
'model': 'Macan',
'odometer': 102537,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-06',
'seller_name': None,
'title': 'Porsche Macan S Diesel',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-27 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP61796%27 HTTP/1.1" 200 None
2026-03-27 10:39:17 [auto1.de] INFO: Saving data for WP61796: {'auction_closing_time': 1774715227.0, 'created_time': 1774263553.410733, 'last_price_update_time': 1774607957.555468}
2026-03-27 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP61796') HTTP/1.1" 204 0
2026-03-27 10:39:17 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-27 10:39:17 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-27 10:39:17 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-27 10:39:17 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-27 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82608%27 HTTP/1.1" 200 None
2026-03-27 10:39:17 [auto1.de] INFO: Scrape type for SA82608: 2
2026-03-27 10:39:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a09a46bf-24eb-5a77-8f2d-815a0973ddf4 with identifier: SA82608
2026-03-27 10:39:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a09a46bf-24eb-5a77-8f2d-815a0973ddf4 with scrape type 2
2026-03-27 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a09a46bf-24eb-5a77-8f2d-815a0973ddf4 with scrape type 2
2026-03-27 10:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a09a46bf-24eb-5a77-8f2d-815a0973ddf4, identifier: SA82608
2026-03-27 10:39:17 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-27 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04457%27 HTTP/1.1" 200 None
2026-03-27 10:39:17 [auto1.de] INFO: Scrape type for HM04457: 2
2026-03-27 10:39:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b with identifier: HM04457
2026-03-27 10:39:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b with scrape type 2
2026-03-27 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b with scrape type 2
2026-03-27 10:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b, identifier: HM04457
2026-03-27 10:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a09a46bf-24eb-5a77-8f2d-815a0973ddf4 with identifier: SA82608
2026-03-27 10:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a09a46bf-24eb-5a77-8f2d-815a0973ddf4 with identifier: SA82608
2026-03-27 10:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a09a46bf-24eb-5a77-8f2d-815a0973ddf4 with identifier: SA82608 to the API
2026-03-27 10:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-28T16:55:20Z',
'fuel_type': 'petrol',
'id': 'a09a46bf-24eb-5a77-8f2d-815a0973ddf4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA82608',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 7544,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-23',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2020}
2026-03-27 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82608%27 HTTP/1.1" 200 None
2026-03-27 10:39:18 [auto1.de] INFO: Saving data for SA82608: {'auction_closing_time': 1774716920.0, 'created_time': 1773660078.102642, 'last_price_update_time': 1774607958.123415}
2026-03-27 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA82608') HTTP/1.1" 204 0
2026-03-27 10:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b with identifier: HM04457
2026-03-27 10:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b with identifier: HM04457
2026-03-27 10:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b with identifier: HM04457 to the API
2026-03-27 10:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:33:21Z',
'fuel_type': 'petrol',
'id': '78a58d34-9df4-5cfd-88d7-8a7eddd6cf3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM04457',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 129544,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-28',
'seller_name': None,
'title': 'Ford Focus 1.6 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2009}
2026-03-27 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04457%27 HTTP/1.1" 200 None
2026-03-27 10:39:18 [auto1.de] INFO: Saving data for HM04457: {'auction_closing_time': 1774715601.0, 'created_time': 1773304569.610432, 'last_price_update_time': 1774607958.556767}
2026-03-27 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM04457') HTTP/1.1" 204 0
2026-03-27 10:39:18 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-27 10:39:18 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-27 10:39:18 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-27 10:39:18 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-27 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH74831%27 HTTP/1.1" 200 None
2026-03-27 10:39:18 [auto1.de] INFO: Scrape type for EH74831: 2
2026-03-27 10:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b14289ac-35be-5e00-b887-be57d524cb89 with identifier: EH74831
2026-03-27 10:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b14289ac-35be-5e00-b887-be57d524cb89 with scrape type 2
2026-03-27 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b14289ac-35be-5e00-b887-be57d524cb89 with scrape type 2
2026-03-27 10:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b14289ac-35be-5e00-b887-be57d524cb89, identifier: EH74831
2026-03-27 10:39:18 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-27 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42625%27 HTTP/1.1" 200 None
2026-03-27 10:39:18 [auto1.de] INFO: Scrape type for DE42625: 2
2026-03-27 10:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5565833-2ca2-5e96-bd88-9461c4c07921 with identifier: DE42625
2026-03-27 10:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5565833-2ca2-5e96-bd88-9461c4c07921 with scrape type 2
2026-03-27 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5565833-2ca2-5e96-bd88-9461c4c07921 with scrape type 2
2026-03-27 10:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5565833-2ca2-5e96-bd88-9461c4c07921, identifier: DE42625
2026-03-27 10:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b14289ac-35be-5e00-b887-be57d524cb89 with identifier: EH74831
2026-03-27 10:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b14289ac-35be-5e00-b887-be57d524cb89 with identifier: EH74831
2026-03-27 10:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b14289ac-35be-5e00-b887-be57d524cb89 with identifier: EH74831 to the API
2026-03-27 10:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:01:57Z',
'fuel_type': 'petrol',
'id': 'b14289ac-35be-5e00-b887-be57d524cb89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH74831',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 79141,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-07',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2019}
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH74831%27 HTTP/1.1" 200 None
2026-03-27 10:39:19 [auto1.de] INFO: Saving data for EH74831: {'auction_closing_time': 1774713717.0, 'created_time': 1773775402.534964, 'last_price_update_time': 1774607959.127834}
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH74831') HTTP/1.1" 204 0
2026-03-27 10:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5565833-2ca2-5e96-bd88-9461c4c07921 with identifier: DE42625
2026-03-27 10:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5565833-2ca2-5e96-bd88-9461c4c07921 with identifier: DE42625
2026-03-27 10:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5565833-2ca2-5e96-bd88-9461c4c07921 with identifier: DE42625 to the API
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:29:54Z',
'fuel_type': 'petrol',
'id': 'b5565833-2ca2-5e96-bd88-9461c4c07921',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE42625',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 218247,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-31',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.4 TSI Team',
'transmission': 'manual',
'trim': 'Team',
'year': 2010}
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42625%27 HTTP/1.1" 200 None
2026-03-27 10:39:19 [auto1.de] INFO: Saving data for DE42625: {'auction_closing_time': 1774715394.0, 'created_time': 1773686583.058438, 'last_price_update_time': 1774607959.460666}
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE42625') HTTP/1.1" 204 0
2026-03-27 10:39:19 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA50565%27 HTTP/1.1" 200 None
2026-03-27 10:39:19 [auto1.de] INFO: Scrape type for CA50565: 2
2026-03-27 10:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8d0d78c-15a0-5605-ba10-d3a8eccac6c3 with identifier: CA50565
2026-03-27 10:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8d0d78c-15a0-5605-ba10-d3a8eccac6c3 with scrape type 2
2026-03-27 10:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8d0d78c-15a0-5605-ba10-d3a8eccac6c3 with scrape type 2
2026-03-27 10:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8d0d78c-15a0-5605-ba10-d3a8eccac6c3, identifier: CA50565
2026-03-27 10:39:19 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX24898%27 HTTP/1.1" 200 None
2026-03-27 10:39:19 [auto1.de] INFO: Scrape type for AX24898: 2
2026-03-27 10:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b88c956-0637-58d3-9fb4-559647cdea4f with identifier: AX24898
2026-03-27 10:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b88c956-0637-58d3-9fb4-559647cdea4f with scrape type 2
2026-03-27 10:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b88c956-0637-58d3-9fb4-559647cdea4f with scrape type 2
2026-03-27 10:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b88c956-0637-58d3-9fb4-559647cdea4f, identifier: AX24898
2026-03-27 10:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8d0d78c-15a0-5605-ba10-d3a8eccac6c3 with identifier: CA50565
2026-03-27 10:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8d0d78c-15a0-5605-ba10-d3a8eccac6c3 with identifier: CA50565
2026-03-27 10:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8d0d78c-15a0-5605-ba10-d3a8eccac6c3 with identifier: CA50565 to the API
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:02:58Z',
'fuel_type': 'diesel',
'id': 'f8d0d78c-15a0-5605-ba10-d3a8eccac6c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA50565',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 135252,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-27',
'seller_name': None,
'title': 'Hyundai Tucson 1.7 CRDi Style blue 2WD',
'transmission': 'automatic',
'trim': 'Style blue 2WD',
'year': 2018}
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA50565%27 HTTP/1.1" 200 None
2026-03-27 10:39:20 [auto1.de] INFO: Saving data for CA50565: {'auction_closing_time': 1774713778.0, 'created_time': 1773774481.528063, 'last_price_update_time': 1774607960.027722}
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA50565') HTTP/1.1" 204 0
2026-03-27 10:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b88c956-0637-58d3-9fb4-559647cdea4f with identifier: AX24898
2026-03-27 10:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b88c956-0637-58d3-9fb4-559647cdea4f with identifier: AX24898
2026-03-27 10:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b88c956-0637-58d3-9fb4-559647cdea4f with identifier: AX24898 to the API
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:12:00Z',
'fuel_type': 'diesel',
'id': '8b88c956-0637-58d3-9fb4-559647cdea4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX24898',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 194736,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-07',
'seller_name': None,
'title': 'Ford Focus 1.5 TDCi Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2015}
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX24898%27 HTTP/1.1" 200 None
2026-03-27 10:39:20 [auto1.de] INFO: Saving data for AX24898: {'auction_closing_time': 1774714320.0, 'created_time': 1773859000.797888, 'last_price_update_time': 1774607960.361306}
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX24898') HTTP/1.1" 204 0
2026-03-27 10:39:20 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-27 10:39:20 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR26970%27 HTTP/1.1" 200 None
2026-03-27 10:39:20 [auto1.de] INFO: Scrape type for XR26970: 2
2026-03-27 10:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27715857-0716-53a3-b808-ec5d7e777291 with identifier: XR26970
2026-03-27 10:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27715857-0716-53a3-b808-ec5d7e777291 with scrape type 2
2026-03-27 10:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27715857-0716-53a3-b808-ec5d7e777291 with scrape type 2
2026-03-27 10:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27715857-0716-53a3-b808-ec5d7e777291, identifier: XR26970
2026-03-27 10:39:20 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA59135%27 HTTP/1.1" 200 None
2026-03-27 10:39:20 [auto1.de] INFO: Scrape type for FA59135: 2
2026-03-27 10:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bff56ec-3cd3-5581-b680-7155ce09e3fb with identifier: FA59135
2026-03-27 10:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bff56ec-3cd3-5581-b680-7155ce09e3fb with scrape type 2
2026-03-27 10:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bff56ec-3cd3-5581-b680-7155ce09e3fb with scrape type 2
2026-03-27 10:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bff56ec-3cd3-5581-b680-7155ce09e3fb, identifier: FA59135
2026-03-27 10:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27715857-0716-53a3-b808-ec5d7e777291 with identifier: XR26970
2026-03-27 10:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27715857-0716-53a3-b808-ec5d7e777291 with identifier: XR26970
2026-03-27 10:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27715857-0716-53a3-b808-ec5d7e777291 with identifier: XR26970 to the API
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:51:42Z',
'fuel_type': 'diesel',
'id': '27715857-0716-53a3-b808-ec5d7e777291',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR26970',
'listing': 'auction',
'make': 'Kia',
'model': 'Carens',
'odometer': 119055,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-26',
'seller_name': None,
'title': 'Kia Carens 1.7 CRDi FIFA World Cup Edition',
'transmission': 'manual',
'trim': 'FIFA World Cup Edition',
'year': 2015}
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR26970%27 HTTP/1.1" 200 None
2026-03-27 10:39:20 [auto1.de] INFO: Saving data for XR26970: {'auction_closing_time': 1774716702.0, 'created_time': 1773307846.300018, 'last_price_update_time': 1774607960.976077}
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR26970') HTTP/1.1" 204 0
2026-03-27 10:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bff56ec-3cd3-5581-b680-7155ce09e3fb with identifier: FA59135
2026-03-27 10:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bff56ec-3cd3-5581-b680-7155ce09e3fb with identifier: FA59135
2026-03-27 10:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bff56ec-3cd3-5581-b680-7155ce09e3fb with identifier: FA59135 to the API
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-28T16:11:49Z',
'fuel_type': 'petrol',
'id': '4bff56ec-3cd3-5581-b680-7155ce09e3fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA59135',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Alto',
'odometer': 106039,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-16',
'seller_name': None,
'title': 'Suzuki Alto 1.0 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2011}
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA59135%27 HTTP/1.1" 200 None
2026-03-27 10:39:21 [auto1.de] INFO: Saving data for FA59135: {'auction_closing_time': 1774714309.0, 'created_time': 1774293440.805188, 'last_price_update_time': 1774607961.329839}
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA59135') HTTP/1.1" 204 0
2026-03-27 10:39:21 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT21646%27 HTTP/1.1" 200 None
2026-03-27 10:39:21 [auto1.de] INFO: Scrape type for LT21646: 2
2026-03-27 10:39:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3007820d-77db-5437-8080-c9a57e30c5f5 with identifier: LT21646
2026-03-27 10:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3007820d-77db-5437-8080-c9a57e30c5f5 with scrape type 2
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3007820d-77db-5437-8080-c9a57e30c5f5 with scrape type 2
2026-03-27 10:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3007820d-77db-5437-8080-c9a57e30c5f5, identifier: LT21646
2026-03-27 10:39:21 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU44330%27 HTTP/1.1" 200 None
2026-03-27 10:39:21 [auto1.de] INFO: Scrape type for MU44330: 2
2026-03-27 10:39:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bd6aa9b-9088-5e3d-af89-c37292938060 with identifier: MU44330
2026-03-27 10:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bd6aa9b-9088-5e3d-af89-c37292938060 with scrape type 2
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bd6aa9b-9088-5e3d-af89-c37292938060 with scrape type 2
2026-03-27 10:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5bd6aa9b-9088-5e3d-af89-c37292938060, identifier: MU44330
2026-03-27 10:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3007820d-77db-5437-8080-c9a57e30c5f5 with identifier: LT21646
2026-03-27 10:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3007820d-77db-5437-8080-c9a57e30c5f5 with identifier: LT21646
2026-03-27 10:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3007820d-77db-5437-8080-c9a57e30c5f5 with identifier: LT21646 to the API
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:30:05Z',
'fuel_type': 'petrol',
'id': '3007820d-77db-5437-8080-c9a57e30c5f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT21646',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 87721,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-01',
'seller_name': None,
'title': 'BMW 1er 118i Edition M Sport Shadow',
'transmission': 'manual',
'trim': 'Edition M Sport Shadow',
'year': 2019}
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT21646%27 HTTP/1.1" 200 None
2026-03-27 10:39:21 [auto1.de] INFO: Saving data for LT21646: {'auction_closing_time': 1774715405.0, 'created_time': 1773427246.178547, 'last_price_update_time': 1774607961.888294}
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT21646') HTTP/1.1" 204 0
2026-03-27 10:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5bd6aa9b-9088-5e3d-af89-c37292938060 with identifier: MU44330
2026-03-27 10:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5bd6aa9b-9088-5e3d-af89-c37292938060 with identifier: MU44330
2026-03-27 10:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5bd6aa9b-9088-5e3d-af89-c37292938060 with identifier: MU44330 to the API
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:00:06Z',
'fuel_type': 'petrol',
'id': '5bd6aa9b-9088-5e3d-af89-c37292938060',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU44330',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 64819,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-27',
'seller_name': None,
'title': 'Opel Astra 1.2 Turbo Elegance Start/Stop',
'transmission': 'manual',
'trim': 'Elegance Start/Stop',
'year': 2020}
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU44330%27 HTTP/1.1" 200 None
2026-03-27 10:39:22 [auto1.de] INFO: Saving data for MU44330: {'auction_closing_time': 1774713606.0, 'created_time': 1773860936.7361, 'last_price_update_time': 1774607962.322389}
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU44330') HTTP/1.1" 204 0
2026-03-27 10:39:22 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE57150%27 HTTP/1.1" 200 None
2026-03-27 10:39:22 [auto1.de] INFO: Scrape type for UE57150: 2
2026-03-27 10:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80e08f92-033f-5fd1-aa5d-b3fe5341ee53 with identifier: UE57150
2026-03-27 10:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80e08f92-033f-5fd1-aa5d-b3fe5341ee53 with scrape type 2
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80e08f92-033f-5fd1-aa5d-b3fe5341ee53 with scrape type 2
2026-03-27 10:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80e08f92-033f-5fd1-aa5d-b3fe5341ee53, identifier: UE57150
2026-03-27 10:39:22 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-27 10:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80e08f92-033f-5fd1-aa5d-b3fe5341ee53 with identifier: UE57150
2026-03-27 10:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80e08f92-033f-5fd1-aa5d-b3fe5341ee53 with identifier: UE57150
2026-03-27 10:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80e08f92-033f-5fd1-aa5d-b3fe5341ee53 with identifier: UE57150 to the API
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:20:16Z',
'fuel_type': 'diesel',
'id': '80e08f92-033f-5fd1-aa5d-b3fe5341ee53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE57150',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 97526,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-20',
'seller_name': None,
'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
'transmission': 'automatic',
'trim': 'SE AWD',
'year': 2018}
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE57150%27 HTTP/1.1" 200 None
2026-03-27 10:39:22 [auto1.de] INFO: Saving data for UE57150: {'auction_closing_time': 1774714816.0, 'created_time': 1773305943.13069, 'last_price_update_time': 1774607962.897233}
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE57150') HTTP/1.1" 204 0
2026-03-27 10:39:22 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK31638%27 HTTP/1.1" 200 None
2026-03-27 10:39:22 [auto1.de] INFO: Scrape type for DK31638: 2
2026-03-27 10:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 164f7313-845f-5b9e-9e16-8353f2ea1d92 with identifier: DK31638
2026-03-27 10:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 164f7313-845f-5b9e-9e16-8353f2ea1d92 with scrape type 2
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 164f7313-845f-5b9e-9e16-8353f2ea1d92 with scrape type 2
2026-03-27 10:39:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 164f7313-845f-5b9e-9e16-8353f2ea1d92, identifier: DK31638
2026-03-27 10:39:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 164f7313-845f-5b9e-9e16-8353f2ea1d92 with identifier: DK31638
2026-03-27 10:39:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 164f7313-845f-5b9e-9e16-8353f2ea1d92 with identifier: DK31638
2026-03-27 10:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 164f7313-845f-5b9e-9e16-8353f2ea1d92 with identifier: DK31638 to the API
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 468,
'expiration_date': '2026-03-28T16:07:56Z',
'fuel_type': 'petrol',
'id': '164f7313-845f-5b9e-9e16-8353f2ea1d92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK31638',
'listing': 'auction',
'make': 'Jeep',
'model': 'Grand Cherokee',
'odometer': 86432,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-15',
'seller_name': None,
'title': 'Jeep Grand Cherokee 6.4 V8 HEMI SRT',
'transmission': 'automatic',
'trim': 'HEMI SRT',
'year': 2015}
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK31638%27 HTTP/1.1" 200 None
2026-03-27 10:39:23 [auto1.de] INFO: Saving data for DK31638: {'auction_closing_time': 1774714076.0, 'created_time': 1774262901.066826, 'last_price_update_time': 1774607963.364366}
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK31638') HTTP/1.1" 204 0
2026-03-27 10:39:23 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-27 10:39:23 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB50510%27 HTTP/1.1" 200 None
2026-03-27 10:39:23 [auto1.de] INFO: Scrape type for HB50510: 2
2026-03-27 10:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87059a7e-f606-5f61-8bbf-a97ea7b6f386 with identifier: HB50510
2026-03-27 10:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87059a7e-f606-5f61-8bbf-a97ea7b6f386 with scrape type 2
2026-03-27 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87059a7e-f606-5f61-8bbf-a97ea7b6f386 with scrape type 2
2026-03-27 10:39:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87059a7e-f606-5f61-8bbf-a97ea7b6f386, identifier: HB50510
2026-03-27 10:39:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87059a7e-f606-5f61-8bbf-a97ea7b6f386 with identifier: HB50510
2026-03-27 10:39:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87059a7e-f606-5f61-8bbf-a97ea7b6f386 with identifier: HB50510
2026-03-27 10:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87059a7e-f606-5f61-8bbf-a97ea7b6f386 with identifier: HB50510 to the API
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:40:53Z',
'fuel_type': 'petrol',
'id': '87059a7e-f606-5f61-8bbf-a97ea7b6f386',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB50510',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII Sportsvan',
'odometer': 125114,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-23',
'seller_name': None,
'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Sound BlueMotion',
'transmission': 'automatic',
'trim': 'Sound BlueMotion',
'year': 2017}
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB50510%27 HTTP/1.1" 200 None
2026-03-27 10:39:23 [auto1.de] INFO: Saving data for HB50510: {'auction_closing_time': 1774716053.0, 'created_time': 1774291665.779535, 'last_price_update_time': 1774607963.81687}
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB50510') HTTP/1.1" 204 0
2026-03-27 10:39:23 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-27 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:24 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 10511 | hits on page: 40
2026-03-27 10:39:24 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK31638%27 HTTP/1.1" 200 None
2026-03-27 10:39:24 [auto1.de] INFO: Scrape type for DK31638: 0
2026-03-27 10:39:24 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-27 10:39:24 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB50510%27 HTTP/1.1" 200 None
2026-03-27 10:39:24 [auto1.de] INFO: Scrape type for HB50510: 0
2026-03-27 10:39:24 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-27 10:39:24 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP04220%27 HTTP/1.1" 200 None
2026-03-27 10:39:24 [auto1.de] INFO: Scrape type for WP04220: 2
2026-03-27 10:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9703eaa8-b882-5107-a900-21f7a1b3a10b with identifier: WP04220
2026-03-27 10:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9703eaa8-b882-5107-a900-21f7a1b3a10b with scrape type 2
2026-03-27 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9703eaa8-b882-5107-a900-21f7a1b3a10b with scrape type 2
2026-03-27 10:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9703eaa8-b882-5107-a900-21f7a1b3a10b, identifier: WP04220
2026-03-27 10:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9703eaa8-b882-5107-a900-21f7a1b3a10b with identifier: WP04220
2026-03-27 10:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9703eaa8-b882-5107-a900-21f7a1b3a10b with identifier: WP04220
2026-03-27 10:39:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9703eaa8-b882-5107-a900-21f7a1b3a10b with identifier: WP04220 to the API
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:07:00Z',
'fuel_type': 'diesel',
'id': '9703eaa8-b882-5107-a900-21f7a1b3a10b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP04220',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 132820,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-15',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI RS',
'transmission': 'automatic',
'trim': 'RS',
'year': 2018}
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP04220%27 HTTP/1.1" 200 None
2026-03-27 10:39:25 [auto1.de] INFO: Saving data for WP04220: {'auction_closing_time': 1774714020.0, 'created_time': 1773305422.350433, 'last_price_update_time': 1774607965.249409}
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP04220') HTTP/1.1" 204 0
2026-03-27 10:39:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:25 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP96351%27 HTTP/1.1" 200 None
2026-03-27 10:39:25 [auto1.de] INFO: Scrape type for XP96351: 2
2026-03-27 10:39:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9cf80c6-a632-5a26-a895-34b7bdf4fbab with identifier: XP96351
2026-03-27 10:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9cf80c6-a632-5a26-a895-34b7bdf4fbab with scrape type 2
2026-03-27 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9cf80c6-a632-5a26-a895-34b7bdf4fbab with scrape type 2
2026-03-27 10:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9cf80c6-a632-5a26-a895-34b7bdf4fbab, identifier: XP96351
2026-03-27 10:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9cf80c6-a632-5a26-a895-34b7bdf4fbab with identifier: XP96351
2026-03-27 10:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9cf80c6-a632-5a26-a895-34b7bdf4fbab with identifier: XP96351
2026-03-27 10:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9cf80c6-a632-5a26-a895-34b7bdf4fbab with identifier: XP96351 to the API
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-03-28T16:12:28Z',
'fuel_type': 'diesel',
'id': 'f9cf80c6-a632-5a26-a895-34b7bdf4fbab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP96351',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 44045,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-03',
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Momentum Pro 2WD',
'transmission': 'automatic',
'trim': 'Momentum Pro 2WD',
'year': 2020}
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP96351%27 HTTP/1.1" 200 None
2026-03-27 10:39:25 [auto1.de] INFO: Saving data for XP96351: {'auction_closing_time': 1774714348.0, 'created_time': 1773305084.289303, 'last_price_update_time': 1774607965.866199}
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP96351') HTTP/1.1" 204 0
2026-03-27 10:39:25 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-27 10:39:25 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP38579%27 HTTP/1.1" 200 None
2026-03-27 10:39:25 [auto1.de] INFO: Scrape type for EP38579: 2
2026-03-27 10:39:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a468eef-e5e7-58be-b86c-eacf239dc4c7 with identifier: EP38579
2026-03-27 10:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a468eef-e5e7-58be-b86c-eacf239dc4c7 with scrape type 2
2026-03-27 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a468eef-e5e7-58be-b86c-eacf239dc4c7 with scrape type 2
2026-03-27 10:39:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a468eef-e5e7-58be-b86c-eacf239dc4c7, identifier: EP38579
2026-03-27 10:39:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a468eef-e5e7-58be-b86c-eacf239dc4c7 with identifier: EP38579
2026-03-27 10:39:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a468eef-e5e7-58be-b86c-eacf239dc4c7 with identifier: EP38579
2026-03-27 10:39:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a468eef-e5e7-58be-b86c-eacf239dc4c7 with identifier: EP38579 to the API
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:08:54Z',
'fuel_type': 'diesel',
'id': '1a468eef-e5e7-58be-b86c-eacf239dc4c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP38579',
'listing': 'auction',
'make': 'Audi',
'model': 'A1',
'odometer': 223402,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-08',
'seller_name': None,
'title': 'Audi A1 1.6 TDI Attraction',
'transmission': 'automatic',
'trim': 'Attraction',
'year': 2011}
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP38579%27 HTTP/1.1" 200 None
2026-03-27 10:39:26 [auto1.de] INFO: Saving data for EP38579: {'auction_closing_time': 1774714134.0, 'created_time': 1773400332.831506, 'last_price_update_time': 1774607966.348156}
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP38579') HTTP/1.1" 204 0
2026-03-27 10:39:26 [auto1.de] INFO: Found listing with ID: EJ54624
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ54624%27 HTTP/1.1" 200 None
2026-03-27 10:39:26 [auto1.de] INFO: Scrape type for EJ54624: 2
2026-03-27 10:39:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a4c65b3-bb1f-5d43-b8bc-83043911ddc8 with identifier: EJ54624
2026-03-27 10:39:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a4c65b3-bb1f-5d43-b8bc-83043911ddc8 with scrape type 2
2026-03-27 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a4c65b3-bb1f-5d43-b8bc-83043911ddc8 with scrape type 2
2026-03-27 10:39:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a4c65b3-bb1f-5d43-b8bc-83043911ddc8, identifier: EJ54624
2026-03-27 10:39:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a4c65b3-bb1f-5d43-b8bc-83043911ddc8 with identifier: EJ54624
2026-03-27 10:39:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a4c65b3-bb1f-5d43-b8bc-83043911ddc8 with identifier: EJ54624
2026-03-27 10:39:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a4c65b3-bb1f-5d43-b8bc-83043911ddc8 with identifier: EJ54624 to the API
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:19:14Z',
'fuel_type': 'petrol',
'id': '2a4c65b3-bb1f-5d43-b8bc-83043911ddc8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ54624',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 234636,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-25',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.2 TSI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2010}
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ54624%27 HTTP/1.1" 200 None
2026-03-27 10:39:26 [auto1.de] INFO: Saving data for EJ54624: {'auction_closing_time': 1774714754.0, 'created_time': 1773400702.080137, 'last_price_update_time': 1774607966.812047}
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ54624') HTTP/1.1" 204 0
2026-03-27 10:39:26 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ60837%27 HTTP/1.1" 200 None
2026-03-27 10:39:26 [auto1.de] INFO: Scrape type for BJ60837: 2
2026-03-27 10:39:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0 with identifier: BJ60837
2026-03-27 10:39:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0 with scrape type 2
2026-03-27 10:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0 with scrape type 2
2026-03-27 10:39:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0, identifier: BJ60837
2026-03-27 10:39:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0 with identifier: BJ60837
2026-03-27 10:39:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0 with identifier: BJ60837
2026-03-27 10:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0 with identifier: BJ60837 to the API
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:48:48Z',
'fuel_type': 'diesel',
'id': '5661f8fe-91d5-57c4-aad0-3e5c10c0d2a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ60837',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 62875,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-15',
'seller_name': None,
'title': 'Audi Q2 35 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2020}
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ60837%27 HTTP/1.1" 200 None
2026-03-27 10:39:27 [auto1.de] INFO: Saving data for BJ60837: {'auction_closing_time': 1774716528.0, 'created_time': 1774293694.471829, 'last_price_update_time': 1774607967.282355}
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ60837') HTTP/1.1" 204 0
2026-03-27 10:39:27 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-27 10:39:27 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-27 10:39:27 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW90276%27 HTTP/1.1" 200 None
2026-03-27 10:39:27 [auto1.de] INFO: Scrape type for DW90276: 2
2026-03-27 10:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9cb8f80-896c-555d-a79d-028ef21c50ef with identifier: DW90276
2026-03-27 10:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9cb8f80-896c-555d-a79d-028ef21c50ef with scrape type 2
2026-03-27 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9cb8f80-896c-555d-a79d-028ef21c50ef with scrape type 2
2026-03-27 10:39:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9cb8f80-896c-555d-a79d-028ef21c50ef, identifier: DW90276
2026-03-27 10:39:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9cb8f80-896c-555d-a79d-028ef21c50ef with identifier: DW90276
2026-03-27 10:39:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9cb8f80-896c-555d-a79d-028ef21c50ef with identifier: DW90276
2026-03-27 10:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9cb8f80-896c-555d-a79d-028ef21c50ef with identifier: DW90276 to the API
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:09:35Z',
'fuel_type': 'diesel',
'id': 'd9cb8f80-896c-555d-a79d-028ef21c50ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW90276',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 120718,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-02',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Multivan Generation Six 4Motion',
'transmission': 'automatic',
'trim': 'Multivan Generation Six 4Motion',
'year': 2017}
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW90276%27 HTTP/1.1" 200 None
2026-03-27 10:39:27 [auto1.de] INFO: Saving data for DW90276: {'auction_closing_time': 1774714175.0, 'created_time': 1773858928.621445, 'last_price_update_time': 1774607967.79693}
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW90276') HTTP/1.1" 204 0
2026-03-27 10:39:27 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN95277%27 HTTP/1.1" 200 None
2026-03-27 10:39:27 [auto1.de] INFO: Scrape type for VN95277: 2
2026-03-27 10:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dde03c7a-e316-5370-8e1d-50c5ccd2f772 with identifier: VN95277
2026-03-27 10:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dde03c7a-e316-5370-8e1d-50c5ccd2f772 with scrape type 2
2026-03-27 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dde03c7a-e316-5370-8e1d-50c5ccd2f772 with scrape type 2
2026-03-27 10:39:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dde03c7a-e316-5370-8e1d-50c5ccd2f772, identifier: VN95277
2026-03-27 10:39:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dde03c7a-e316-5370-8e1d-50c5ccd2f772 with identifier: VN95277
2026-03-27 10:39:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dde03c7a-e316-5370-8e1d-50c5ccd2f772 with identifier: VN95277
2026-03-27 10:39:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dde03c7a-e316-5370-8e1d-50c5ccd2f772 with identifier: VN95277 to the API
2026-03-27 10:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:54:52Z',
'fuel_type': 'diesel',
'id': 'dde03c7a-e316-5370-8e1d-50c5ccd2f772',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN95277',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 252462,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-02',
'seller_name': None,
'title': 'BMW 3er 320d GT',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-27 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN95277%27 HTTP/1.1" 200 None
2026-03-27 10:39:28 [auto1.de] INFO: Saving data for VN95277: {'auction_closing_time': 1774716892.0, 'created_time': 1774262589.516157, 'last_price_update_time': 1774607968.247509}
2026-03-27 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN95277') HTTP/1.1" 204 0
2026-03-27 10:39:28 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-27 10:39:28 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-27 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN35790%27 HTTP/1.1" 200 None
2026-03-27 10:39:28 [auto1.de] INFO: Scrape type for YN35790: 2
2026-03-27 10:39:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3 with identifier: YN35790
2026-03-27 10:39:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3 with scrape type 2
2026-03-27 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3 with scrape type 2
2026-03-27 10:39:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3, identifier: YN35790
2026-03-27 10:39:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3 with identifier: YN35790
2026-03-27 10:39:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3 with identifier: YN35790
2026-03-27 10:39:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3 with identifier: YN35790 to the API
2026-03-27 10:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 310,
'expiration_date': '2026-03-28T16:42:54Z',
'fuel_type': 'petrol',
'id': 'de3e5de0-3c49-57e6-8bb8-ccf5cd7fddd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN35790',
'listing': 'auction',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 38915,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-21',
'seller_name': None,
'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
'transmission': 'automatic',
'trim': 'VZ 4Drive',
'year': 2021}
2026-03-27 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN35790%27 HTTP/1.1" 200 None
2026-03-27 10:39:28 [auto1.de] INFO: Saving data for YN35790: {'auction_closing_time': 1774716174.0, 'created_time': 1774265118.820482, 'last_price_update_time': 1774607968.789274}
2026-03-27 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN35790') HTTP/1.1" 204 0
2026-03-27 10:39:28 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-27 10:39:28 [auto1.de] INFO: Found listing with ID: CF02627
2026-03-27 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF02627%27 HTTP/1.1" 200 None
2026-03-27 10:39:28 [auto1.de] INFO: Scrape type for CF02627: 2
2026-03-27 10:39:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d777cb51-be22-582a-8544-509ff2400f61 with identifier: CF02627
2026-03-27 10:39:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d777cb51-be22-582a-8544-509ff2400f61 with scrape type 2
2026-03-27 10:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d777cb51-be22-582a-8544-509ff2400f61 with scrape type 2
2026-03-27 10:39:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d777cb51-be22-582a-8544-509ff2400f61, identifier: CF02627
2026-03-27 10:39:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d777cb51-be22-582a-8544-509ff2400f61 with identifier: CF02627
2026-03-27 10:39:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d777cb51-be22-582a-8544-509ff2400f61 with identifier: CF02627
2026-03-27 10:39:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d777cb51-be22-582a-8544-509ff2400f61 with identifier: CF02627 to the API
2026-03-27 10:39:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:51:15Z',
'fuel_type': 'petrol',
'id': 'd777cb51-be22-582a-8544-509ff2400f61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF02627',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 71198,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-20',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2015}
2026-03-27 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF02627%27 HTTP/1.1" 200 None
2026-03-27 10:39:29 [auto1.de] INFO: Saving data for CF02627: {'auction_closing_time': 1774716675.0, 'created_time': 1773859653.438261, 'last_price_update_time': 1774607969.340433}
2026-03-27 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF02627') HTTP/1.1" 204 0
2026-03-27 10:39:29 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-27 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ67594%27 HTTP/1.1" 200 None
2026-03-27 10:39:29 [auto1.de] INFO: Scrape type for TJ67594: 2
2026-03-27 10:39:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eef27ea-db7d-5f8b-b6af-a18637003549 with identifier: TJ67594
2026-03-27 10:39:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eef27ea-db7d-5f8b-b6af-a18637003549 with scrape type 2
2026-03-27 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eef27ea-db7d-5f8b-b6af-a18637003549 with scrape type 2
2026-03-27 10:39:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6eef27ea-db7d-5f8b-b6af-a18637003549, identifier: TJ67594
2026-03-27 10:39:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6eef27ea-db7d-5f8b-b6af-a18637003549 with identifier: TJ67594
2026-03-27 10:39:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6eef27ea-db7d-5f8b-b6af-a18637003549 with identifier: TJ67594
2026-03-27 10:39:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6eef27ea-db7d-5f8b-b6af-a18637003549 with identifier: TJ67594 to the API
2026-03-27 10:39:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:21:01Z',
'fuel_type': 'petrol',
'id': '6eef27ea-db7d-5f8b-b6af-a18637003549',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ67594',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 80681,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-30',
'seller_name': None,
'title': 'Ford S-Max 1.5 EcoBoost ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2018}
2026-03-27 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ67594%27 HTTP/1.1" 200 None
2026-03-27 10:39:29 [auto1.de] INFO: Saving data for TJ67594: {'auction_closing_time': 1774714861.0, 'created_time': 1773859362.653042, 'last_price_update_time': 1774607969.789708}
2026-03-27 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ67594') HTTP/1.1" 204 0
2026-03-27 10:39:29 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-27 10:39:29 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-27 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR77795%27 HTTP/1.1" 200 None
2026-03-27 10:39:29 [auto1.de] INFO: Scrape type for SR77795: 2
2026-03-27 10:39:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7518fbbd-4d69-5c89-9ef8-db9b44759098 with identifier: SR77795
2026-03-27 10:39:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7518fbbd-4d69-5c89-9ef8-db9b44759098 with scrape type 2
2026-03-27 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7518fbbd-4d69-5c89-9ef8-db9b44759098 with scrape type 2
2026-03-27 10:39:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7518fbbd-4d69-5c89-9ef8-db9b44759098, identifier: SR77795
2026-03-27 10:39:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7518fbbd-4d69-5c89-9ef8-db9b44759098 with identifier: SR77795
2026-03-27 10:39:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7518fbbd-4d69-5c89-9ef8-db9b44759098 with identifier: SR77795
2026-03-27 10:39:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7518fbbd-4d69-5c89-9ef8-db9b44759098 with identifier: SR77795 to the API
2026-03-27 10:39:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-28T16:22:29Z',
'fuel_type': 'diesel',
'id': '7518fbbd-4d69-5c89-9ef8-db9b44759098',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR77795',
'listing': 'auction',
'make': 'Ford',
'model': 'Edge',
'odometer': 104063,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-12',
'seller_name': None,
'title': 'Ford Edge 2.0 TDCi Bi-Turbo Vignale 4x4',
'transmission': 'automatic',
'trim': 'Vignale 4x4',
'year': 2017}
2026-03-27 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR77795%27 HTTP/1.1" 200 None
2026-03-27 10:39:30 [auto1.de] INFO: Saving data for SR77795: {'auction_closing_time': 1774714949.0, 'created_time': 1773467835.394671, 'last_price_update_time': 1774607970.222222}
2026-03-27 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR77795') HTTP/1.1" 204 0
2026-03-27 10:39:30 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-27 10:39:30 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-27 10:39:30 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-27 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13181%27 HTTP/1.1" 200 None
2026-03-27 10:39:30 [auto1.de] INFO: Scrape type for NV13181: 2
2026-03-27 10:39:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce with identifier: NV13181
2026-03-27 10:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce with scrape type 2
2026-03-27 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce with scrape type 2
2026-03-27 10:39:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce, identifier: NV13181
2026-03-27 10:39:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce with identifier: NV13181
2026-03-27 10:39:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce with identifier: NV13181
2026-03-27 10:39:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce with identifier: NV13181 to the API
2026-03-27 10:39:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:09:12Z',
'fuel_type': 'diesel',
'id': 'ecbc2c1a-3b3b-5b0c-aa29-f5bafa8f54ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV13181',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 276650,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-08-16',
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'manual',
'trim': '',
'year': 2005}
2026-03-27 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13181%27 HTTP/1.1" 200 None
2026-03-27 10:39:30 [auto1.de] INFO: Saving data for NV13181: {'auction_closing_time': 1774714152.0, 'created_time': 1773427331.912878, 'last_price_update_time': 1774607970.664771}
2026-03-27 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV13181') HTTP/1.1" 204 0
2026-03-27 10:39:30 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-27 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS26605%27 HTTP/1.1" 200 None
2026-03-27 10:39:30 [auto1.de] INFO: Scrape type for BS26605: 2
2026-03-27 10:39:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 341d79e4-ad46-5a01-9a2a-a1d12f14feaf with identifier: BS26605
2026-03-27 10:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 341d79e4-ad46-5a01-9a2a-a1d12f14feaf with scrape type 2
2026-03-27 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 341d79e4-ad46-5a01-9a2a-a1d12f14feaf with scrape type 2
2026-03-27 10:39:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 341d79e4-ad46-5a01-9a2a-a1d12f14feaf, identifier: BS26605
2026-03-27 10:39:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 341d79e4-ad46-5a01-9a2a-a1d12f14feaf with identifier: BS26605
2026-03-27 10:39:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 341d79e4-ad46-5a01-9a2a-a1d12f14feaf with identifier: BS26605
2026-03-27 10:39:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 341d79e4-ad46-5a01-9a2a-a1d12f14feaf with identifier: BS26605 to the API
2026-03-27 10:39:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-28T16:21:07Z',
'fuel_type': 'diesel',
'id': '341d79e4-ad46-5a01-9a2a-a1d12f14feaf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS26605',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 219300,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-18',
'seller_name': None,
'title': 'BMW X1 xDrive 25d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2018}
2026-03-27 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS26605%27 HTTP/1.1" 200 None
2026-03-27 10:39:31 [auto1.de] INFO: Saving data for BS26605: {'auction_closing_time': 1774714867.0, 'created_time': 1773776013.509787, 'last_price_update_time': 1774607971.397837}
2026-03-27 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS26605') HTTP/1.1" 204 0
2026-03-27 10:39:31 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-27 10:39:31 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-27 10:39:31 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-27 10:39:31 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-27 10:39:31 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-27 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC25925%27 HTTP/1.1" 200 None
2026-03-27 10:39:31 [auto1.de] INFO: Scrape type for EC25925: 2
2026-03-27 10:39:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc08f6bf-99be-56e5-8859-cccfd5d12af2 with identifier: EC25925
2026-03-27 10:39:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc08f6bf-99be-56e5-8859-cccfd5d12af2 with scrape type 2
2026-03-27 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc08f6bf-99be-56e5-8859-cccfd5d12af2 with scrape type 2
2026-03-27 10:39:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc08f6bf-99be-56e5-8859-cccfd5d12af2, identifier: EC25925
2026-03-27 10:39:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc08f6bf-99be-56e5-8859-cccfd5d12af2 with identifier: EC25925
2026-03-27 10:39:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc08f6bf-99be-56e5-8859-cccfd5d12af2 with identifier: EC25925
2026-03-27 10:39:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc08f6bf-99be-56e5-8859-cccfd5d12af2 with identifier: EC25925 to the API
2026-03-27 10:39:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:30:04Z',
'fuel_type': 'petrol',
'id': 'bc08f6bf-99be-56e5-8859-cccfd5d12af2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC25925',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 199499,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-29',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-27 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC25925%27 HTTP/1.1" 200 None
2026-03-27 10:39:31 [auto1.de] INFO: Saving data for EC25925: {'auction_closing_time': 1774715404.0, 'created_time': 1773466619.58683, 'last_price_update_time': 1774607971.920653}
2026-03-27 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC25925') HTTP/1.1" 204 0
2026-03-27 10:39:32 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-27 10:39:32 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-27 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM89515%27 HTTP/1.1" 200 None
2026-03-27 10:39:32 [auto1.de] INFO: Scrape type for XM89515: 2
2026-03-27 10:39:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445 with identifier: XM89515
2026-03-27 10:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445 with scrape type 2
2026-03-27 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445 with scrape type 2
2026-03-27 10:39:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445, identifier: XM89515
2026-03-27 10:39:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445 with identifier: XM89515
2026-03-27 10:39:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445 with identifier: XM89515
2026-03-27 10:39:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 671bb7d8-37ac-5a8b-ada1-dd7db8bf6445 with identifier: XM89515 to the API
2026-03-27 10:39:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:04:20Z',
'fuel_type': 'petrol',
'id': '671bb7d8-37ac-5a8b-ada1-dd7db8bf6445',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM89515',
'listing': 'auction',
'make': 'Skoda',
'model': 'Roomster',
'odometer': 109059,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-15',
'seller_name': None,
'title': 'Skoda Roomster 1.2 Praktik',
'transmission': 'manual',
'trim': 'Praktik',
'year': 2012}
2026-03-27 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM89515%27 HTTP/1.1" 200 None
2026-03-27 10:39:32 [auto1.de] INFO: Saving data for XM89515: {'auction_closing_time': 1774713860.0, 'created_time': 1774293880.955878, 'last_price_update_time': 1774607972.483853}
2026-03-27 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM89515') HTTP/1.1" 204 0
2026-03-27 10:39:32 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-27 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX34650%27 HTTP/1.1" 200 None
2026-03-27 10:39:32 [auto1.de] INFO: Scrape type for VX34650: 2
2026-03-27 10:39:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31049a8e-cdb3-51f8-a255-82f089ad50a9 with identifier: VX34650
2026-03-27 10:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31049a8e-cdb3-51f8-a255-82f089ad50a9 with scrape type 2
2026-03-27 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31049a8e-cdb3-51f8-a255-82f089ad50a9 with scrape type 2
2026-03-27 10:39:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31049a8e-cdb3-51f8-a255-82f089ad50a9, identifier: VX34650
2026-03-27 10:39:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31049a8e-cdb3-51f8-a255-82f089ad50a9 with identifier: VX34650
2026-03-27 10:39:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31049a8e-cdb3-51f8-a255-82f089ad50a9 with identifier: VX34650
2026-03-27 10:39:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31049a8e-cdb3-51f8-a255-82f089ad50a9 with identifier: VX34650 to the API
2026-03-27 10:39:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 155,
'expiration_date': '2026-03-28T16:58:49Z',
'fuel_type': 'petrol',
'id': '31049a8e-cdb3-51f8-a255-82f089ad50a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX34650',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 151728,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-04',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2013}
2026-03-27 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX34650%27 HTTP/1.1" 200 None
2026-03-27 10:39:33 [auto1.de] INFO: Saving data for VX34650: {'auction_closing_time': 1774717129.0, 'created_time': 1773774705.884662, 'last_price_update_time': 1774607973.261108}
2026-03-27 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX34650') HTTP/1.1" 204 0
2026-03-27 10:39:33 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-27 10:39:33 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-27 10:39:33 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-27 10:39:33 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-27 10:39:33 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-27 10:39:33 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-27 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW00961%27 HTTP/1.1" 200 None
2026-03-27 10:39:33 [auto1.de] INFO: Scrape type for DW00961: 2
2026-03-27 10:39:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c01bdfc6-e73c-5106-9ad7-4c5c2598782f with identifier: DW00961
2026-03-27 10:39:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c01bdfc6-e73c-5106-9ad7-4c5c2598782f with scrape type 2
2026-03-27 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c01bdfc6-e73c-5106-9ad7-4c5c2598782f with scrape type 2
2026-03-27 10:39:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c01bdfc6-e73c-5106-9ad7-4c5c2598782f, identifier: DW00961
2026-03-27 10:39:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c01bdfc6-e73c-5106-9ad7-4c5c2598782f with identifier: DW00961
2026-03-27 10:39:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c01bdfc6-e73c-5106-9ad7-4c5c2598782f with identifier: DW00961
2026-03-27 10:39:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c01bdfc6-e73c-5106-9ad7-4c5c2598782f with identifier: DW00961 to the API
2026-03-27 10:39:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:07:10Z',
'fuel_type': 'diesel',
'id': 'c01bdfc6-e73c-5106-9ad7-4c5c2598782f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW00961',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 193916,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-27',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 340 L2 Trend',
'transmission': 'manual',
'trim': '340 L2 Trend',
'year': 2016}
2026-03-27 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW00961%27 HTTP/1.1" 200 None
2026-03-27 10:39:33 [auto1.de] INFO: Saving data for DW00961: {'auction_closing_time': 1774714030.0, 'created_time': 1773138584.560725, 'last_price_update_time': 1774607973.921684}
2026-03-27 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW00961') HTTP/1.1" 204 0
2026-03-27 10:39:33 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-27 10:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:44 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 10512 | hits on page: 40
2026-03-27 10:39:44 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-27 10:39:44 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-27 10:39:44 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-27 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU27539%27 HTTP/1.1" 200 None
2026-03-27 10:39:45 [auto1.de] INFO: Scrape type for DU27539: 2
2026-03-27 10:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4869be33-a847-5ca2-b107-350924eb03cf with identifier: DU27539
2026-03-27 10:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4869be33-a847-5ca2-b107-350924eb03cf with scrape type 2
2026-03-27 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4869be33-a847-5ca2-b107-350924eb03cf with scrape type 2
2026-03-27 10:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4869be33-a847-5ca2-b107-350924eb03cf, identifier: DU27539
2026-03-27 10:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4869be33-a847-5ca2-b107-350924eb03cf with identifier: DU27539
2026-03-27 10:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4869be33-a847-5ca2-b107-350924eb03cf with identifier: DU27539
2026-03-27 10:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4869be33-a847-5ca2-b107-350924eb03cf with identifier: DU27539 to the API
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 272,
'expiration_date': '2026-03-28T16:48:45Z',
'fuel_type': 'petrol',
'id': '4869be33-a847-5ca2-b107-350924eb03cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU27539',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 143512,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-01',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 300 Mild-Hybrid 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2020}
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU27539%27 HTTP/1.1" 200 None
2026-03-27 10:39:45 [auto1.de] INFO: Saving data for DU27539: {'auction_closing_time': 1774716525.0, 'created_time': 1773860070.767056, 'last_price_update_time': 1774607985.449425}
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU27539') HTTP/1.1" 204 0
2026-03-27 10:39:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:45 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-27 10:39:45 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV94095%27 HTTP/1.1" 200 None
2026-03-27 10:39:45 [auto1.de] INFO: Scrape type for WV94095: 2
2026-03-27 10:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db2cbad4-ee18-5f98-a0d5-7517cdb3eaab with identifier: WV94095
2026-03-27 10:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db2cbad4-ee18-5f98-a0d5-7517cdb3eaab with scrape type 2
2026-03-27 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db2cbad4-ee18-5f98-a0d5-7517cdb3eaab with scrape type 2
2026-03-27 10:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db2cbad4-ee18-5f98-a0d5-7517cdb3eaab, identifier: WV94095
2026-03-27 10:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db2cbad4-ee18-5f98-a0d5-7517cdb3eaab with identifier: WV94095
2026-03-27 10:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db2cbad4-ee18-5f98-a0d5-7517cdb3eaab with identifier: WV94095
2026-03-27 10:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db2cbad4-ee18-5f98-a0d5-7517cdb3eaab with identifier: WV94095 to the API
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:48:53Z',
'fuel_type': 'petrol',
'id': 'db2cbad4-ee18-5f98-a0d5-7517cdb3eaab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV94095',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 142113,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-18',
'seller_name': None,
'title': 'Opel Zafira Tourer 1.4 Turbo Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2017}
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV94095%27 HTTP/1.1" 200 None
2026-03-27 10:39:46 [auto1.de] INFO: Saving data for WV94095: {'auction_closing_time': 1774716533.0, 'created_time': 1773741463.06113, 'last_price_update_time': 1774607986.029993}
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV94095') HTTP/1.1" 204 0
2026-03-27 10:39:46 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC22222%27 HTTP/1.1" 200 None
2026-03-27 10:39:46 [auto1.de] INFO: Scrape type for MC22222: 2
2026-03-27 10:39:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdfd7a21-c40a-50cb-a4a4-af9de3993814 with identifier: MC22222
2026-03-27 10:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdfd7a21-c40a-50cb-a4a4-af9de3993814 with scrape type 2
2026-03-27 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdfd7a21-c40a-50cb-a4a4-af9de3993814 with scrape type 2
2026-03-27 10:39:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdfd7a21-c40a-50cb-a4a4-af9de3993814, identifier: MC22222
2026-03-27 10:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdfd7a21-c40a-50cb-a4a4-af9de3993814 with identifier: MC22222
2026-03-27 10:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdfd7a21-c40a-50cb-a4a4-af9de3993814 with identifier: MC22222
2026-03-27 10:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdfd7a21-c40a-50cb-a4a4-af9de3993814 with identifier: MC22222 to the API
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:47:18Z',
'fuel_type': 'petrol',
'id': 'bdfd7a21-c40a-50cb-a4a4-af9de3993814',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC22222',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 118272,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-06-29',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 170 Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2005}
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC22222%27 HTTP/1.1" 200 None
2026-03-27 10:39:46 [auto1.de] INFO: Saving data for MC22222: {'auction_closing_time': 1774716438.0, 'created_time': 1773830931.305584, 'last_price_update_time': 1774607986.561277}
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC22222') HTTP/1.1" 204 0
2026-03-27 10:39:46 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF91285%27 HTTP/1.1" 200 None
2026-03-27 10:39:46 [auto1.de] INFO: Scrape type for KF91285: 2
2026-03-27 10:39:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fdc03d9-bc57-5b61-b085-bce43f022bc9 with identifier: KF91285
2026-03-27 10:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fdc03d9-bc57-5b61-b085-bce43f022bc9 with scrape type 2
2026-03-27 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fdc03d9-bc57-5b61-b085-bce43f022bc9 with scrape type 2
2026-03-27 10:39:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fdc03d9-bc57-5b61-b085-bce43f022bc9, identifier: KF91285
2026-03-27 10:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fdc03d9-bc57-5b61-b085-bce43f022bc9 with identifier: KF91285
2026-03-27 10:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fdc03d9-bc57-5b61-b085-bce43f022bc9 with identifier: KF91285
2026-03-27 10:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fdc03d9-bc57-5b61-b085-bce43f022bc9 with identifier: KF91285 to the API
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:57:12Z',
'fuel_type': 'petrol',
'id': '4fdc03d9-bc57-5b61-b085-bce43f022bc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF91285',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 103954,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-29',
'seller_name': None,
'title': 'Peugeot 207 1.6 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2008}
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF91285%27 HTTP/1.1" 200 None
2026-03-27 10:39:47 [auto1.de] INFO: Saving data for KF91285: {'auction_closing_time': 1774717032.0, 'created_time': 1773305079.028194, 'last_price_update_time': 1774607987.050763}
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF91285') HTTP/1.1" 204 0
2026-03-27 10:39:47 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB77182%27 HTTP/1.1" 200 None
2026-03-27 10:39:47 [auto1.de] INFO: Scrape type for RB77182: 2
2026-03-27 10:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6203c47-d9c1-55ca-9f5c-077d71936cc6 with identifier: RB77182
2026-03-27 10:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6203c47-d9c1-55ca-9f5c-077d71936cc6 with scrape type 2
2026-03-27 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6203c47-d9c1-55ca-9f5c-077d71936cc6 with scrape type 2
2026-03-27 10:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6203c47-d9c1-55ca-9f5c-077d71936cc6, identifier: RB77182
2026-03-27 10:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6203c47-d9c1-55ca-9f5c-077d71936cc6 with identifier: RB77182
2026-03-27 10:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6203c47-d9c1-55ca-9f5c-077d71936cc6 with identifier: RB77182
2026-03-27 10:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6203c47-d9c1-55ca-9f5c-077d71936cc6 with identifier: RB77182 to the API
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:05:53Z',
'fuel_type': 'petrol',
'id': 'd6203c47-d9c1-55ca-9f5c-077d71936cc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB77182',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 57286,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-10',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 TGDI N-Line 2WD',
'transmission': 'automatic',
'trim': 'N-Line 2WD',
'year': 2020}
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB77182%27 HTTP/1.1" 200 None
2026-03-27 10:39:47 [auto1.de] INFO: Saving data for RB77182: {'auction_closing_time': 1774713953.0, 'created_time': 1773657801.925021, 'last_price_update_time': 1774607987.677975}
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB77182') HTTP/1.1" 204 0
2026-03-27 10:39:47 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-27 10:39:47 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-27 10:39:47 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-27 10:39:47 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-27 10:39:47 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-27 10:39:47 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV17454%27 HTTP/1.1" 200 None
2026-03-27 10:39:47 [auto1.de] INFO: Scrape type for TV17454: 2
2026-03-27 10:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b7f275c-e2d2-5b70-990e-661f91471912 with identifier: TV17454
2026-03-27 10:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b7f275c-e2d2-5b70-990e-661f91471912 with scrape type 2
2026-03-27 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b7f275c-e2d2-5b70-990e-661f91471912 with scrape type 2
2026-03-27 10:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b7f275c-e2d2-5b70-990e-661f91471912, identifier: TV17454
2026-03-27 10:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b7f275c-e2d2-5b70-990e-661f91471912 with identifier: TV17454
2026-03-27 10:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b7f275c-e2d2-5b70-990e-661f91471912 with identifier: TV17454
2026-03-27 10:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b7f275c-e2d2-5b70-990e-661f91471912 with identifier: TV17454 to the API
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:01:19Z',
'fuel_type': 'diesel',
'id': '2b7f275c-e2d2-5b70-990e-661f91471912',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV17454',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 151607,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-11',
'seller_name': None,
'title': 'BMW 3er 320d Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2018}
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV17454%27 HTTP/1.1" 200 None
2026-03-27 10:39:48 [auto1.de] INFO: Saving data for TV17454: {'auction_closing_time': 1774713679.0, 'created_time': 1773859615.92452, 'last_price_update_time': 1774607988.157722}
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV17454') HTTP/1.1" 204 0
2026-03-27 10:39:48 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-27 10:39:48 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-27 10:39:48 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-27 10:39:48 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-27 10:39:48 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU77482%27 HTTP/1.1" 200 None
2026-03-27 10:39:48 [auto1.de] INFO: Scrape type for JU77482: 2
2026-03-27 10:39:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e161abf6-cd02-5201-91ff-e46bf75b50fc with identifier: JU77482
2026-03-27 10:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e161abf6-cd02-5201-91ff-e46bf75b50fc with scrape type 2
2026-03-27 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e161abf6-cd02-5201-91ff-e46bf75b50fc with scrape type 2
2026-03-27 10:39:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e161abf6-cd02-5201-91ff-e46bf75b50fc, identifier: JU77482
2026-03-27 10:39:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e161abf6-cd02-5201-91ff-e46bf75b50fc with identifier: JU77482
2026-03-27 10:39:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e161abf6-cd02-5201-91ff-e46bf75b50fc with identifier: JU77482
2026-03-27 10:39:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e161abf6-cd02-5201-91ff-e46bf75b50fc with identifier: JU77482 to the API
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:12:23Z',
'fuel_type': 'diesel',
'id': 'e161abf6-cd02-5201-91ff-e46bf75b50fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU77482',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 159669,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-22',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
'transmission': 'automatic',
'trim': 'Allure Pack',
'year': 2022}
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU77482%27 HTTP/1.1" 200 None
2026-03-27 10:39:48 [auto1.de] INFO: Saving data for JU77482: {'auction_closing_time': 1774714343.0, 'created_time': 1773426768.002692, 'last_price_update_time': 1774607988.722176}
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU77482') HTTP/1.1" 204 0
2026-03-27 10:39:48 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV74864%27 HTTP/1.1" 200 None
2026-03-27 10:39:48 [auto1.de] INFO: Scrape type for BV74864: 2
2026-03-27 10:39:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb87bf96-be5c-55dd-b193-8dc350e0f09d with identifier: BV74864
2026-03-27 10:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb87bf96-be5c-55dd-b193-8dc350e0f09d with scrape type 2
2026-03-27 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb87bf96-be5c-55dd-b193-8dc350e0f09d with scrape type 2
2026-03-27 10:39:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb87bf96-be5c-55dd-b193-8dc350e0f09d, identifier: BV74864
2026-03-27 10:39:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb87bf96-be5c-55dd-b193-8dc350e0f09d with identifier: BV74864
2026-03-27 10:39:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb87bf96-be5c-55dd-b193-8dc350e0f09d with identifier: BV74864
2026-03-27 10:39:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb87bf96-be5c-55dd-b193-8dc350e0f09d with identifier: BV74864 to the API
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:27:52Z',
'fuel_type': 'petrol',
'id': 'eb87bf96-be5c-55dd-b193-8dc350e0f09d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV74864',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 103859,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-28',
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-27 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV74864%27 HTTP/1.1" 200 None
2026-03-27 10:39:49 [auto1.de] INFO: Saving data for BV74864: {'auction_closing_time': 1774715272.0, 'created_time': 1773775791.75517, 'last_price_update_time': 1774607989.198596}
2026-03-27 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV74864') HTTP/1.1" 204 0
2026-03-27 10:39:49 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-27 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68514%27 HTTP/1.1" 200 None
2026-03-27 10:39:49 [auto1.de] INFO: Scrape type for NX68514: 2
2026-03-27 10:39:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08303f5a-9d5c-54bd-868a-4b73e8e897c7 with identifier: NX68514
2026-03-27 10:39:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08303f5a-9d5c-54bd-868a-4b73e8e897c7 with scrape type 2
2026-03-27 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08303f5a-9d5c-54bd-868a-4b73e8e897c7 with scrape type 2
2026-03-27 10:39:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08303f5a-9d5c-54bd-868a-4b73e8e897c7, identifier: NX68514
2026-03-27 10:39:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08303f5a-9d5c-54bd-868a-4b73e8e897c7 with identifier: NX68514
2026-03-27 10:39:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08303f5a-9d5c-54bd-868a-4b73e8e897c7 with identifier: NX68514
2026-03-27 10:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08303f5a-9d5c-54bd-868a-4b73e8e897c7 with identifier: NX68514 to the API
2026-03-27 10:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:59:56Z',
'fuel_type': 'petrol',
'id': '08303f5a-9d5c-54bd-868a-4b73e8e897c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX68514',
'listing': 'auction',
'make': 'Kia',
'model': "pro_cee'd",
'odometer': 50454,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-02',
'seller_name': None,
'title': "Kia pro_cee'd 1.6 TGDI GT",
'transmission': 'automatic',
'trim': 'GT',
'year': 2022}
2026-03-27 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68514%27 HTTP/1.1" 200 None
2026-03-27 10:39:49 [auto1.de] INFO: Saving data for NX68514: {'auction_closing_time': 1774717196.0, 'created_time': 1774294279.71042, 'last_price_update_time': 1774607989.65897}
2026-03-27 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX68514') HTTP/1.1" 204 0
2026-03-27 10:39:49 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-27 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU33144%27 HTTP/1.1" 200 None
2026-03-27 10:39:49 [auto1.de] INFO: Scrape type for TU33144: 2
2026-03-27 10:39:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a379f190-5340-5001-af2d-eb7bbbaf28b0 with identifier: TU33144
2026-03-27 10:39:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a379f190-5340-5001-af2d-eb7bbbaf28b0 with scrape type 2
2026-03-27 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a379f190-5340-5001-af2d-eb7bbbaf28b0 with scrape type 2
2026-03-27 10:39:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a379f190-5340-5001-af2d-eb7bbbaf28b0, identifier: TU33144
2026-03-27 10:39:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a379f190-5340-5001-af2d-eb7bbbaf28b0 with identifier: TU33144
2026-03-27 10:39:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a379f190-5340-5001-af2d-eb7bbbaf28b0 with identifier: TU33144
2026-03-27 10:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a379f190-5340-5001-af2d-eb7bbbaf28b0 with identifier: TU33144 to the API
2026-03-27 10:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:11:35Z',
'fuel_type': 'petrol',
'id': 'a379f190-5340-5001-af2d-eb7bbbaf28b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU33144',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 93455,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-28',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.2 TSI',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU33144%27 HTTP/1.1" 200 None
2026-03-27 10:39:50 [auto1.de] INFO: Saving data for TU33144: {'auction_closing_time': 1774714295.0, 'created_time': 1773774326.429819, 'last_price_update_time': 1774607990.129442}
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU33144') HTTP/1.1" 204 0
2026-03-27 10:39:50 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-27 10:39:50 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL15649%27 HTTP/1.1" 200 None
2026-03-27 10:39:50 [auto1.de] INFO: Scrape type for ZL15649: 1
2026-03-27 10:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:50 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL65692%27 HTTP/1.1" 200 None
2026-03-27 10:39:50 [auto1.de] INFO: Scrape type for JL65692: 1
2026-03-27 10:39:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:50 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW96119%27 HTTP/1.1" 200 None
2026-03-27 10:39:50 [auto1.de] INFO: Scrape type for CW96119: 2
2026-03-27 10:39:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66d0a061-043a-5bef-af38-b3a308bb1e86 with identifier: CW96119
2026-03-27 10:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66d0a061-043a-5bef-af38-b3a308bb1e86 with scrape type 2
2026-03-27 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66d0a061-043a-5bef-af38-b3a308bb1e86 with scrape type 2
2026-03-27 10:39:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66d0a061-043a-5bef-af38-b3a308bb1e86, identifier: CW96119
2026-03-27 10:39:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66d0a061-043a-5bef-af38-b3a308bb1e86 with identifier: CW96119
2026-03-27 10:39:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66d0a061-043a-5bef-af38-b3a308bb1e86 with identifier: CW96119
2026-03-27 10:39:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66d0a061-043a-5bef-af38-b3a308bb1e86 with identifier: CW96119 to the API
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:27:35Z',
'fuel_type': 'petrol',
'id': '66d0a061-043a-5bef-af38-b3a308bb1e86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW96119',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 124543,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-09',
'seller_name': None,
'title': 'Hyundai i30 1.4 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2013}
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW96119%27 HTTP/1.1" 200 None
2026-03-27 10:39:50 [auto1.de] INFO: Saving data for CW96119: {'auction_closing_time': 1774715255.0, 'created_time': 1773860967.140001, 'last_price_update_time': 1774607990.728138}
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW96119') HTTP/1.1" 204 0
2026-03-27 10:39:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:50 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-27 10:39:50 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN77653%27 HTTP/1.1" 200 None
2026-03-27 10:39:50 [auto1.de] INFO: Scrape type for YN77653: 2
2026-03-27 10:39:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55 with identifier: YN77653
2026-03-27 10:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55 with scrape type 2
2026-03-27 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55 with scrape type 2
2026-03-27 10:39:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55, identifier: YN77653
2026-03-27 10:39:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55 with identifier: YN77653
2026-03-27 10:39:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55 with identifier: YN77653
2026-03-27 10:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d58a9c3-eb96-5374-bd3a-e25ea28cbe55 with identifier: YN77653 to the API
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:34:13Z',
'fuel_type': 'petrol',
'id': '4d58a9c3-eb96-5374-bd3a-e25ea28cbe55',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN77653',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 115894,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-08',
'seller_name': None,
'title': 'Opel Mokka X 1.4 Turbo Active Start/Stop',
'transmission': 'manual',
'trim': 'Active Start/Stop',
'year': 2017}
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN77653%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [auto1.de] INFO: Saving data for YN77653: {'auction_closing_time': 1774715653.0, 'created_time': 1774292602.629372, 'last_price_update_time': 1774607991.274149}
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN77653') HTTP/1.1" 204 0
2026-03-27 10:39:51 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 10512 | hits on page: 40
2026-03-27 10:39:51 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-27 10:39:51 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-27 10:39:51 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-27 10:39:51 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV84359%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [auto1.de] INFO: Scrape type for ZV84359: 2
2026-03-27 10:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef68b548-af9a-5cd2-bb4e-0c0fb178d817 with identifier: ZV84359
2026-03-27 10:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef68b548-af9a-5cd2-bb4e-0c0fb178d817 with scrape type 2
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef68b548-af9a-5cd2-bb4e-0c0fb178d817 with scrape type 2
2026-03-27 10:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef68b548-af9a-5cd2-bb4e-0c0fb178d817, identifier: ZV84359
2026-03-27 10:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD67792/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef68b548-af9a-5cd2-bb4e-0c0fb178d817 with identifier: ZV84359
2026-03-27 10:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef68b548-af9a-5cd2-bb4e-0c0fb178d817 with identifier: ZV84359
2026-03-27 10:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef68b548-af9a-5cd2-bb4e-0c0fb178d817 with identifier: ZV84359 to the API
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-28T16:43:47Z',
'fuel_type': 'diesel',
'id': 'ef68b548-af9a-5cd2-bb4e-0c0fb178d817',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV84359',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 156647,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-03',
'seller_name': None,
'title': 'BMW X5 xDrive 40d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV84359%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [auto1.de] INFO: Saving data for ZV84359: {'auction_closing_time': 1774716227.0, 'created_time': 1773426853.951205, 'last_price_update_time': 1774607991.72961}
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV84359') HTTP/1.1" 204 0
2026-03-27 10:39:51 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-27 10:39:51 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH97983%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [auto1.de] INFO: Scrape type for AH97983: 2
2026-03-27 10:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951 with identifier: AH97983
2026-03-27 10:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951 with scrape type 2
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951 with scrape type 2
2026-03-27 10:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951, identifier: AH97983
2026-03-27 10:39:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:51 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX13516%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [auto1.de] INFO: Scrape type for VX13516: 2
2026-03-27 10:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d with identifier: VX13516
2026-03-27 10:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d with scrape type 2
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d with scrape type 2
2026-03-27 10:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d, identifier: VX13516
2026-03-27 10:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951 with identifier: AH97983
2026-03-27 10:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951 with identifier: AH97983
2026-03-27 10:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951 with identifier: AH97983 to the API
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:18:50Z',
'fuel_type': 'diesel',
'id': 'cd0e06d2-5fb9-527f-9a5c-4f1eb7d17951',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH97983',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 173774,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-09',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 CDI',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH97983%27 HTTP/1.1" 200 None
2026-03-27 10:39:52 [auto1.de] INFO: Saving data for AH97983: {'auction_closing_time': 1774714730.0, 'created_time': 1773399961.892188, 'last_price_update_time': 1774607992.306734}
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH97983') HTTP/1.1" 204 0
2026-03-27 10:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d with identifier: VX13516
2026-03-27 10:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d with identifier: VX13516
2026-03-27 10:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d with identifier: VX13516 to the API
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:50:11Z',
'fuel_type': 'diesel',
'id': '0bdbaebc-3f62-5eb9-a1b8-709b40c7f29d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX13516',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 276282,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-05',
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX13516%27 HTTP/1.1" 200 None
2026-03-27 10:39:52 [auto1.de] INFO: Saving data for VX13516: {'auction_closing_time': 1774716611.0, 'created_time': 1773399936.200992, 'last_price_update_time': 1774607992.698592}
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX13516') HTTP/1.1" 204 0
2026-03-27 10:39:52 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-27 10:39:52 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED00109%27 HTTP/1.1" 200 None
2026-03-27 10:39:52 [auto1.de] INFO: Scrape type for ED00109: 2
2026-03-27 10:39:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc with identifier: ED00109
2026-03-27 10:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc with scrape type 2
2026-03-27 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc with scrape type 2
2026-03-27 10:39:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc, identifier: ED00109
2026-03-27 10:39:52 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-27 10:39:52 [auto1.de] INFO: Found listing with ID: TR21109
2026-03-27 10:39:52 [auto1.de] INFO: Found listing with ID: EX10887
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX10887%27 HTTP/1.1" 200 None
2026-03-27 10:39:52 [auto1.de] INFO: Scrape type for EX10887: 2
2026-03-27 10:39:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3ec22a2-7a87-5e78-9d2c-9417a4fa7d6e with identifier: EX10887
2026-03-27 10:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3ec22a2-7a87-5e78-9d2c-9417a4fa7d6e with scrape type 2
2026-03-27 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3ec22a2-7a87-5e78-9d2c-9417a4fa7d6e with scrape type 2
2026-03-27 10:39:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3ec22a2-7a87-5e78-9d2c-9417a4fa7d6e, identifier: EX10887
2026-03-27 10:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc with identifier: ED00109
2026-03-27 10:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc with identifier: ED00109
2026-03-27 10:39:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14a4dcb9-cff4-59c3-8989-a8c9b3a007fc with identifier: ED00109 to the API
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:48:29Z',
'fuel_type': 'petrol',
'id': '14a4dcb9-cff4-59c3-8989-a8c9b3a007fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED00109',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 192858,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-31',
'seller_name': None,
'title': 'Opel Zafira Tourer 1.4 Turbo Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2016}
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED00109%27 HTTP/1.1" 200 None
2026-03-27 10:39:53 [auto1.de] INFO: Saving data for ED00109: {'auction_closing_time': 1774716509.0, 'created_time': 1774290787.179871, 'last_price_update_time': 1774607993.31852}
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED00109') HTTP/1.1" 204 0
2026-03-27 10:39:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3ec22a2-7a87-5e78-9d2c-9417a4fa7d6e with identifier: EX10887
2026-03-27 10:39:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3ec22a2-7a87-5e78-9d2c-9417a4fa7d6e with identifier: EX10887
2026-03-27 10:39:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3ec22a2-7a87-5e78-9d2c-9417a4fa7d6e with identifier: EX10887 to the API
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 218,
'expiration_date': '2026-03-28T16:39:38Z',
'fuel_type': 'petrol',
'id': 'b3ec22a2-7a87-5e78-9d2c-9417a4fa7d6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX10887',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 107827,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-17',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 250 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2016}
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX10887%27 HTTP/1.1" 200 None
2026-03-27 10:39:53 [auto1.de] INFO: Saving data for EX10887: {'auction_closing_time': 1774715978.0, 'created_time': 1774293030.567528, 'last_price_update_time': 1774607993.84066}
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX10887') HTTP/1.1" 204 0
2026-03-27 10:39:53 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR43208%27 HTTP/1.1" 200 None
2026-03-27 10:39:53 [auto1.de] INFO: Scrape type for XR43208: 2
2026-03-27 10:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9988beee-091a-51a8-9251-c85e89b9b8ca with identifier: XR43208
2026-03-27 10:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9988beee-091a-51a8-9251-c85e89b9b8ca with scrape type 2
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9988beee-091a-51a8-9251-c85e89b9b8ca with scrape type 2
2026-03-27 10:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9988beee-091a-51a8-9251-c85e89b9b8ca, identifier: XR43208
2026-03-27 10:39:54 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA75258%27 HTTP/1.1" 200 None
2026-03-27 10:39:54 [auto1.de] INFO: Scrape type for GA75258: 2
2026-03-27 10:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 998148ad-7c7b-5486-a016-cfb485d2dfb2 with identifier: GA75258
2026-03-27 10:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 998148ad-7c7b-5486-a016-cfb485d2dfb2 with scrape type 2
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 998148ad-7c7b-5486-a016-cfb485d2dfb2 with scrape type 2
2026-03-27 10:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 998148ad-7c7b-5486-a016-cfb485d2dfb2, identifier: GA75258
2026-03-27 10:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9988beee-091a-51a8-9251-c85e89b9b8ca with identifier: XR43208
2026-03-27 10:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9988beee-091a-51a8-9251-c85e89b9b8ca with identifier: XR43208
2026-03-27 10:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9988beee-091a-51a8-9251-c85e89b9b8ca with identifier: XR43208 to the API
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:13:58Z',
'fuel_type': 'diesel',
'id': '9988beee-091a-51a8-9251-c85e89b9b8ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR43208',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 140190,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-16',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.0 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2010}
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR43208%27 HTTP/1.1" 200 None
2026-03-27 10:39:54 [auto1.de] INFO: Saving data for XR43208: {'auction_closing_time': 1774714438.0, 'created_time': 1774293312.589195, 'last_price_update_time': 1774607994.481771}
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR43208') HTTP/1.1" 204 0
2026-03-27 10:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 998148ad-7c7b-5486-a016-cfb485d2dfb2 with identifier: GA75258
2026-03-27 10:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 998148ad-7c7b-5486-a016-cfb485d2dfb2 with identifier: GA75258
2026-03-27 10:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 998148ad-7c7b-5486-a016-cfb485d2dfb2 with identifier: GA75258 to the API
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:53:06Z',
'fuel_type': 'diesel',
'id': '998148ad-7c7b-5486-a016-cfb485d2dfb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA75258',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 197356,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-31',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA75258%27 HTTP/1.1" 200 None
2026-03-27 10:39:54 [auto1.de] INFO: Saving data for GA75258: {'auction_closing_time': 1774716786.0, 'created_time': 1773400145.309242, 'last_price_update_time': 1774607994.916325}
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA75258') HTTP/1.1" 204 0
2026-03-27 10:39:54 [auto1.de] INFO: Found listing with ID: TV77789
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV77789%27 HTTP/1.1" 200 None
2026-03-27 10:39:54 [auto1.de] INFO: Scrape type for TV77789: 2
2026-03-27 10:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b3b2d8a-c07b-500a-82c2-76f73d979cea with identifier: TV77789
2026-03-27 10:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b3b2d8a-c07b-500a-82c2-76f73d979cea with scrape type 2
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b3b2d8a-c07b-500a-82c2-76f73d979cea with scrape type 2
2026-03-27 10:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b3b2d8a-c07b-500a-82c2-76f73d979cea, identifier: TV77789
2026-03-27 10:39:55 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT60095%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [auto1.de] INFO: Scrape type for WT60095: 2
2026-03-27 10:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97042aa8-c767-5d71-8a41-28072e248773 with identifier: WT60095
2026-03-27 10:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97042aa8-c767-5d71-8a41-28072e248773 with scrape type 2
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97042aa8-c767-5d71-8a41-28072e248773 with scrape type 2
2026-03-27 10:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97042aa8-c767-5d71-8a41-28072e248773, identifier: WT60095
2026-03-27 10:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b3b2d8a-c07b-500a-82c2-76f73d979cea with identifier: TV77789
2026-03-27 10:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b3b2d8a-c07b-500a-82c2-76f73d979cea with identifier: TV77789
2026-03-27 10:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b3b2d8a-c07b-500a-82c2-76f73d979cea with identifier: TV77789 to the API
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-28T16:01:58Z',
'fuel_type': 'petrol',
'id': '8b3b2d8a-c07b-500a-82c2-76f73d979cea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV77789',
'listing': 'auction',
'make': 'Dacia',
'model': 'Logan MCV',
'odometer': 136930,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-03',
'seller_name': None,
'title': 'Dacia Logan MCV 1.2 Essentiel',
'transmission': 'manual',
'trim': 'Essentiel',
'year': 2016}
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV77789%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [auto1.de] INFO: Saving data for TV77789: {'auction_closing_time': 1774713718.0, 'created_time': 1774034338.163368, 'last_price_update_time': 1774607995.490974}
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV77789') HTTP/1.1" 204 0
2026-03-27 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL15649/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97042aa8-c767-5d71-8a41-28072e248773 with identifier: WT60095
2026-03-27 10:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97042aa8-c767-5d71-8a41-28072e248773 with identifier: WT60095
2026-03-27 10:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97042aa8-c767-5d71-8a41-28072e248773 with identifier: WT60095 to the API
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 194,
'expiration_date': '2026-03-28T16:45:11Z',
'fuel_type': 'diesel',
'id': '97042aa8-c767-5d71-8a41-28072e248773',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT60095',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 188024,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-24',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2018}
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT60095%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [auto1.de] INFO: Saving data for WT60095: {'auction_closing_time': 1774716311.0, 'created_time': 1773687135.837734, 'last_price_update_time': 1774607996.303089}
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT60095') HTTP/1.1" 204 0
2026-03-27 10:39:56 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN65444%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [auto1.de] INFO: Scrape type for KN65444: 2
2026-03-27 10:39:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4a209ed-c1ec-58e8-8243-fd471eaa4511 with identifier: KN65444
2026-03-27 10:39:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4a209ed-c1ec-58e8-8243-fd471eaa4511 with scrape type 2
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4a209ed-c1ec-58e8-8243-fd471eaa4511 with scrape type 2
2026-03-27 10:39:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4a209ed-c1ec-58e8-8243-fd471eaa4511, identifier: KN65444
2026-03-27 10:39:56 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-27 10:39:56 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS53864%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [auto1.de] INFO: Scrape type for HS53864: 2
2026-03-27 10:39:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb with identifier: HS53864
2026-03-27 10:39:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb with scrape type 2
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb with scrape type 2
2026-03-27 10:39:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb, identifier: HS53864
2026-03-27 10:39:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4a209ed-c1ec-58e8-8243-fd471eaa4511 with identifier: KN65444
2026-03-27 10:39:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4a209ed-c1ec-58e8-8243-fd471eaa4511 with identifier: KN65444
2026-03-27 10:39:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4a209ed-c1ec-58e8-8243-fd471eaa4511 with identifier: KN65444 to the API
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 261,
'expiration_date': '2026-03-28T16:41:52Z',
'fuel_type': 'hybrid',
'id': 'a4a209ed-c1ec-58e8-8243-fd471eaa4511',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN65444',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC40',
'odometer': 47574,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-31',
'seller_name': None,
'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid Inscription 2WD',
'transmission': 'automatic',
'trim': 'Inscription 2WD',
'year': 2021}
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN65444%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [auto1.de] INFO: Saving data for KN65444: {'auction_closing_time': 1774716112.0, 'created_time': 1774290894.901808, 'last_price_update_time': 1774607996.917538}
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN65444') HTTP/1.1" 204 0
2026-03-27 10:39:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb with identifier: HS53864
2026-03-27 10:39:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb with identifier: HS53864
2026-03-27 10:39:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 096f9ff6-ff5e-5368-9de9-59b8ac2c74cb with identifier: HS53864 to the API
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:41:18Z',
'fuel_type': 'diesel',
'id': '096f9ff6-ff5e-5368-9de9-59b8ac2c74cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS53864',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 190005,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-06',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS53864%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [auto1.de] INFO: Saving data for HS53864: {'auction_closing_time': 1774716078.0, 'created_time': 1773858670.207965, 'last_price_update_time': 1774607997.315989}
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS53864') HTTP/1.1" 204 0
2026-03-27 10:39:57 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK29782%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [auto1.de] INFO: Scrape type for LK29782: 2
2026-03-27 10:39:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4d7e4c2-6335-5aa6-b768-99391cc6bd88 with identifier: LK29782
2026-03-27 10:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4d7e4c2-6335-5aa6-b768-99391cc6bd88 with scrape type 2
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4d7e4c2-6335-5aa6-b768-99391cc6bd88 with scrape type 2
2026-03-27 10:39:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4d7e4c2-6335-5aa6-b768-99391cc6bd88, identifier: LK29782
2026-03-27 10:39:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4d7e4c2-6335-5aa6-b768-99391cc6bd88 with identifier: LK29782
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-27 10:39:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:39:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4d7e4c2-6335-5aa6-b768-99391cc6bd88 with identifier: LK29782
2026-03-27 10:39:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4d7e4c2-6335-5aa6-b768-99391cc6bd88 with identifier: LK29782 to the API
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:31:54Z',
'fuel_type': 'petrol',
'id': 'a4d7e4c2-6335-5aa6-b768-99391cc6bd88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK29782',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Taigo',
'odometer': 23860,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-06',
'seller_name': None,
'title': 'Volkswagen Taigo 1.0 TSI',
'transmission': 'manual',
'trim': '',
'year': 2022}
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK29782%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [auto1.de] INFO: Saving data for LK29782: {'auction_closing_time': 1774715514.0, 'created_time': 1773427476.579495, 'last_price_update_time': 1774607997.948527}
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK29782') HTTP/1.1" 204 0
2026-03-27 10:39:57 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF26076%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [auto1.de] INFO: Scrape type for TF26076: 2
2026-03-27 10:39:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b8283d1-3454-52ff-8ee7-13387781cc71 with identifier: TF26076
2026-03-27 10:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b8283d1-3454-52ff-8ee7-13387781cc71 with scrape type 2
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b8283d1-3454-52ff-8ee7-13387781cc71 with scrape type 2
2026-03-27 10:39:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b8283d1-3454-52ff-8ee7-13387781cc71, identifier: TF26076
2026-03-27 10:39:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JL65692/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b8283d1-3454-52ff-8ee7-13387781cc71 with identifier: TF26076
2026-03-27 10:39:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b8283d1-3454-52ff-8ee7-13387781cc71 with identifier: TF26076
2026-03-27 10:39:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b8283d1-3454-52ff-8ee7-13387781cc71 with identifier: TF26076 to the API
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-28T16:40:53Z',
'fuel_type': 'hybrid',
'id': '6b8283d1-3454-52ff-8ee7-13387781cc71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF26076',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 37301,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-08',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.4 eHybrid Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2022}
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF26076%27 HTTP/1.1" 200 None
2026-03-27 10:39:58 [auto1.de] INFO: Saving data for TF26076: {'auction_closing_time': 1774716053.0, 'created_time': 1773304061.515343, 'last_price_update_time': 1774607998.476931}
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF26076') HTTP/1.1" 204 0
2026-03-27 10:39:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:58 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB33579%27 HTTP/1.1" 200 None
2026-03-27 10:39:58 [auto1.de] INFO: Scrape type for EB33579: 2
2026-03-27 10:39:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 192ff80f-f22b-5e01-a34f-c6f43f215114 with identifier: EB33579
2026-03-27 10:39:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 192ff80f-f22b-5e01-a34f-c6f43f215114 with scrape type 2
2026-03-27 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 192ff80f-f22b-5e01-a34f-c6f43f215114 with scrape type 2
2026-03-27 10:39:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 192ff80f-f22b-5e01-a34f-c6f43f215114, identifier: EB33579
2026-03-27 10:39:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 192ff80f-f22b-5e01-a34f-c6f43f215114 with identifier: EB33579
2026-03-27 10:39:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 192ff80f-f22b-5e01-a34f-c6f43f215114 with identifier: EB33579
2026-03-27 10:39:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 192ff80f-f22b-5e01-a34f-c6f43f215114 with identifier: EB33579 to the API
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 204,
'expiration_date': '2026-03-28T16:47:24Z',
'fuel_type': 'diesel',
'id': '192ff80f-f22b-5e01-a34f-c6f43f215114',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB33579',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 California',
'odometer': 93778,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-24',
'seller_name': None,
'title': 'Volkswagen T6 California 2.0 TDI Ocean FWD',
'transmission': 'automatic',
'trim': 'Ocean FWD',
'year': 2021}
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB33579%27 HTTP/1.1" 200 None
2026-03-27 10:39:58 [auto1.de] INFO: Saving data for EB33579: {'auction_closing_time': 1774716444.0, 'created_time': 1773340378.96919, 'last_price_update_time': 1774607998.954076}
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB33579') HTTP/1.1" 204 0
2026-03-27 10:39:58 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF63689%27 HTTP/1.1" 200 None
2026-03-27 10:39:58 [auto1.de] INFO: Scrape type for TF63689: 2
2026-03-27 10:39:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34194588-12f6-54d3-ae6f-f5170e716e17 with identifier: TF63689
2026-03-27 10:39:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34194588-12f6-54d3-ae6f-f5170e716e17 with scrape type 2
2026-03-27 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34194588-12f6-54d3-ae6f-f5170e716e17 with scrape type 2
2026-03-27 10:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34194588-12f6-54d3-ae6f-f5170e716e17, identifier: TF63689
2026-03-27 10:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34194588-12f6-54d3-ae6f-f5170e716e17 with identifier: TF63689
2026-03-27 10:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34194588-12f6-54d3-ae6f-f5170e716e17 with identifier: TF63689
2026-03-27 10:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34194588-12f6-54d3-ae6f-f5170e716e17 with identifier: TF63689 to the API
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 245,
'expiration_date': '2026-03-28T16:59:46Z',
'fuel_type': 'petrol',
'id': '34194588-12f6-54d3-ae6f-f5170e716e17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF63689',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 147337,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-06',
'seller_name': None,
'title': 'BMW 3er 328i xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2014}
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF63689%27 HTTP/1.1" 200 None
2026-03-27 10:39:59 [auto1.de] INFO: Saving data for TF63689: {'auction_closing_time': 1774717186.0, 'created_time': 1774291997.535388, 'last_price_update_time': 1774607999.46793}
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF63689') HTTP/1.1" 204 0
2026-03-27 10:39:59 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-27 10:39:59 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ94450%27 HTTP/1.1" 200 None
2026-03-27 10:39:59 [auto1.de] INFO: Scrape type for CZ94450: 2
2026-03-27 10:39:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 023b43e7-00c1-5cae-8017-4b4155e5e661 with identifier: CZ94450
2026-03-27 10:39:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 023b43e7-00c1-5cae-8017-4b4155e5e661 with scrape type 2
2026-03-27 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 023b43e7-00c1-5cae-8017-4b4155e5e661 with scrape type 2
2026-03-27 10:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 023b43e7-00c1-5cae-8017-4b4155e5e661, identifier: CZ94450
2026-03-27 10:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 023b43e7-00c1-5cae-8017-4b4155e5e661 with identifier: CZ94450
2026-03-27 10:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 023b43e7-00c1-5cae-8017-4b4155e5e661 with identifier: CZ94450
2026-03-27 10:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 023b43e7-00c1-5cae-8017-4b4155e5e661 with identifier: CZ94450 to the API
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:14:48Z',
'fuel_type': 'petrol',
'id': '023b43e7-00c1-5cae-8017-4b4155e5e661',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ94450',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 147514,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-23',
'seller_name': None,
'title': 'BMW 1er 118i Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2018}
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ94450%27 HTTP/1.1" 200 None
2026-03-27 10:40:00 [auto1.de] INFO: Saving data for CZ94450: {'auction_closing_time': 1774714488.0, 'created_time': 1774292019.43737, 'last_price_update_time': 1774608000.129845}
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ94450') HTTP/1.1" 204 0
2026-03-27 10:40:00 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 10512 | hits on page: 40
2026-03-27 10:40:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:00 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW16724%27 HTTP/1.1" 200 None
2026-03-27 10:40:00 [auto1.de] INFO: Scrape type for WW16724: 2
2026-03-27 10:40:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f94af90a-ffcb-5a07-9fd7-27f562bbce1b with identifier: WW16724
2026-03-27 10:40:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f94af90a-ffcb-5a07-9fd7-27f562bbce1b with scrape type 2
2026-03-27 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f94af90a-ffcb-5a07-9fd7-27f562bbce1b with scrape type 2
2026-03-27 10:40:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f94af90a-ffcb-5a07-9fd7-27f562bbce1b, identifier: WW16724
2026-03-27 10:40:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f94af90a-ffcb-5a07-9fd7-27f562bbce1b with identifier: WW16724
2026-03-27 10:40:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f94af90a-ffcb-5a07-9fd7-27f562bbce1b with identifier: WW16724
2026-03-27 10:40:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f94af90a-ffcb-5a07-9fd7-27f562bbce1b with identifier: WW16724 to the API
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:26:48Z',
'fuel_type': 'diesel',
'id': 'f94af90a-ffcb-5a07-9fd7-27f562bbce1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW16724',
'listing': 'auction',
'make': 'Renault',
'model': 'Koleos',
'odometer': 199436,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-27',
'seller_name': None,
'title': 'Renault Koleos 2.0 dCi Energy Initiale Paris 4x4',
'transmission': 'automatic',
'trim': 'Initiale Paris 4x4',
'year': 2017}
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW16724%27 HTTP/1.1" 200 None
2026-03-27 10:40:00 [auto1.de] INFO: Saving data for WW16724: {'auction_closing_time': 1774715208.0, 'created_time': 1773819038.868884, 'last_price_update_time': 1774608000.671217}
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW16724') HTTP/1.1" 204 0
2026-03-27 10:40:00 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN66597%27 HTTP/1.1" 200 None
2026-03-27 10:40:00 [auto1.de] INFO: Scrape type for NN66597: 2
2026-03-27 10:40:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ab90b43-623e-5bc7-bea2-47c2de6cccc9 with identifier: NN66597
2026-03-27 10:40:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ab90b43-623e-5bc7-bea2-47c2de6cccc9 with scrape type 2
2026-03-27 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ab90b43-623e-5bc7-bea2-47c2de6cccc9 with scrape type 2
2026-03-27 10:40:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ab90b43-623e-5bc7-bea2-47c2de6cccc9, identifier: NN66597
2026-03-27 10:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD67792> (referer: https://www.auto1.com/v1/car-details-view/SD67792/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:00 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC70285%27 HTTP/1.1" 200 None
2026-03-27 10:40:00 [auto1.de] INFO: Scrape type for SC70285: 2
2026-03-27 10:40:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bb24ee4-37db-5074-9208-16d3d2d58feb with identifier: SC70285
2026-03-27 10:40:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bb24ee4-37db-5074-9208-16d3d2d58feb with scrape type 2
2026-03-27 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bb24ee4-37db-5074-9208-16d3d2d58feb with scrape type 2
2026-03-27 10:40:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bb24ee4-37db-5074-9208-16d3d2d58feb, identifier: SC70285
2026-03-27 10:40:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ab90b43-623e-5bc7-bea2-47c2de6cccc9 with identifier: NN66597
2026-03-27 10:40:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ab90b43-623e-5bc7-bea2-47c2de6cccc9 with identifier: NN66597
2026-03-27 10:40:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ab90b43-623e-5bc7-bea2-47c2de6cccc9 with identifier: NN66597 to the API
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-28T16:48:36Z',
'fuel_type': 'hybrid',
'id': '5ab90b43-623e-5bc7-bea2-47c2de6cccc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN66597',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 106388,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-16',
'seller_name': None,
'title': 'Toyota RAV 4 2.5 Hybrid 4x4',
'transmission': 'automatic',
'trim': '4x4',
'year': 2021}
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN66597%27 HTTP/1.1" 200 None
2026-03-27 10:40:01 [auto1.de] INFO: Saving data for NN66597: {'auction_closing_time': 1774716516.0, 'created_time': 1774264441.724794, 'last_price_update_time': 1774608001.30083}
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN66597') HTTP/1.1" 204 0
2026-03-27 10:40:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bb24ee4-37db-5074-9208-16d3d2d58feb with identifier: SC70285
2026-03-27 10:40:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bb24ee4-37db-5074-9208-16d3d2d58feb with identifier: SC70285
2026-03-27 10:40:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bb24ee4-37db-5074-9208-16d3d2d58feb with identifier: SC70285 to the API
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:45:43Z',
'fuel_type': 'diesel',
'id': '3bb24ee4-37db-5074-9208-16d3d2d58feb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC70285',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 273874,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-21',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2011}
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC70285%27 HTTP/1.1" 200 None
2026-03-27 10:40:01 [auto1.de] INFO: Saving data for SC70285: {'auction_closing_time': 1774716343.0, 'created_time': 1773137311.513845, 'last_price_update_time': 1774608001.687202}
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC70285') HTTP/1.1" 204 0
2026-03-27 10:40:01 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB47051%27 HTTP/1.1" 200 None
2026-03-27 10:40:01 [auto1.de] INFO: Scrape type for LB47051: 2
2026-03-27 10:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc with identifier: LB47051
2026-03-27 10:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc with scrape type 2
2026-03-27 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc with scrape type 2
2026-03-27 10:40:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc, identifier: LB47051
2026-03-27 10:40:01 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-27 10:40:01 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV60687%27 HTTP/1.1" 200 None
2026-03-27 10:40:01 [auto1.de] INFO: Scrape type for TV60687: 2
2026-03-27 10:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc3edd7c-0625-5490-8f7a-e716059083dd with identifier: TV60687
2026-03-27 10:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc3edd7c-0625-5490-8f7a-e716059083dd with scrape type 2
2026-03-27 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc3edd7c-0625-5490-8f7a-e716059083dd with scrape type 2
2026-03-27 10:40:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc3edd7c-0625-5490-8f7a-e716059083dd, identifier: TV60687
2026-03-27 10:40:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc with identifier: LB47051
2026-03-27 10:40:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc with identifier: LB47051
2026-03-27 10:40:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d5129b1-1119-5e66-a41a-6cc1cf6b93dc with identifier: LB47051 to the API
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:16:26Z',
'fuel_type': 'diesel',
'id': '8d5129b1-1119-5e66-a41a-6cc1cf6b93dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB47051',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 350327,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-01',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2014}
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB47051%27 HTTP/1.1" 200 None
2026-03-27 10:40:02 [auto1.de] INFO: Saving data for LB47051: {'auction_closing_time': 1774714586.0, 'created_time': 1774294582.005345, 'last_price_update_time': 1774608002.260668}
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB47051') HTTP/1.1" 204 0
2026-03-27 10:40:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc3edd7c-0625-5490-8f7a-e716059083dd with identifier: TV60687
2026-03-27 10:40:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc3edd7c-0625-5490-8f7a-e716059083dd with identifier: TV60687
2026-03-27 10:40:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc3edd7c-0625-5490-8f7a-e716059083dd with identifier: TV60687 to the API
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:03:03Z',
'fuel_type': 'petrol',
'id': 'cc3edd7c-0625-5490-8f7a-e716059083dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV60687',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 149218,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-29',
'seller_name': None,
'title': 'Opel Meriva 1.6 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2008}
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV60687%27 HTTP/1.1" 200 None
2026-03-27 10:40:02 [auto1.de] INFO: Saving data for TV60687: {'auction_closing_time': 1774713783.0, 'created_time': 1773685840.45106, 'last_price_update_time': 1774608002.62966}
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV60687') HTTP/1.1" 204 0
2026-03-27 10:40:02 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR01003%27 HTTP/1.1" 200 None
2026-03-27 10:40:02 [auto1.de] INFO: Scrape type for NR01003: 2
2026-03-27 10:40:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9becfd88-2267-5299-81e8-ce7fd5e06001 with identifier: NR01003
2026-03-27 10:40:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9becfd88-2267-5299-81e8-ce7fd5e06001 with scrape type 2
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9becfd88-2267-5299-81e8-ce7fd5e06001 with scrape type 2
2026-03-27 10:40:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9becfd88-2267-5299-81e8-ce7fd5e06001, identifier: NR01003
2026-03-27 10:40:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21316b4c-87d4-55ae-8e44-c6578ebbc316 with identifier: SD67792
2026-03-27 10:40:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21316b4c-87d4-55ae-8e44-c6578ebbc316 with scrape type 1
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21316b4c-87d4-55ae-8e44-c6578ebbc316
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F13%252Feb13b0f5163338138c24f5668fa7ee4f%252Fpa%252FSD67792_75c73ec396699bd263c18d32e4534dad.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_75c73ec396699bd263c18d32e4534dad.jpg already downloaded
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F13%252Feb13b0f5163338138c24f5668fa7ee4f%252Fpa%252FSD67792_6fd6fd52fcf30c758b498e3cfc5e4014.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_6fd6fd52fcf30c758b498e3cfc5e4014.jpg already downloaded
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F13%252Feb13b0f5163338138c24f5668fa7ee4f%252Fpa%252FSD67792_71577eea174e55c6adeb7ccae70369c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_71577eea174e55c6adeb7ccae70369c5.jpg already downloaded
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F13%252Feb13b0f5163338138c24f5668fa7ee4f%252Fpa%252FSD67792_e92faa084d74acd9ad71a1c353ea6e18.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_e92faa084d74acd9ad71a1c353ea6e18.jpg already downloaded
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F13%252Feb13b0f5163338138c24f5668fa7ee4f%252Fpa%252FSD67792_7bd2681503e6e4acab0dcaaa6cd7df1b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_7bd2681503e6e4acab0dcaaa6cd7df1b.jpg already downloaded
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F13%252Feb13b0f5163338138c24f5668fa7ee4f%252Fpa%252FSD67792_9e5ac7f735cda4825aa8da1f1eee0486.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_9e5ac7f735cda4825aa8da1f1eee0486.jpg already downloaded
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F13%252Feb13b0f5163338138c24f5668fa7ee4f%252Fpa%252FSD67792_3ecd673f7eba169f1ef5cdd168c919a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_3ecd673f7eba169f1ef5cdd168c919a6.jpg already downloaded
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F13%252Feb13b0f5163338138c24f5668fa7ee4f%252Fpa%252FSD67792_9234954d3f8ffad9abd0229300fe5ba3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_9234954d3f8ffad9abd0229300fe5ba3.jpg already downloaded
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F13%252Feb13b0f5163338138c24f5668fa7ee4f%252Fpa%252FSD67792_b49513def5cbbc98c1bb05e012b77f18.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_b49513def5cbbc98c1bb05e012b77f18.jpg already downloaded
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F13%252Feb13b0f5163338138c24f5668fa7ee4f%252Fpa%252FSD67792_ee7629e5839ce033dfd2af5f4b1102d2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_ee7629e5839ce033dfd2af5f4b1102d2.jpg already downloaded
2026-03-27 10:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21316b4c-87d4-55ae-8e44-c6578ebbc316, identifier: SD67792
2026-03-27 10:40:03 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-27 10:40:03 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX68266%27 HTTP/1.1" 200 None
2026-03-27 10:40:03 [auto1.de] INFO: Scrape type for DX68266: 2
2026-03-27 10:40:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd67f9c6-c7b9-5060-b0da-946d9bc75931 with identifier: DX68266
2026-03-27 10:40:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd67f9c6-c7b9-5060-b0da-946d9bc75931 with scrape type 2
2026-03-27 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd67f9c6-c7b9-5060-b0da-946d9bc75931 with scrape type 2
2026-03-27 10:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd67f9c6-c7b9-5060-b0da-946d9bc75931, identifier: DX68266
2026-03-27 10:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9becfd88-2267-5299-81e8-ce7fd5e06001 with identifier: NR01003
2026-03-27 10:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9becfd88-2267-5299-81e8-ce7fd5e06001 with identifier: NR01003
2026-03-27 10:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9becfd88-2267-5299-81e8-ce7fd5e06001 with identifier: NR01003 to the API
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:16:26Z',
'fuel_type': 'petrol',
'id': '9becfd88-2267-5299-81e8-ce7fd5e06001',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR01003',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 142017,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-30',
'seller_name': None,
'title': 'BMW 2er 216i Active Tourer Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2016}
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR01003%27 HTTP/1.1" 200 None
2026-03-27 10:40:03 [auto1.de] INFO: Saving data for NR01003: {'auction_closing_time': 1774714586.0, 'created_time': 1773135853.206265, 'last_price_update_time': 1774608003.647}
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR01003') HTTP/1.1" 204 0
2026-03-27 10:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21316b4c-87d4-55ae-8e44-c6578ebbc316 with identifier: SD67792
2026-03-27 10:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21316b4c-87d4-55ae-8e44-c6578ebbc316 with identifier: SD67792
2026-03-27 10:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21316b4c-87d4-55ae-8e44-c6578ebbc316 with identifier: SD67792 to the API
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SD67792>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:07:22Z',
'fuel_type': 'petrol',
'id': '21316b4c-87d4-55ae-8e44-c6578ebbc316',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD67792',
'listing': 'auction',
'location': 'DE, Schkopau (OT Rassnitz)',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 60280,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_75c73ec396699bd263c18d32e4534dad.jpg',
'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_6fd6fd52fcf30c758b498e3cfc5e4014.jpg',
'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_71577eea174e55c6adeb7ccae70369c5.jpg',
'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_e92faa084d74acd9ad71a1c353ea6e18.jpg',
'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_7bd2681503e6e4acab0dcaaa6cd7df1b.jpg',
'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_9e5ac7f735cda4825aa8da1f1eee0486.jpg',
'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_3ecd673f7eba169f1ef5cdd168c919a6.jpg',
'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_9234954d3f8ffad9abd0229300fe5ba3.jpg',
'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_b49513def5cbbc98c1bb05e012b77f18.jpg',
'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_ee7629e5839ce033dfd2af5f4b1102d2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21316b4c-87d4-55ae-8e44-c6578ebbc316/21316b4c-87d4-55ae-8e44-c6578ebbc316_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69945,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_75c73ec396699bd263c18d32e4534dad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21316b4c-87d4-55ae-8e44-c6578ebbc316/21316b4c-87d4-55ae-8e44-c6578ebbc316_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75244,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_6fd6fd52fcf30c758b498e3cfc5e4014.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21316b4c-87d4-55ae-8e44-c6578ebbc316/21316b4c-87d4-55ae-8e44-c6578ebbc316_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_71577eea174e55c6adeb7ccae70369c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21316b4c-87d4-55ae-8e44-c6578ebbc316/21316b4c-87d4-55ae-8e44-c6578ebbc316_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59570,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_e92faa084d74acd9ad71a1c353ea6e18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21316b4c-87d4-55ae-8e44-c6578ebbc316/21316b4c-87d4-55ae-8e44-c6578ebbc316_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66555,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_7bd2681503e6e4acab0dcaaa6cd7df1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21316b4c-87d4-55ae-8e44-c6578ebbc316/21316b4c-87d4-55ae-8e44-c6578ebbc316_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_9e5ac7f735cda4825aa8da1f1eee0486.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21316b4c-87d4-55ae-8e44-c6578ebbc316/21316b4c-87d4-55ae-8e44-c6578ebbc316_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58581,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_3ecd673f7eba169f1ef5cdd168c919a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21316b4c-87d4-55ae-8e44-c6578ebbc316/21316b4c-87d4-55ae-8e44-c6578ebbc316_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_9234954d3f8ffad9abd0229300fe5ba3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21316b4c-87d4-55ae-8e44-c6578ebbc316/21316b4c-87d4-55ae-8e44-c6578ebbc316_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79150,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_b49513def5cbbc98c1bb05e012b77f18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21316b4c-87d4-55ae-8e44-c6578ebbc316/21316b4c-87d4-55ae-8e44-c6578ebbc316_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67820,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/13/eb13b0f5163338138c24f5668fa7ee4f/pa/SD67792_ee7629e5839ce033dfd2af5f4b1102d2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-01-02',
'seats_number': 4,
'seller_name': None,
'title': 'Volkswagen Beetle 1.2 TSI Design',
'transmission': 'manual',
'trim': 'Design',
'year': 2013}
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD67792%27 HTTP/1.1" 200 None
2026-03-27 10:40:04 [auto1.de] INFO: Saving data for SD67792: {'created_time': 1774608004.102277, 'last_price_update_time': 1774608004.10229, 'auction_closing_time': 1774714042.0}
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD67792') HTTP/1.1" 204 0
2026-03-27 10:40:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd67f9c6-c7b9-5060-b0da-946d9bc75931 with identifier: DX68266
2026-03-27 10:40:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd67f9c6-c7b9-5060-b0da-946d9bc75931 with identifier: DX68266
2026-03-27 10:40:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd67f9c6-c7b9-5060-b0da-946d9bc75931 with identifier: DX68266 to the API
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 121,
'expiration_date': '2026-03-28T16:52:19Z',
'fuel_type': 'diesel',
'id': 'bd67f9c6-c7b9-5060-b0da-946d9bc75931',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX68266',
'listing': 'auction',
'make': 'Renault',
'model': 'Trafic',
'odometer': 137524,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-07',
'seller_name': None,
'title': 'Renault Trafic 1.6 dCi L1H1 2,7t Expression',
'transmission': 'manual',
'trim': 'L1H1 2,7t Expression',
'year': 2019}
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX68266%27 HTTP/1.1" 200 None
2026-03-27 10:40:04 [auto1.de] INFO: Saving data for DX68266: {'auction_closing_time': 1774716739.0, 'created_time': 1774292886.596666, 'last_price_update_time': 1774608004.492673}
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX68266') HTTP/1.1" 204 0
2026-03-27 10:40:04 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-27 10:40:04 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-27 10:40:04 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-27 10:40:04 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-27 10:40:04 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09257%27 HTTP/1.1" 200 None
2026-03-27 10:40:04 [auto1.de] INFO: Scrape type for LL09257: 2
2026-03-27 10:40:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e with identifier: LL09257
2026-03-27 10:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e with scrape type 2
2026-03-27 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e with scrape type 2
2026-03-27 10:40:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e, identifier: LL09257
2026-03-27 10:40:04 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-27 10:40:04 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-27 10:40:04 [auto1.de] INFO: Found listing with ID: KL29911
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL29911%27 HTTP/1.1" 200 None
2026-03-27 10:40:04 [auto1.de] INFO: Scrape type for KL29911: 1
2026-03-27 10:40:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e with identifier: LL09257
2026-03-27 10:40:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e with identifier: LL09257
2026-03-27 10:40:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e with identifier: LL09257 to the API
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-28T16:05:43Z',
'fuel_type': 'petrol',
'id': 'c3e8175d-8c6a-5313-8e5a-b5b51cff7f6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL09257',
'listing': 'auction',
'make': 'Cupra',
'model': 'Ateca',
'odometer': 44520,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-01',
'seller_name': None,
'title': 'Cupra Ateca 2.0 TSI 4Drive',
'transmission': 'automatic',
'trim': '4Drive',
'year': 2020}
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09257%27 HTTP/1.1" 200 None
2026-03-27 10:40:04 [auto1.de] INFO: Saving data for LL09257: {'auction_closing_time': 1774713943.0, 'created_time': 1773427808.751477, 'last_price_update_time': 1774608004.995091}
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL09257') HTTP/1.1" 204 0
2026-03-27 10:40:05 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR53020%27 HTTP/1.1" 200 None
2026-03-27 10:40:05 [auto1.de] INFO: Scrape type for AR53020: 2
2026-03-27 10:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32dbe053-06ff-56fa-aa4b-843394f9b659 with identifier: AR53020
2026-03-27 10:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32dbe053-06ff-56fa-aa4b-843394f9b659 with scrape type 2
2026-03-27 10:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32dbe053-06ff-56fa-aa4b-843394f9b659 with scrape type 2
2026-03-27 10:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32dbe053-06ff-56fa-aa4b-843394f9b659, identifier: AR53020
2026-03-27 10:40:05 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-27 10:40:05 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-27 10:40:05 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-27 10:40:05 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-27 10:40:05 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-27 10:40:05 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-27 10:40:05 [auto1.de] INFO: Found listing with ID: CK84203
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK84203%27 HTTP/1.1" 200 None
2026-03-27 10:40:05 [auto1.de] INFO: Scrape type for CK84203: 1
2026-03-27 10:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32dbe053-06ff-56fa-aa4b-843394f9b659 with identifier: AR53020
2026-03-27 10:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32dbe053-06ff-56fa-aa4b-843394f9b659 with identifier: AR53020
2026-03-27 10:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32dbe053-06ff-56fa-aa4b-843394f9b659 with identifier: AR53020 to the API
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 286,
'expiration_date': '2026-03-28T16:35:35Z',
'fuel_type': 'diesel',
'id': '32dbe053-06ff-56fa-aa4b-843394f9b659',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR53020',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 127760,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-22',
'seller_name': None,
'title': 'Audi A6 50 TDI Mild-Hybrid quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR53020%27 HTTP/1.1" 200 None
2026-03-27 10:40:05 [auto1.de] INFO: Saving data for AR53020: {'auction_closing_time': 1774715735.0, 'created_time': 1773427561.411427, 'last_price_update_time': 1774608005.476838}
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR53020') HTTP/1.1" 204 0
2026-03-27 10:40:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:05 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-27 10:40:05 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE21884%27 HTTP/1.1" 200 None
2026-03-27 10:40:05 [auto1.de] INFO: Scrape type for AE21884: 2
2026-03-27 10:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0250675-1b3d-5f97-92c7-d60ee3082ece with identifier: AE21884
2026-03-27 10:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0250675-1b3d-5f97-92c7-d60ee3082ece with scrape type 2
2026-03-27 10:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0250675-1b3d-5f97-92c7-d60ee3082ece with scrape type 2
2026-03-27 10:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0250675-1b3d-5f97-92c7-d60ee3082ece, identifier: AE21884
2026-03-27 10:40:05 [auto1.de] INFO: Found listing with ID: TH70911
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH70911%27 HTTP/1.1" 200 None
2026-03-27 10:40:05 [auto1.de] INFO: Scrape type for TH70911: 2
2026-03-27 10:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ecd3a4c-5a89-5958-bad3-68d67afded52 with identifier: TH70911
2026-03-27 10:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ecd3a4c-5a89-5958-bad3-68d67afded52 with scrape type 2
2026-03-27 10:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ecd3a4c-5a89-5958-bad3-68d67afded52 with scrape type 2
2026-03-27 10:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ecd3a4c-5a89-5958-bad3-68d67afded52, identifier: TH70911
2026-03-27 10:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0250675-1b3d-5f97-92c7-d60ee3082ece with identifier: AE21884
2026-03-27 10:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0250675-1b3d-5f97-92c7-d60ee3082ece with identifier: AE21884
2026-03-27 10:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0250675-1b3d-5f97-92c7-d60ee3082ece with identifier: AE21884 to the API
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:08:49Z',
'fuel_type': 'diesel',
'id': 'c0250675-1b3d-5f97-92c7-d60ee3082ece',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE21884',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 182888,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-06',
'seller_name': None,
'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2015}
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE21884%27 HTTP/1.1" 200 None
2026-03-27 10:40:06 [auto1.de] INFO: Saving data for AE21884: {'auction_closing_time': 1774714129.0, 'created_time': 1773304264.800252, 'last_price_update_time': 1774608006.156854}
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE21884') HTTP/1.1" 204 0
2026-03-27 10:40:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ecd3a4c-5a89-5958-bad3-68d67afded52 with identifier: TH70911
2026-03-27 10:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ecd3a4c-5a89-5958-bad3-68d67afded52 with identifier: TH70911
2026-03-27 10:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ecd3a4c-5a89-5958-bad3-68d67afded52 with identifier: TH70911 to the API
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:40:24Z',
'fuel_type': 'diesel',
'id': '3ecd3a4c-5a89-5958-bad3-68d67afded52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH70911',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 181201,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-08',
'seller_name': None,
'title': 'Ford Focus 1.5 EcoBlue TDCi Cool&Connect',
'transmission': 'manual',
'trim': 'Cool&Connect',
'year': 2019}
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH70911%27 HTTP/1.1" 200 None
2026-03-27 10:40:06 [auto1.de] INFO: Saving data for TH70911: {'auction_closing_time': 1774716024.0, 'created_time': 1773426820.669321, 'last_price_update_time': 1774608006.48817}
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH70911') HTTP/1.1" 204 0
2026-03-27 10:40:06 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-27 10:40:06 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH85992%27 HTTP/1.1" 200 None
2026-03-27 10:40:06 [auto1.de] INFO: Scrape type for YH85992: 2
2026-03-27 10:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 039e5412-a506-5aa4-9a84-a640663eb484 with identifier: YH85992
2026-03-27 10:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 039e5412-a506-5aa4-9a84-a640663eb484 with scrape type 2
2026-03-27 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 039e5412-a506-5aa4-9a84-a640663eb484 with scrape type 2
2026-03-27 10:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 039e5412-a506-5aa4-9a84-a640663eb484, identifier: YH85992
2026-03-27 10:40:06 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-27 10:40:06 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-27 10:40:06 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-27 10:40:06 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE40568%27 HTTP/1.1" 200 None
2026-03-27 10:40:06 [auto1.de] INFO: Scrape type for ZE40568: 2
2026-03-27 10:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e with identifier: ZE40568
2026-03-27 10:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e with scrape type 2
2026-03-27 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e with scrape type 2
2026-03-27 10:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e, identifier: ZE40568
2026-03-27 10:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 039e5412-a506-5aa4-9a84-a640663eb484 with identifier: YH85992
2026-03-27 10:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 039e5412-a506-5aa4-9a84-a640663eb484 with identifier: YH85992
2026-03-27 10:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 039e5412-a506-5aa4-9a84-a640663eb484 with identifier: YH85992 to the API
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:16:32Z',
'fuel_type': 'diesel',
'id': '039e5412-a506-5aa4-9a84-a640663eb484',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH85992',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Transporter',
'odometer': 217653,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-26',
'seller_name': None,
'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten',
'transmission': 'manual',
'trim': 'Kasten',
'year': 2011}
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH85992%27 HTTP/1.1" 200 None
2026-03-27 10:40:07 [auto1.de] INFO: Saving data for YH85992: {'auction_closing_time': 1774714592.0, 'created_time': 1773858652.811359, 'last_price_update_time': 1774608007.060132}
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH85992') HTTP/1.1" 204 0
2026-03-27 10:40:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e with identifier: ZE40568
2026-03-27 10:40:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e with identifier: ZE40568
2026-03-27 10:40:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 018a3c7a-e421-5e8e-8bdb-bfa78fd0594e with identifier: ZE40568 to the API
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:50:29Z',
'fuel_type': 'diesel',
'id': '018a3c7a-e421-5e8e-8bdb-bfa78fd0594e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE40568',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 189025,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-15',
'seller_name': None,
'title': 'BMW 3er 320d Luxury Line',
'transmission': 'automatic',
'trim': 'Luxury Line',
'year': 2017}
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE40568%27 HTTP/1.1" 200 None
2026-03-27 10:40:07 [auto1.de] INFO: Saving data for ZE40568: {'auction_closing_time': 1774716629.0, 'created_time': 1773399998.814952, 'last_price_update_time': 1774608007.421427}
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE40568') HTTP/1.1" 204 0
2026-03-27 10:40:07 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA06109%27 HTTP/1.1" 200 None
2026-03-27 10:40:07 [auto1.de] INFO: Scrape type for SA06109: 2
2026-03-27 10:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 698628e7-16f0-58dc-a7c7-d9cd3790794b with identifier: SA06109
2026-03-27 10:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 698628e7-16f0-58dc-a7c7-d9cd3790794b with scrape type 2
2026-03-27 10:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 698628e7-16f0-58dc-a7c7-d9cd3790794b with scrape type 2
2026-03-27 10:40:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 698628e7-16f0-58dc-a7c7-d9cd3790794b, identifier: SA06109
2026-03-27 10:40:07 [scrapy.extensions.logstats] INFO: Crawled 319 pages (at 9 pages/min), scraped 480 items (at 91 items/min)
2026-03-27 10:40:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-27 10:40:07 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-27 10:40:07 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK97856%27 HTTP/1.1" 200 None
2026-03-27 10:40:07 [auto1.de] INFO: Scrape type for FK97856: 2
2026-03-27 10:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d6e9f46-25bd-5649-84d0-89374332d38e with identifier: FK97856
2026-03-27 10:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d6e9f46-25bd-5649-84d0-89374332d38e with scrape type 2
2026-03-27 10:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d6e9f46-25bd-5649-84d0-89374332d38e with scrape type 2
2026-03-27 10:40:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d6e9f46-25bd-5649-84d0-89374332d38e, identifier: FK97856
2026-03-27 10:40:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 698628e7-16f0-58dc-a7c7-d9cd3790794b with identifier: SA06109
2026-03-27 10:40:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 698628e7-16f0-58dc-a7c7-d9cd3790794b with identifier: SA06109
2026-03-27 10:40:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 698628e7-16f0-58dc-a7c7-d9cd3790794b with identifier: SA06109 to the API
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-28T16:37:06Z',
'fuel_type': 'diesel',
'id': '698628e7-16f0-58dc-a7c7-d9cd3790794b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA06109',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLS-Klasse',
'odometer': 180130,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-10',
'seller_name': None,
'title': 'Mercedes-Benz CLS-Klasse CLS 350 d Shooting Brake BlueEfficiency',
'transmission': 'automatic',
'trim': 'BlueEfficiency',
'year': 2013}
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA06109%27 HTTP/1.1" 200 None
2026-03-27 10:40:08 [auto1.de] INFO: Saving data for SA06109: {'auction_closing_time': 1774715826.0, 'created_time': 1773379830.726534, 'last_price_update_time': 1774608008.001833}
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA06109') HTTP/1.1" 204 0
2026-03-27 10:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d6e9f46-25bd-5649-84d0-89374332d38e with identifier: FK97856
2026-03-27 10:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d6e9f46-25bd-5649-84d0-89374332d38e with identifier: FK97856
2026-03-27 10:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d6e9f46-25bd-5649-84d0-89374332d38e with identifier: FK97856 to the API
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 77,
'expiration_date': '2026-03-28T16:47:59Z',
'fuel_type': 'petrol',
'id': '4d6e9f46-25bd-5649-84d0-89374332d38e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK97856',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 102102,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-11-23',
'seller_name': None,
'title': 'Hyundai i10 1.2 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2008}
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK97856%27 HTTP/1.1" 200 None
2026-03-27 10:40:08 [auto1.de] INFO: Saving data for FK97856: {'auction_closing_time': 1774716479.0, 'created_time': 1773772242.563258, 'last_price_update_time': 1774608008.444183}
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK97856') HTTP/1.1" 204 0
2026-03-27 10:40:08 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ48596%27 HTTP/1.1" 200 None
2026-03-27 10:40:08 [auto1.de] INFO: Scrape type for SZ48596: 2
2026-03-27 10:40:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1 with identifier: SZ48596
2026-03-27 10:40:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1 with scrape type 2
2026-03-27 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1 with scrape type 2
2026-03-27 10:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1, identifier: SZ48596
2026-03-27 10:40:08 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-27 10:40:08 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE44185%27 HTTP/1.1" 200 None
2026-03-27 10:40:08 [auto1.de] INFO: Scrape type for WE44185: 2
2026-03-27 10:40:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d with identifier: WE44185
2026-03-27 10:40:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d with scrape type 2
2026-03-27 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d with scrape type 2
2026-03-27 10:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d, identifier: WE44185
2026-03-27 10:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1 with identifier: SZ48596
2026-03-27 10:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1 with identifier: SZ48596
2026-03-27 10:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8aca3659-3eeb-5cbe-bc35-caa6efafbfc1 with identifier: SZ48596 to the API
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:44:49Z',
'fuel_type': 'diesel',
'id': '8aca3659-3eeb-5cbe-bc35-caa6efafbfc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ48596',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 118336,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-07',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Cruise FWD',
'transmission': 'automatic',
'trim': 'Cruise FWD',
'year': 2020}
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ48596%27 HTTP/1.1" 200 None
2026-03-27 10:40:09 [auto1.de] INFO: Saving data for SZ48596: {'auction_closing_time': 1774716289.0, 'created_time': 1773304168.733015, 'last_price_update_time': 1774608009.010467}
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ48596') HTTP/1.1" 204 0
2026-03-27 10:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d with identifier: WE44185
2026-03-27 10:40:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d with identifier: WE44185
2026-03-27 10:40:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d with identifier: WE44185 to the API
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:35:04Z',
'fuel_type': 'petrol',
'id': '1e6f1be7-ba4d-5b24-8c21-94fabf56ce3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE44185',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 88458,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-06-15',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2005}
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE44185%27 HTTP/1.1" 200 None
2026-03-27 10:40:09 [auto1.de] INFO: Saving data for WE44185: {'auction_closing_time': 1774715704.0, 'created_time': 1774290657.325942, 'last_price_update_time': 1774608009.389875}
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE44185') HTTP/1.1" 204 0
2026-03-27 10:40:09 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33073%27 HTTP/1.1" 200 None
2026-03-27 10:40:09 [auto1.de] INFO: Scrape type for EC33073: 2
2026-03-27 10:40:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daac7975-829c-5726-8424-3d07b3a3d396 with identifier: EC33073
2026-03-27 10:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daac7975-829c-5726-8424-3d07b3a3d396 with scrape type 2
2026-03-27 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daac7975-829c-5726-8424-3d07b3a3d396 with scrape type 2
2026-03-27 10:40:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: daac7975-829c-5726-8424-3d07b3a3d396, identifier: EC33073
2026-03-27 10:40:09 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 132.067(s), this was the 1st time calling it.
2026-03-27 10:40:09 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.378209070951205 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:40:09 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-27 10:40:09 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB90216%27 HTTP/1.1" 200 None
2026-03-27 10:40:09 [auto1.de] INFO: Scrape type for XB90216: 2
2026-03-27 10:40:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c44d5c4b-2c47-59f9-86f8-c1b4a6278683 with identifier: XB90216
2026-03-27 10:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c44d5c4b-2c47-59f9-86f8-c1b4a6278683 with scrape type 2
2026-03-27 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c44d5c4b-2c47-59f9-86f8-c1b4a6278683 with scrape type 2
2026-03-27 10:40:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c44d5c4b-2c47-59f9-86f8-c1b4a6278683, identifier: XB90216
2026-03-27 10:40:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: daac7975-829c-5726-8424-3d07b3a3d396 with identifier: EC33073
2026-03-27 10:40:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: daac7975-829c-5726-8424-3d07b3a3d396 with identifier: EC33073
2026-03-27 10:40:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: daac7975-829c-5726-8424-3d07b3a3d396 with identifier: EC33073 to the API
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:54:43Z',
'fuel_type': 'petrol',
'id': 'daac7975-829c-5726-8424-3d07b3a3d396',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC33073',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 68450,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-06',
'seller_name': None,
'title': 'Volkswagen Polo 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2020}
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33073%27 HTTP/1.1" 200 None
2026-03-27 10:40:09 [auto1.de] INFO: Saving data for EC33073: {'auction_closing_time': 1774716883.0, 'created_time': 1774293756.55904, 'last_price_update_time': 1774608009.978748}
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC33073') HTTP/1.1" 204 0
2026-03-27 10:40:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c44d5c4b-2c47-59f9-86f8-c1b4a6278683 with identifier: XB90216
2026-03-27 10:40:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c44d5c4b-2c47-59f9-86f8-c1b4a6278683 with identifier: XB90216
2026-03-27 10:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c44d5c4b-2c47-59f9-86f8-c1b4a6278683 with identifier: XB90216 to the API
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:03:45Z',
'fuel_type': 'diesel',
'id': 'c44d5c4b-2c47-59f9-86f8-c1b4a6278683',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB90216',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 110426,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-25',
'seller_name': None,
'title': 'Opel Mokka 1.7 CDTI Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2015}
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB90216%27 HTTP/1.1" 200 None
2026-03-27 10:40:10 [auto1.de] INFO: Saving data for XB90216: {'auction_closing_time': 1774713825.0, 'created_time': 1774291339.257916, 'last_price_update_time': 1774608010.3374}
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB90216') HTTP/1.1" 204 0
2026-03-27 10:40:10 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR06917%27 HTTP/1.1" 200 None
2026-03-27 10:40:10 [auto1.de] INFO: Scrape type for LR06917: 2
2026-03-27 10:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a761a09-404b-5f6d-973f-a77d7fd03a97 with identifier: LR06917
2026-03-27 10:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a761a09-404b-5f6d-973f-a77d7fd03a97 with scrape type 2
2026-03-27 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a761a09-404b-5f6d-973f-a77d7fd03a97 with scrape type 2
2026-03-27 10:40:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a761a09-404b-5f6d-973f-a77d7fd03a97, identifier: LR06917
2026-03-27 10:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a761a09-404b-5f6d-973f-a77d7fd03a97 with identifier: LR06917
2026-03-27 10:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a761a09-404b-5f6d-973f-a77d7fd03a97 with identifier: LR06917
2026-03-27 10:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a761a09-404b-5f6d-973f-a77d7fd03a97 with identifier: LR06917 to the API
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:20:19Z',
'fuel_type': 'diesel',
'id': '3a761a09-404b-5f6d-973f-a77d7fd03a97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR06917',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 247027,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-23',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
'transmission': 'automatic',
'trim': 'GTD BlueMotion Tech',
'year': 2015}
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR06917%27 HTTP/1.1" 200 None
2026-03-27 10:40:10 [auto1.de] INFO: Saving data for LR06917: {'auction_closing_time': 1774714819.0, 'created_time': 1773859875.735783, 'last_price_update_time': 1774608010.829764}
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR06917') HTTP/1.1" 204 0
2026-03-27 10:40:10 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR11100%27 HTTP/1.1" 200 None
2026-03-27 10:40:10 [auto1.de] INFO: Scrape type for CR11100: 2
2026-03-27 10:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fd1872c-6273-5317-b4bf-3c69666c1e1a with identifier: CR11100
2026-03-27 10:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fd1872c-6273-5317-b4bf-3c69666c1e1a with scrape type 2
2026-03-27 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fd1872c-6273-5317-b4bf-3c69666c1e1a with scrape type 2
2026-03-27 10:40:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fd1872c-6273-5317-b4bf-3c69666c1e1a, identifier: CR11100
2026-03-27 10:40:10 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 10513 | hits on page: 40
2026-03-27 10:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fd1872c-6273-5317-b4bf-3c69666c1e1a with identifier: CR11100
2026-03-27 10:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fd1872c-6273-5317-b4bf-3c69666c1e1a with identifier: CR11100
2026-03-27 10:40:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fd1872c-6273-5317-b4bf-3c69666c1e1a with identifier: CR11100 to the API
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:59:09Z',
'fuel_type': 'diesel',
'id': '1fd1872c-6273-5317-b4bf-3c69666c1e1a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR11100',
'listing': 'auction',
'make': 'Kia',
'model': "cee'd",
'odometer': 222827,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-08',
'seller_name': None,
'title': "Kia cee'd 1.6 CRDi GT Line",
'transmission': 'manual',
'trim': 'GT Line',
'year': 2016}
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR11100%27 HTTP/1.1" 200 None
2026-03-27 10:40:11 [auto1.de] INFO: Saving data for CR11100: {'auction_closing_time': 1774717149.0, 'created_time': 1773303513.283578, 'last_price_update_time': 1774608011.347393}
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR11100') HTTP/1.1" 204 0
2026-03-27 10:40:11 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY09817%27 HTTP/1.1" 200 None
2026-03-27 10:40:11 [auto1.de] INFO: Scrape type for NY09817: 1
2026-03-27 10:40:11 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN32134%27 HTTP/1.1" 200 None
2026-03-27 10:40:11 [auto1.de] INFO: Scrape type for XN32134: 2
2026-03-27 10:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d with identifier: XN32134
2026-03-27 10:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d with scrape type 2
2026-03-27 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d with scrape type 2
2026-03-27 10:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d, identifier: XN32134
2026-03-27 10:40:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d with identifier: XN32134
2026-03-27 10:40:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d with identifier: XN32134
2026-03-27 10:40:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d with identifier: XN32134 to the API
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:10:04Z',
'fuel_type': 'petrol',
'id': '40e2bbe3-6395-5dae-b93b-29a6f3fb1f7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN32134',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 55805,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-27',
'seller_name': None,
'title': 'Kia Sportage 2.0 LX 2WD',
'transmission': 'manual',
'trim': 'LX 2WD',
'year': 2009}
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN32134%27 HTTP/1.1" 200 None
2026-03-27 10:40:11 [auto1.de] INFO: Saving data for XN32134: {'auction_closing_time': 1774714204.0, 'created_time': 1774290706.952195, 'last_price_update_time': 1774608011.848331}
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN32134') HTTP/1.1" 204 0
2026-03-27 10:40:11 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-27 10:40:11 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB01944%27 HTTP/1.1" 200 None
2026-03-27 10:40:11 [auto1.de] INFO: Scrape type for EB01944: 2
2026-03-27 10:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebe88af6-9a60-5dfe-a689-4ef75fbf16e1 with identifier: EB01944
2026-03-27 10:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebe88af6-9a60-5dfe-a689-4ef75fbf16e1 with scrape type 2
2026-03-27 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebe88af6-9a60-5dfe-a689-4ef75fbf16e1 with scrape type 2
2026-03-27 10:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebe88af6-9a60-5dfe-a689-4ef75fbf16e1, identifier: EB01944
2026-03-27 10:40:11 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT04304%27 HTTP/1.1" 200 None
2026-03-27 10:40:11 [auto1.de] INFO: Scrape type for YT04304: 2
2026-03-27 10:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 014c542a-9e88-59b8-83a5-bf76c553ee3e with identifier: YT04304
2026-03-27 10:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 014c542a-9e88-59b8-83a5-bf76c553ee3e with scrape type 2
2026-03-27 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 014c542a-9e88-59b8-83a5-bf76c553ee3e with scrape type 2
2026-03-27 10:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 014c542a-9e88-59b8-83a5-bf76c553ee3e, identifier: YT04304
2026-03-27 10:40:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebe88af6-9a60-5dfe-a689-4ef75fbf16e1 with identifier: EB01944
2026-03-27 10:40:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebe88af6-9a60-5dfe-a689-4ef75fbf16e1 with identifier: EB01944
2026-03-27 10:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebe88af6-9a60-5dfe-a689-4ef75fbf16e1 with identifier: EB01944 to the API
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:41:52Z',
'fuel_type': 'petrol',
'id': 'ebe88af6-9a60-5dfe-a689-4ef75fbf16e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB01944',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 87327,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-13',
'seller_name': None,
'title': 'BMW 1er 114i',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB01944%27 HTTP/1.1" 200 None
2026-03-27 10:40:12 [auto1.de] INFO: Saving data for EB01944: {'auction_closing_time': 1774716112.0, 'created_time': 1773136467.123687, 'last_price_update_time': 1774608012.455751}
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB01944') HTTP/1.1" 204 0
2026-03-27 10:40:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 014c542a-9e88-59b8-83a5-bf76c553ee3e with identifier: YT04304
2026-03-27 10:40:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 014c542a-9e88-59b8-83a5-bf76c553ee3e with identifier: YT04304
2026-03-27 10:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 014c542a-9e88-59b8-83a5-bf76c553ee3e with identifier: YT04304 to the API
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:37:44Z',
'fuel_type': 'diesel',
'id': '014c542a-9e88-59b8-83a5-bf76c553ee3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT04304',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 153410,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-12',
'seller_name': None,
'title': 'BMW 1er 116d Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2018}
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT04304%27 HTTP/1.1" 200 None
2026-03-27 10:40:13 [auto1.de] INFO: Saving data for YT04304: {'auction_closing_time': 1774715864.0, 'created_time': 1773304367.687804, 'last_price_update_time': 1774608013.002691}
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT04304') HTTP/1.1" 204 0
2026-03-27 10:40:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:13 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-27 10:40:13 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL47086%27 HTTP/1.1" 200 None
2026-03-27 10:40:13 [auto1.de] INFO: Scrape type for SL47086: 2
2026-03-27 10:40:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62fd87bc-91b6-5aac-adba-619880342280 with identifier: SL47086
2026-03-27 10:40:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62fd87bc-91b6-5aac-adba-619880342280 with scrape type 2
2026-03-27 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62fd87bc-91b6-5aac-adba-619880342280 with scrape type 2
2026-03-27 10:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62fd87bc-91b6-5aac-adba-619880342280, identifier: SL47086
2026-03-27 10:40:13 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ94089%27 HTTP/1.1" 200 None
2026-03-27 10:40:13 [auto1.de] INFO: Scrape type for EZ94089: 2
2026-03-27 10:40:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99c0cb98-7ff4-5e36-812b-ef5d45be10ba with identifier: EZ94089
2026-03-27 10:40:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99c0cb98-7ff4-5e36-812b-ef5d45be10ba with scrape type 2
2026-03-27 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99c0cb98-7ff4-5e36-812b-ef5d45be10ba with scrape type 2
2026-03-27 10:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99c0cb98-7ff4-5e36-812b-ef5d45be10ba, identifier: EZ94089
2026-03-27 10:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62fd87bc-91b6-5aac-adba-619880342280 with identifier: SL47086
2026-03-27 10:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62fd87bc-91b6-5aac-adba-619880342280 with identifier: SL47086
2026-03-27 10:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62fd87bc-91b6-5aac-adba-619880342280 with identifier: SL47086 to the API
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:58:07Z',
'fuel_type': 'diesel',
'id': '62fd87bc-91b6-5aac-adba-619880342280',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL47086',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 59333,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-19',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 220 d 4Matic Progressive',
'transmission': 'automatic',
'trim': '4Matic Progressive',
'year': 2022}
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL47086%27 HTTP/1.1" 200 None
2026-03-27 10:40:13 [auto1.de] INFO: Saving data for SL47086: {'auction_closing_time': 1774717087.0, 'created_time': 1773859232.539409, 'last_price_update_time': 1774608013.604754}
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL47086') HTTP/1.1" 204 0
2026-03-27 10:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99c0cb98-7ff4-5e36-812b-ef5d45be10ba with identifier: EZ94089
2026-03-27 10:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99c0cb98-7ff4-5e36-812b-ef5d45be10ba with identifier: EZ94089
2026-03-27 10:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99c0cb98-7ff4-5e36-812b-ef5d45be10ba with identifier: EZ94089 to the API
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:25:20Z',
'fuel_type': 'petrol',
'id': '99c0cb98-7ff4-5e36-812b-ef5d45be10ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ94089',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 103194,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-21',
'seller_name': None,
'title': 'Opel Meriva 1.6 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2010}
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ94089%27 HTTP/1.1" 200 None
2026-03-27 10:40:13 [auto1.de] INFO: Saving data for EZ94089: {'auction_closing_time': 1774715120.0, 'created_time': 1774349363.88541, 'last_price_update_time': 1774608013.986165}
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ94089') HTTP/1.1" 204 0
2026-03-27 10:40:14 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-27 10:40:14 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06043%27 HTTP/1.1" 200 None
2026-03-27 10:40:14 [auto1.de] INFO: Scrape type for VN06043: 2
2026-03-27 10:40:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d with identifier: VN06043
2026-03-27 10:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d with scrape type 2
2026-03-27 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d with scrape type 2
2026-03-27 10:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d, identifier: VN06043
2026-03-27 10:40:14 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-27 10:40:14 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS84546%27 HTTP/1.1" 200 None
2026-03-27 10:40:14 [auto1.de] INFO: Scrape type for ZS84546: 2
2026-03-27 10:40:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14936224-b559-5c51-b0ee-14f74714156d with identifier: ZS84546
2026-03-27 10:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14936224-b559-5c51-b0ee-14f74714156d with scrape type 2
2026-03-27 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14936224-b559-5c51-b0ee-14f74714156d with scrape type 2
2026-03-27 10:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14936224-b559-5c51-b0ee-14f74714156d, identifier: ZS84546
2026-03-27 10:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CK84203/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d with identifier: VN06043
2026-03-27 10:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d with identifier: VN06043
2026-03-27 10:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d with identifier: VN06043 to the API
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 286,
'expiration_date': '2026-03-28T16:12:47Z',
'fuel_type': 'diesel',
'id': '7cb83a8e-ed6a-5e90-99d2-d60c2de69e2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN06043',
'listing': 'auction',
'make': 'Audi',
'model': 'Q7',
'odometer': 63125,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-16',
'seller_name': None,
'title': 'Audi Q7 50 TDI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2021}
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06043%27 HTTP/1.1" 200 None
2026-03-27 10:40:14 [auto1.de] INFO: Saving data for VN06043: {'auction_closing_time': 1774714367.0, 'created_time': 1773136038.289438, 'last_price_update_time': 1774608014.585985}
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN06043') HTTP/1.1" 204 0
2026-03-27 10:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14936224-b559-5c51-b0ee-14f74714156d with identifier: ZS84546
2026-03-27 10:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14936224-b559-5c51-b0ee-14f74714156d with identifier: ZS84546
2026-03-27 10:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14936224-b559-5c51-b0ee-14f74714156d with identifier: ZS84546 to the API
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 69,
'expiration_date': '2026-03-28T16:15:18Z',
'fuel_type': 'petrol',
'id': '14936224-b559-5c51-b0ee-14f74714156d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS84546',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 64978,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-14',
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid Club',
'transmission': 'manual',
'trim': 'Club',
'year': 2014}
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS84546%27 HTTP/1.1" 200 None
2026-03-27 10:40:14 [auto1.de] INFO: Saving data for ZS84546: {'auction_closing_time': 1774714518.0, 'created_time': 1773400086.235863, 'last_price_update_time': 1774608014.95326}
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS84546') HTTP/1.1" 204 0
2026-03-27 10:40:14 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-27 10:40:14 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF52264%27 HTTP/1.1" 200 None
2026-03-27 10:40:14 [auto1.de] INFO: Scrape type for TF52264: 2
2026-03-27 10:40:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4428ba84-f3e1-5194-bd76-54dfe1495501 with identifier: TF52264
2026-03-27 10:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4428ba84-f3e1-5194-bd76-54dfe1495501 with scrape type 2
2026-03-27 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4428ba84-f3e1-5194-bd76-54dfe1495501 with scrape type 2
2026-03-27 10:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4428ba84-f3e1-5194-bd76-54dfe1495501, identifier: TF52264
2026-03-27 10:40:15 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH26484%27 HTTP/1.1" 200 None
2026-03-27 10:40:15 [auto1.de] INFO: Scrape type for SH26484: 2
2026-03-27 10:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e with identifier: SH26484
2026-03-27 10:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e with scrape type 2
2026-03-27 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e with scrape type 2
2026-03-27 10:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e, identifier: SH26484
2026-03-27 10:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4428ba84-f3e1-5194-bd76-54dfe1495501 with identifier: TF52264
2026-03-27 10:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4428ba84-f3e1-5194-bd76-54dfe1495501 with identifier: TF52264
2026-03-27 10:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4428ba84-f3e1-5194-bd76-54dfe1495501 with identifier: TF52264 to the API
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:22:27Z',
'fuel_type': 'diesel',
'id': '4428ba84-f3e1-5194-bd76-54dfe1495501',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF52264',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 150948,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-23',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2011}
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF52264%27 HTTP/1.1" 200 None
2026-03-27 10:40:15 [auto1.de] INFO: Saving data for TF52264: {'auction_closing_time': 1774714947.0, 'created_time': 1773400604.75493, 'last_price_update_time': 1774608015.520995}
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF52264') HTTP/1.1" 204 0
2026-03-27 10:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e with identifier: SH26484
2026-03-27 10:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e with identifier: SH26484
2026-03-27 10:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e with identifier: SH26484 to the API
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:32:15Z',
'fuel_type': 'petrol',
'id': '9de9e5d4-95e4-5fdb-bbc0-901ae81cb29e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH26484',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 152397,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-27',
'seller_name': None,
'title': 'Skoda Octavia 1.5 TSI ACT Soleil',
'transmission': 'automatic',
'trim': 'Soleil',
'year': 2020}
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH26484%27 HTTP/1.1" 200 None
2026-03-27 10:40:15 [auto1.de] INFO: Saving data for SH26484: {'auction_closing_time': 1774715535.0, 'created_time': 1773819034.431577, 'last_price_update_time': 1774608015.857869}
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH26484') HTTP/1.1" 204 0
2026-03-27 10:40:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:40:15 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-27 10:40:15 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY82930%27 HTTP/1.1" 200 None
2026-03-27 10:40:15 [auto1.de] INFO: Scrape type for TY82930: 2
2026-03-27 10:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2de1ce19-0924-50d8-bbd5-650c94288ed5 with identifier: TY82930
2026-03-27 10:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2de1ce19-0924-50d8-bbd5-650c94288ed5 with scrape type 2
2026-03-27 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2de1ce19-0924-50d8-bbd5-650c94288ed5 with scrape type 2
2026-03-27 10:40:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2de1ce19-0924-50d8-bbd5-650c94288ed5, identifier: TY82930
2026-03-27 10:40:16 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX34455%27 HTTP/1.1" 200 None
2026-03-27 10:40:16 [auto1.de] INFO: Scrape type for HX34455: 2
2026-03-27 10:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d65715d4-7f34-5a8b-bd13-a89dca28c524 with identifier: HX34455
2026-03-27 10:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d65715d4-7f34-5a8b-bd13-a89dca28c524 with scrape type 2
2026-03-27 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d65715d4-7f34-5a8b-bd13-a89dca28c524 with scrape type 2
2026-03-27 10:40:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d65715d4-7f34-5a8b-bd13-a89dca28c524, identifier: HX34455
2026-03-27 10:40:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2de1ce19-0924-50d8-bbd5-650c94288ed5 with identifier: TY82930
2026-03-27 10:40:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2de1ce19-0924-50d8-bbd5-650c94288ed5 with identifier: TY82930
2026-03-27 10:40:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2de1ce19-0924-50d8-bbd5-650c94288ed5 with identifier: TY82930 to the API
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 290,
'expiration_date': '2026-03-28T16:37:46Z',
'fuel_type': 'petrol',
'id': '2de1ce19-0924-50d8-bbd5-650c94288ed5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY82930',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 107220,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-21',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
'transmission': 'automatic',
'trim': 'GTI TCR',
'year': 2019}
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY82930%27 HTTP/1.1" 200 None
2026-03-27 10:40:16 [auto1.de] INFO: Saving data for TY82930: {'auction_closing_time': 1774715866.0, 'created_time': 1773658612.037912, 'last_price_update_time': 1774608016.477009}
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY82930') HTTP/1.1" 204 0
2026-03-27 10:40:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d65715d4-7f34-5a8b-bd13-a89dca28c524 with identifier: HX34455
2026-03-27 10:40:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d65715d4-7f34-5a8b-bd13-a89dca28c524 with identifier: HX34455
2026-03-27 10:40:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d65715d4-7f34-5a8b-bd13-a89dca28c524 with identifier: HX34455 to the API
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:45:59Z',
'fuel_type': 'diesel',
'id': 'd65715d4-7f34-5a8b-bd13-a89dca28c524',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX34455',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 111597,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-12',
'seller_name': None,
'title': 'Ford Focus 1.5 EcoBlue TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2019}
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX34455%27 HTTP/1.1" 200 None
2026-03-27 10:40:16 [auto1.de] INFO: Saving data for HX34455: {'auction_closing_time': 1774716359.0, 'created_time': 1773306638.925378, 'last_price_update_time': 1774608016.954061}
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX34455') HTTP/1.1" 204 0
2026-03-27 10:40:16 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-27 10:40:16 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-27 10:40:16 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND33880%27 HTTP/1.1" 200 None
2026-03-27 10:40:16 [auto1.de] INFO: Scrape type for ND33880: 2
2026-03-27 10:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95012aec-382b-5018-b1d7-3351a4df06d2 with identifier: ND33880
2026-03-27 10:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95012aec-382b-5018-b1d7-3351a4df06d2 with scrape type 2
2026-03-27 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95012aec-382b-5018-b1d7-3351a4df06d2 with scrape type 2
2026-03-27 10:40:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95012aec-382b-5018-b1d7-3351a4df06d2, identifier: ND33880
2026-03-27 10:40:17 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ32425%27 HTTP/1.1" 200 None
2026-03-27 10:40:17 [auto1.de] INFO: Scrape type for DJ32425: 2
2026-03-27 10:40:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c10d3bf-c14a-570c-90e4-6d0c55c32190 with identifier: DJ32425
2026-03-27 10:40:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c10d3bf-c14a-570c-90e4-6d0c55c32190 with scrape type 2
2026-03-27 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c10d3bf-c14a-570c-90e4-6d0c55c32190 with scrape type 2
2026-03-27 10:40:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c10d3bf-c14a-570c-90e4-6d0c55c32190, identifier: DJ32425
2026-03-27 10:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95012aec-382b-5018-b1d7-3351a4df06d2 with identifier: ND33880
2026-03-27 10:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95012aec-382b-5018-b1d7-3351a4df06d2 with identifier: ND33880
2026-03-27 10:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95012aec-382b-5018-b1d7-3351a4df06d2 with identifier: ND33880 to the API
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:45:47Z',
'fuel_type': 'petrol',
'id': '95012aec-382b-5018-b1d7-3351a4df06d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND33880',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 133798,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-15',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 Kompressor T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2009}
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND33880%27 HTTP/1.1" 200 None
2026-03-27 10:40:17 [auto1.de] INFO: Saving data for ND33880: {'auction_closing_time': 1774716347.0, 'created_time': 1773687628.022583, 'last_price_update_time': 1774608017.549261}
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND33880') HTTP/1.1" 204 0
2026-03-27 10:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c10d3bf-c14a-570c-90e4-6d0c55c32190 with identifier: DJ32425
2026-03-27 10:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c10d3bf-c14a-570c-90e4-6d0c55c32190 with identifier: DJ32425
2026-03-27 10:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c10d3bf-c14a-570c-90e4-6d0c55c32190 with identifier: DJ32425 to the API
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:58:28Z',
'fuel_type': 'diesel',
'id': '9c10d3bf-c14a-570c-90e4-6d0c55c32190',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ32425',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 70834,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-19',
'seller_name': None,
'title': 'Opel Mokka X 1.6 CDTI DPF Edition Start/Stop',
'transmission': 'manual',
'trim': 'Edition Start/Stop',
'year': 2016}
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ32425%27 HTTP/1.1" 200 None
2026-03-27 10:40:17 [auto1.de] INFO: Saving data for DJ32425: {'auction_closing_time': 1774717108.0, 'created_time': 1773307966.870438, 'last_price_update_time': 1774608017.909638}
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ32425') HTTP/1.1" 204 0
2026-03-27 10:40:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:17 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-27 10:40:17 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-27 10:40:17 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU29288%27 HTTP/1.1" 200 None
2026-03-27 10:40:17 [auto1.de] INFO: Scrape type for TU29288: 2
2026-03-27 10:40:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11cc4c26-e79f-5114-b6e8-e2fd37b6918e with identifier: TU29288
2026-03-27 10:40:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11cc4c26-e79f-5114-b6e8-e2fd37b6918e with scrape type 2
2026-03-27 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11cc4c26-e79f-5114-b6e8-e2fd37b6918e with scrape type 2
2026-03-27 10:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11cc4c26-e79f-5114-b6e8-e2fd37b6918e, identifier: TU29288
2026-03-27 10:40:18 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-27 10:40:18 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV91076%27 HTTP/1.1" 200 None
2026-03-27 10:40:18 [auto1.de] INFO: Scrape type for DV91076: 2
2026-03-27 10:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88cfcf40-1c29-5e06-8e86-0f4abc0fed72 with identifier: DV91076
2026-03-27 10:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88cfcf40-1c29-5e06-8e86-0f4abc0fed72 with scrape type 2
2026-03-27 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88cfcf40-1c29-5e06-8e86-0f4abc0fed72 with scrape type 2
2026-03-27 10:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88cfcf40-1c29-5e06-8e86-0f4abc0fed72, identifier: DV91076
2026-03-27 10:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11cc4c26-e79f-5114-b6e8-e2fd37b6918e with identifier: TU29288
2026-03-27 10:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11cc4c26-e79f-5114-b6e8-e2fd37b6918e with identifier: TU29288
2026-03-27 10:40:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11cc4c26-e79f-5114-b6e8-e2fd37b6918e with identifier: TU29288 to the API
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-28T16:58:38Z',
'fuel_type': 'hybrid',
'id': '11cc4c26-e79f-5114-b6e8-e2fd37b6918e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU29288',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 52168,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-08',
'seller_name': None,
'title': 'MINI Countryman Cooper SE Essential Trim ALL4',
'transmission': 'automatic',
'trim': 'Essential Trim ALL4',
'year': 2022}
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU29288%27 HTTP/1.1" 200 None
2026-03-27 10:40:18 [auto1.de] INFO: Saving data for TU29288: {'auction_closing_time': 1774717118.0, 'created_time': 1773306982.261137, 'last_price_update_time': 1774608018.490564}
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU29288') HTTP/1.1" 204 0
2026-03-27 10:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88cfcf40-1c29-5e06-8e86-0f4abc0fed72 with identifier: DV91076
2026-03-27 10:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88cfcf40-1c29-5e06-8e86-0f4abc0fed72 with identifier: DV91076
2026-03-27 10:40:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88cfcf40-1c29-5e06-8e86-0f4abc0fed72 with identifier: DV91076 to the API
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 113,
'expiration_date': '2026-03-28T16:50:10Z',
'fuel_type': 'diesel',
'id': '88cfcf40-1c29-5e06-8e86-0f4abc0fed72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV91076',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 297655,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-07-31',
'seller_name': None,
'title': 'Kia Sportage 2.0 Turbodiesel EX 4WD',
'transmission': 'automatic',
'trim': 'EX 4WD',
'year': 2005}
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV91076%27 HTTP/1.1" 200 None
2026-03-27 10:40:18 [auto1.de] INFO: Saving data for DV91076: {'auction_closing_time': 1774716610.0, 'created_time': 1773468474.634517, 'last_price_update_time': 1774608018.875218}
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV91076') HTTP/1.1" 204 0
2026-03-27 10:40:18 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-27 10:40:18 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-27 10:40:18 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-27 10:40:18 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ89661%27 HTTP/1.1" 200 None
2026-03-27 10:40:18 [auto1.de] INFO: Scrape type for CZ89661: 2
2026-03-27 10:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 604475fb-0a77-588c-b7d4-a3667d135f58 with identifier: CZ89661
2026-03-27 10:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 604475fb-0a77-588c-b7d4-a3667d135f58 with scrape type 2
2026-03-27 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 604475fb-0a77-588c-b7d4-a3667d135f58 with scrape type 2
2026-03-27 10:40:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 604475fb-0a77-588c-b7d4-a3667d135f58, identifier: CZ89661
2026-03-27 10:40:19 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-27 10:40:19 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-27 10:40:19 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU26768%27 HTTP/1.1" 200 None
2026-03-27 10:40:19 [auto1.de] INFO: Scrape type for ZU26768: 2
2026-03-27 10:40:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b40f711-92ae-5045-adcb-71839f045d3d with identifier: ZU26768
2026-03-27 10:40:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b40f711-92ae-5045-adcb-71839f045d3d with scrape type 2
2026-03-27 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b40f711-92ae-5045-adcb-71839f045d3d with scrape type 2
2026-03-27 10:40:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b40f711-92ae-5045-adcb-71839f045d3d, identifier: ZU26768
2026-03-27 10:40:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 604475fb-0a77-588c-b7d4-a3667d135f58 with identifier: CZ89661
2026-03-27 10:40:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 604475fb-0a77-588c-b7d4-a3667d135f58 with identifier: CZ89661
2026-03-27 10:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 604475fb-0a77-588c-b7d4-a3667d135f58 with identifier: CZ89661 to the API
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:33:13Z',
'fuel_type': 'petrol',
'id': '604475fb-0a77-588c-b7d4-a3667d135f58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ89661',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 72383,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-27',
'seller_name': None,
'title': 'Opel Mokka X 1.6 Selection Start/Stop',
'transmission': 'manual',
'trim': 'Selection Start/Stop',
'year': 2016}
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ89661%27 HTTP/1.1" 200 None
2026-03-27 10:40:19 [auto1.de] INFO: Saving data for CZ89661: {'auction_closing_time': 1774715593.0, 'created_time': 1773467350.095299, 'last_price_update_time': 1774608019.628293}
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ89661') HTTP/1.1" 204 0
2026-03-27 10:40:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b40f711-92ae-5045-adcb-71839f045d3d with identifier: ZU26768
2026-03-27 10:40:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b40f711-92ae-5045-adcb-71839f045d3d with identifier: ZU26768
2026-03-27 10:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b40f711-92ae-5045-adcb-71839f045d3d with identifier: ZU26768 to the API
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 80,
'expiration_date': '2026-03-28T16:29:37Z',
'fuel_type': 'diesel',
'id': '3b40f711-92ae-5045-adcb-71839f045d3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU26768',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 294305,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-26',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 TDI Sportline',
'transmission': 'manual',
'trim': 'Sportline',
'year': 2006}
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU26768%27 HTTP/1.1" 200 None
2026-03-27 10:40:20 [auto1.de] INFO: Saving data for ZU26768: {'auction_closing_time': 1774715377.0, 'created_time': 1774118856.095716, 'last_price_update_time': 1774608020.341162}
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU26768') HTTP/1.1" 204 0
2026-03-27 10:40:20 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN32134%27 HTTP/1.1" 200 None
2026-03-27 10:40:20 [auto1.de] INFO: Scrape type for XN32134: 0
2026-03-27 10:40:20 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-27 10:40:20 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21062%27 HTTP/1.1" 200 None
2026-03-27 10:40:20 [auto1.de] INFO: Scrape type for RX21062: 2
2026-03-27 10:40:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82272a7b-f8a4-55f4-9661-187b7c878674 with identifier: RX21062
2026-03-27 10:40:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82272a7b-f8a4-55f4-9661-187b7c878674 with scrape type 2
2026-03-27 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82272a7b-f8a4-55f4-9661-187b7c878674 with scrape type 2
2026-03-27 10:40:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82272a7b-f8a4-55f4-9661-187b7c878674, identifier: RX21062
2026-03-27 10:40:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82272a7b-f8a4-55f4-9661-187b7c878674 with identifier: RX21062
2026-03-27 10:40:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82272a7b-f8a4-55f4-9661-187b7c878674 with identifier: RX21062
2026-03-27 10:40:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82272a7b-f8a4-55f4-9661-187b7c878674 with identifier: RX21062 to the API
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 227,
'expiration_date': '2026-03-28T16:07:29Z',
'fuel_type': 'petrol',
'id': '82272a7b-f8a4-55f4-9661-187b7c878674',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX21062',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 9140,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-15',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic Edition '
'Avantgarde',
'transmission': 'automatic',
'trim': '4Matic Edition Avantgarde',
'year': 2025}
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21062%27 HTTP/1.1" 200 None
2026-03-27 10:40:21 [auto1.de] INFO: Saving data for RX21062: {'auction_closing_time': 1774714049.0, 'created_time': 1773773459.754662, 'last_price_update_time': 1774608021.124055}
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX21062') HTTP/1.1" 204 0
2026-03-27 10:40:21 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU43225%27 HTTP/1.1" 200 None
2026-03-27 10:40:21 [auto1.de] INFO: Scrape type for GU43225: 2
2026-03-27 10:40:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6746d2a1-de9d-5b45-a9f4-cae3dd508e58 with identifier: GU43225
2026-03-27 10:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6746d2a1-de9d-5b45-a9f4-cae3dd508e58 with scrape type 2
2026-03-27 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6746d2a1-de9d-5b45-a9f4-cae3dd508e58 with scrape type 2
2026-03-27 10:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6746d2a1-de9d-5b45-a9f4-cae3dd508e58, identifier: GU43225
2026-03-27 10:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY09817/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JL65692> (referer: https://www.auto1.com/v1/car-details-view/JL65692/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6746d2a1-de9d-5b45-a9f4-cae3dd508e58 with identifier: GU43225
2026-03-27 10:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6746d2a1-de9d-5b45-a9f4-cae3dd508e58 with identifier: GU43225
2026-03-27 10:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6746d2a1-de9d-5b45-a9f4-cae3dd508e58 with identifier: GU43225 to the API
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:40:56Z',
'fuel_type': 'diesel',
'id': '6746d2a1-de9d-5b45-a9f4-cae3dd508e58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU43225',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Kombi',
'odometer': 342306,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-07',
'seller_name': None,
'title': 'Volkswagen T6 Kombi 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU43225%27 HTTP/1.1" 200 None
2026-03-27 10:40:21 [auto1.de] INFO: Saving data for GU43225: {'auction_closing_time': 1774716056.0, 'created_time': 1773303802.705745, 'last_price_update_time': 1774608021.62044}
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU43225') HTTP/1.1" 204 0
2026-03-27 10:40:21 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-27 10:40:21 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-27 10:40:21 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-27 10:40:21 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD07804%27 HTTP/1.1" 200 None
2026-03-27 10:40:21 [auto1.de] INFO: Scrape type for FD07804: 2
2026-03-27 10:40:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dc9a63b-bef0-516a-b640-0ed70f5eb054 with identifier: FD07804
2026-03-27 10:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dc9a63b-bef0-516a-b640-0ed70f5eb054 with scrape type 2
2026-03-27 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dc9a63b-bef0-516a-b640-0ed70f5eb054 with scrape type 2
2026-03-27 10:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7dc9a63b-bef0-516a-b640-0ed70f5eb054, identifier: FD07804
2026-03-27 10:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL29911/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7dc9a63b-bef0-516a-b640-0ed70f5eb054 with identifier: FD07804
2026-03-27 10:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7dc9a63b-bef0-516a-b640-0ed70f5eb054 with identifier: FD07804
2026-03-27 10:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7dc9a63b-bef0-516a-b640-0ed70f5eb054 with identifier: FD07804 to the API
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:14:49Z',
'fuel_type': 'petrol',
'id': '7dc9a63b-bef0-516a-b640-0ed70f5eb054',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD07804',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 306605,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-05',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD07804%27 HTTP/1.1" 200 None
2026-03-27 10:40:22 [auto1.de] INFO: Saving data for FD07804: {'auction_closing_time': 1774714489.0, 'created_time': 1774293941.83323, 'last_price_update_time': 1774608022.136223}
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD07804') HTTP/1.1" 204 0
2026-03-27 10:40:22 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG31115%27 HTTP/1.1" 200 None
2026-03-27 10:40:22 [auto1.de] INFO: Scrape type for LG31115: 2
2026-03-27 10:40:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c82f2fe-4503-53aa-8263-f7cdd614fda7 with identifier: LG31115
2026-03-27 10:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c82f2fe-4503-53aa-8263-f7cdd614fda7 with scrape type 2
2026-03-27 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c82f2fe-4503-53aa-8263-f7cdd614fda7 with scrape type 2
2026-03-27 10:40:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c82f2fe-4503-53aa-8263-f7cdd614fda7, identifier: LG31115
2026-03-27 10:40:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c82f2fe-4503-53aa-8263-f7cdd614fda7 with identifier: LG31115
2026-03-27 10:40:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c82f2fe-4503-53aa-8263-f7cdd614fda7 with identifier: LG31115
2026-03-27 10:40:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c82f2fe-4503-53aa-8263-f7cdd614fda7 with identifier: LG31115 to the API
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:18:02Z',
'fuel_type': 'petrol',
'id': '4c82f2fe-4503-53aa-8263-f7cdd614fda7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG31115',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 139869,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-21',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.0 TSI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2017}
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG31115%27 HTTP/1.1" 200 None
2026-03-27 10:40:22 [auto1.de] INFO: Saving data for LG31115: {'auction_closing_time': 1774714682.0, 'created_time': 1774292016.506207, 'last_price_update_time': 1774608022.6125}
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG31115') HTTP/1.1" 204 0
2026-03-27 10:40:22 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 10513 | hits on page: 40
2026-03-27 10:40:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b602d74-654e-532b-9eea-20ed15e62c97 with identifier: JL65692
2026-03-27 10:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b602d74-654e-532b-9eea-20ed15e62c97 with scrape type 1
2026-03-27 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b602d74-654e-532b-9eea-20ed15e62c97
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F51%252F9151055e9de1219623d0e84ea07af606%252Fpa%252FJL65692_2002743b4776ad893bf65256fb498603.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_2002743b4776ad893bf65256fb498603.jpg already downloaded
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F51%252F9151055e9de1219623d0e84ea07af606%252Fpa%252FJL65692_501c295156a1cce8730fdf198fdd2d3b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_501c295156a1cce8730fdf198fdd2d3b.jpg already downloaded
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F51%252F9151055e9de1219623d0e84ea07af606%252Fpa%252FJL65692_2d55dcc33c6067a06ef5278d2498c28b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_2d55dcc33c6067a06ef5278d2498c28b.jpg already downloaded
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F51%252F9151055e9de1219623d0e84ea07af606%252Fpa%252FJL65692_9e5f8a2b17caaff8f931de215ae4b7e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_9e5f8a2b17caaff8f931de215ae4b7e1.jpg already downloaded
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F51%252F9151055e9de1219623d0e84ea07af606%252Fpa%252FJL65692_3871909b154c5091dcf28a21062698f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_3871909b154c5091dcf28a21062698f2.jpg already downloaded
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F51%252F9151055e9de1219623d0e84ea07af606%252Fpa%252FJL65692_ea1a927444270cce3f68cdea486994d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_ea1a927444270cce3f68cdea486994d7.jpg already downloaded
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F51%252F9151055e9de1219623d0e84ea07af606%252Fpa%252FJL65692_77943238a71b68cb493ec583a27affff.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_77943238a71b68cb493ec583a27affff.jpg already downloaded
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F51%252F9151055e9de1219623d0e84ea07af606%252Fpa%252FJL65692_9914abe14a003db733d3db203b5d5a00.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_9914abe14a003db733d3db203b5d5a00.jpg already downloaded
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F51%252F9151055e9de1219623d0e84ea07af606%252Fpa%252FJL65692_493a55c21150eadb5bea01a86c7e36b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_493a55c21150eadb5bea01a86c7e36b2.jpg already downloaded
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F51%252F9151055e9de1219623d0e84ea07af606%252Fpa%252FJL65692_e3f5c3bad9af5797fccc9a4c849188b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_e3f5c3bad9af5797fccc9a4c849188b2.jpg already downloaded
2026-03-27 10:40:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b602d74-654e-532b-9eea-20ed15e62c97, identifier: JL65692
2026-03-27 10:40:22 [auto1.de] INFO: Found listing with ID: DC16754
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC16754%27 HTTP/1.1" 200 None
2026-03-27 10:40:22 [auto1.de] INFO: Scrape type for DC16754: 2
2026-03-27 10:40:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d34997ba-710c-5886-b0ad-d9e74a82d9bf with identifier: DC16754
2026-03-27 10:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d34997ba-710c-5886-b0ad-d9e74a82d9bf with scrape type 2
2026-03-27 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d34997ba-710c-5886-b0ad-d9e74a82d9bf with scrape type 2
2026-03-27 10:40:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d34997ba-710c-5886-b0ad-d9e74a82d9bf, identifier: DC16754
2026-03-27 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX11179> (referer: https://www.auto1.com/v1/car-details-view/XX11179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b602d74-654e-532b-9eea-20ed15e62c97 with identifier: JL65692
2026-03-27 10:40:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b602d74-654e-532b-9eea-20ed15e62c97 with identifier: JL65692
2026-03-27 10:40:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b602d74-654e-532b-9eea-20ed15e62c97 with identifier: JL65692 to the API
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JL65692>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 116,
'expiration_date': '2026-03-28T16:41:34Z',
'fuel_type': 'petrol',
'id': '1b602d74-654e-532b-9eea-20ed15e62c97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL65692',
'listing': 'auction',
'location': 'DE, Schkopau (OT Rassnitz)',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 82227,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_2002743b4776ad893bf65256fb498603.jpg',
'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_501c295156a1cce8730fdf198fdd2d3b.jpg',
'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_2d55dcc33c6067a06ef5278d2498c28b.jpg',
'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_9e5f8a2b17caaff8f931de215ae4b7e1.jpg',
'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_3871909b154c5091dcf28a21062698f2.jpg',
'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_ea1a927444270cce3f68cdea486994d7.jpg',
'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_77943238a71b68cb493ec583a27affff.jpg',
'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_9914abe14a003db733d3db203b5d5a00.jpg',
'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_493a55c21150eadb5bea01a86c7e36b2.jpg',
'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_e3f5c3bad9af5797fccc9a4c849188b2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b602d74-654e-532b-9eea-20ed15e62c97/1b602d74-654e-532b-9eea-20ed15e62c97_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97645,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_2002743b4776ad893bf65256fb498603.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b602d74-654e-532b-9eea-20ed15e62c97/1b602d74-654e-532b-9eea-20ed15e62c97_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89622,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_501c295156a1cce8730fdf198fdd2d3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b602d74-654e-532b-9eea-20ed15e62c97/1b602d74-654e-532b-9eea-20ed15e62c97_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81056,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_2d55dcc33c6067a06ef5278d2498c28b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b602d74-654e-532b-9eea-20ed15e62c97/1b602d74-654e-532b-9eea-20ed15e62c97_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62247,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_9e5f8a2b17caaff8f931de215ae4b7e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b602d74-654e-532b-9eea-20ed15e62c97/1b602d74-654e-532b-9eea-20ed15e62c97_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_3871909b154c5091dcf28a21062698f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b602d74-654e-532b-9eea-20ed15e62c97/1b602d74-654e-532b-9eea-20ed15e62c97_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78563,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_ea1a927444270cce3f68cdea486994d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b602d74-654e-532b-9eea-20ed15e62c97/1b602d74-654e-532b-9eea-20ed15e62c97_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_77943238a71b68cb493ec583a27affff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b602d74-654e-532b-9eea-20ed15e62c97/1b602d74-654e-532b-9eea-20ed15e62c97_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_9914abe14a003db733d3db203b5d5a00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b602d74-654e-532b-9eea-20ed15e62c97/1b602d74-654e-532b-9eea-20ed15e62c97_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_493a55c21150eadb5bea01a86c7e36b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b602d74-654e-532b-9eea-20ed15e62c97/1b602d74-654e-532b-9eea-20ed15e62c97_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/51/9151055e9de1219623d0e84ea07af606/pa/JL65692_e3f5c3bad9af5797fccc9a4c849188b2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-05',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.0 TSI Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2019}
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL65692%27 HTTP/1.1" 200 None
2026-03-27 10:40:23 [auto1.de] INFO: Saving data for JL65692: {'created_time': 1774608023.403767, 'last_price_update_time': 1774608023.403777, 'auction_closing_time': 1774716094.0}
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL65692') HTTP/1.1" 204 0
2026-03-27 10:40:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d34997ba-710c-5886-b0ad-d9e74a82d9bf with identifier: DC16754
2026-03-27 10:40:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d34997ba-710c-5886-b0ad-d9e74a82d9bf with identifier: DC16754
2026-03-27 10:40:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d34997ba-710c-5886-b0ad-d9e74a82d9bf with identifier: DC16754 to the API
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:18:21Z',
'fuel_type': 'petrol',
'id': 'd34997ba-710c-5886-b0ad-d9e74a82d9bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC16754',
'listing': 'auction',
'make': 'Ford',
'model': 'EcoSport',
'odometer': 49899,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-19',
'seller_name': None,
'title': 'Ford EcoSport 1.0 EcoBoost ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2019}
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC16754%27 HTTP/1.1" 200 None
2026-03-27 10:40:23 [auto1.de] INFO: Saving data for DC16754: {'auction_closing_time': 1774714701.0, 'created_time': 1774292881.417798, 'last_price_update_time': 1774608023.817137}
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC16754') HTTP/1.1" 204 0
2026-03-27 10:40:23 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-27 10:40:23 [auto1.de] INFO: Found listing with ID: TK73674
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK73674%27 HTTP/1.1" 200 None
2026-03-27 10:40:23 [auto1.de] INFO: Scrape type for TK73674: 2
2026-03-27 10:40:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77ae663c-824b-5662-b61d-990a1cdb9c99 with identifier: TK73674
2026-03-27 10:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77ae663c-824b-5662-b61d-990a1cdb9c99 with scrape type 2
2026-03-27 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77ae663c-824b-5662-b61d-990a1cdb9c99 with scrape type 2
2026-03-27 10:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77ae663c-824b-5662-b61d-990a1cdb9c99, identifier: TK73674
2026-03-27 10:40:24 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-27 10:40:24 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-27 10:40:24 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75190%27 HTTP/1.1" 200 None
2026-03-27 10:40:24 [auto1.de] INFO: Scrape type for NY75190: 2
2026-03-27 10:40:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 936031d5-5b8a-5edc-b7a6-5f76a8f3d954 with identifier: NY75190
2026-03-27 10:40:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 936031d5-5b8a-5edc-b7a6-5f76a8f3d954 with scrape type 2
2026-03-27 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 936031d5-5b8a-5edc-b7a6-5f76a8f3d954 with scrape type 2
2026-03-27 10:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 936031d5-5b8a-5edc-b7a6-5f76a8f3d954, identifier: NY75190
2026-03-27 10:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77ae663c-824b-5662-b61d-990a1cdb9c99 with identifier: TK73674
2026-03-27 10:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77ae663c-824b-5662-b61d-990a1cdb9c99 with identifier: TK73674
2026-03-27 10:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77ae663c-824b-5662-b61d-990a1cdb9c99 with identifier: TK73674 to the API
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 178,
'expiration_date': '2026-03-28T16:07:23Z',
'fuel_type': 'petrol',
'id': '77ae663c-824b-5662-b61d-990a1cdb9c99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK73674',
'listing': 'auction',
'make': 'BMW',
'model': 'X2',
'odometer': 40850,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-18',
'seller_name': None,
'title': 'BMW X2 sDrive 20i M Sport X',
'transmission': 'automatic',
'trim': 'M Sport X',
'year': 2022}
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK73674%27 HTTP/1.1" 200 None
2026-03-27 10:40:24 [auto1.de] INFO: Saving data for TK73674: {'auction_closing_time': 1774714043.0, 'created_time': 1773303465.612273, 'last_price_update_time': 1774608024.526011}
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK73674') HTTP/1.1" 204 0
2026-03-27 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CK84203> (referer: https://www.auto1.com/v1/car-details-view/CK84203/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 936031d5-5b8a-5edc-b7a6-5f76a8f3d954 with identifier: NY75190
2026-03-27 10:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 936031d5-5b8a-5edc-b7a6-5f76a8f3d954 with identifier: NY75190
2026-03-27 10:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 936031d5-5b8a-5edc-b7a6-5f76a8f3d954 with identifier: NY75190 to the API
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:16:43Z',
'fuel_type': 'petrol',
'id': '936031d5-5b8a-5edc-b7a6-5f76a8f3d954',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY75190',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Vitara',
'odometer': 72999,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-26',
'seller_name': None,
'title': 'Suzuki Vitara 1.4 BoosterJet Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2019}
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75190%27 HTTP/1.1" 200 None
2026-03-27 10:40:24 [auto1.de] INFO: Saving data for NY75190: {'auction_closing_time': 1774714603.0, 'created_time': 1773469040.023094, 'last_price_update_time': 1774608024.978753}
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY75190') HTTP/1.1" 204 0
2026-03-27 10:40:25 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK51404%27 HTTP/1.1" 200 None
2026-03-27 10:40:25 [auto1.de] INFO: Scrape type for GK51404: 2
2026-03-27 10:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70 with identifier: GK51404
2026-03-27 10:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70 with scrape type 2
2026-03-27 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70 with scrape type 2
2026-03-27 10:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70, identifier: GK51404
2026-03-27 10:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL15649> (referer: https://www.auto1.com/v1/car-details-view/ZL15649/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:25 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-27 10:40:25 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49418%27 HTTP/1.1" 200 None
2026-03-27 10:40:25 [auto1.de] INFO: Scrape type for TB49418: 2
2026-03-27 10:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b67c7ff8-120a-5144-ab8a-f43452b49b74 with identifier: TB49418
2026-03-27 10:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b67c7ff8-120a-5144-ab8a-f43452b49b74 with scrape type 2
2026-03-27 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b67c7ff8-120a-5144-ab8a-f43452b49b74 with scrape type 2
2026-03-27 10:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b67c7ff8-120a-5144-ab8a-f43452b49b74, identifier: TB49418
2026-03-27 10:40:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70 with identifier: GK51404
2026-03-27 10:40:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70 with identifier: GK51404
2026-03-27 10:40:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d97d5d3-552b-5f3d-b4e5-1364ddd66e70 with identifier: GK51404 to the API
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 408,
'expiration_date': '2026-03-28T16:31:42Z',
'fuel_type': 'petrol',
'id': '0d97d5d3-552b-5f3d-b4e5-1364ddd66e70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK51404',
'listing': 'auction',
'make': 'BMW',
'model': 'X6',
'odometer': 153790,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-20',
'seller_name': None,
'title': 'BMW X6 xDrive 50i',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK51404%27 HTTP/1.1" 200 None
2026-03-27 10:40:25 [auto1.de] INFO: Saving data for GK51404: {'auction_closing_time': 1774715502.0, 'created_time': 1774294616.505064, 'last_price_update_time': 1774608025.653142}
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK51404') HTTP/1.1" 204 0
2026-03-27 10:40:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea075bdd-3169-5676-9ecf-9541e96e4a78 with identifier: XX11179
2026-03-27 10:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea075bdd-3169-5676-9ecf-9541e96e4a78 with scrape type 1
2026-03-27 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea075bdd-3169-5676-9ecf-9541e96e4a78
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_39b36dbfb1bb86afcb4627581d2b2198.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_39b36dbfb1bb86afcb4627581d2b2198.jpg not downloaded yet
2026-03-27 10:40:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b67c7ff8-120a-5144-ab8a-f43452b49b74 with identifier: TB49418
2026-03-27 10:40:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b67c7ff8-120a-5144-ab8a-f43452b49b74 with identifier: TB49418
2026-03-27 10:40:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b67c7ff8-120a-5144-ab8a-f43452b49b74 with identifier: TB49418 to the API
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 333,
'expiration_date': '2026-03-28T16:08:57Z',
'fuel_type': 'petrol',
'id': 'b67c7ff8-120a-5144-ab8a-f43452b49b74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB49418',
'listing': 'auction',
'make': 'BMW',
'model': '6er',
'odometer': 113025,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-04-27',
'seller_name': None,
'title': 'BMW 6er 645 CI',
'transmission': 'automatic',
'trim': '',
'year': 2005}
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49418%27 HTTP/1.1" 200 None
2026-03-27 10:40:26 [auto1.de] INFO: Saving data for TB49418: {'auction_closing_time': 1774714137.0, 'created_time': 1773223597.423583, 'last_price_update_time': 1774608026.05063}
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB49418') HTTP/1.1" 204 0
2026-03-27 10:40:26 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM66171%27 HTTP/1.1" 200 None
2026-03-27 10:40:26 [auto1.de] INFO: Scrape type for KM66171: 2
2026-03-27 10:40:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9bd72b3-bf31-54d5-8033-a5b253fd8afe with identifier: KM66171
2026-03-27 10:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9bd72b3-bf31-54d5-8033-a5b253fd8afe with scrape type 2
2026-03-27 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9bd72b3-bf31-54d5-8033-a5b253fd8afe with scrape type 2
2026-03-27 10:40:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9bd72b3-bf31-54d5-8033-a5b253fd8afe, identifier: KM66171
2026-03-27 10:40:26 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC29722%27 HTTP/1.1" 200 None
2026-03-27 10:40:26 [auto1.de] INFO: Scrape type for FC29722: 2
2026-03-27 10:40:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b79e52d5-7216-5b83-9ff0-2b2e8efb8266 with identifier: FC29722
2026-03-27 10:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b79e52d5-7216-5b83-9ff0-2b2e8efb8266 with scrape type 2
2026-03-27 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b79e52d5-7216-5b83-9ff0-2b2e8efb8266 with scrape type 2
2026-03-27 10:40:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b79e52d5-7216-5b83-9ff0-2b2e8efb8266, identifier: FC29722
2026-03-27 10:40:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9bd72b3-bf31-54d5-8033-a5b253fd8afe with identifier: KM66171
2026-03-27 10:40:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9bd72b3-bf31-54d5-8033-a5b253fd8afe with identifier: KM66171
2026-03-27 10:40:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9bd72b3-bf31-54d5-8033-a5b253fd8afe with identifier: KM66171 to the API
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:41:46Z',
'fuel_type': 'petrol',
'id': 'e9bd72b3-bf31-54d5-8033-a5b253fd8afe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM66171',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 93938,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-29',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
'transmission': 'manual',
'trim': 'BlueEfficiency Urban',
'year': 2016}
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM66171%27 HTTP/1.1" 200 None
2026-03-27 10:40:26 [auto1.de] INFO: Saving data for KM66171: {'auction_closing_time': 1774716106.0, 'created_time': 1773134586.161787, 'last_price_update_time': 1774608026.616783}
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM66171') HTTP/1.1" 204 0
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_81d9847665e0460273898c50e5a8d510.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_81d9847665e0460273898c50e5a8d510.jpg not downloaded yet
2026-03-27 10:40:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93a00916-98b5-5ed9-92af-a78295bc84fc with identifier: CK84203
2026-03-27 10:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93a00916-98b5-5ed9-92af-a78295bc84fc with scrape type 1
2026-03-27 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 93a00916-98b5-5ed9-92af-a78295bc84fc
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F82%252Fe282e533e039a47dc64f213d8cfabde4%252Fpa%252FCK84203_f51e3eadb4b2dc721c5a25ea5c3ae526.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_f51e3eadb4b2dc721c5a25ea5c3ae526.jpg not downloaded yet
2026-03-27 10:40:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b79e52d5-7216-5b83-9ff0-2b2e8efb8266 with identifier: FC29722
2026-03-27 10:40:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b79e52d5-7216-5b83-9ff0-2b2e8efb8266 with identifier: FC29722
2026-03-27 10:40:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b79e52d5-7216-5b83-9ff0-2b2e8efb8266 with identifier: FC29722 to the API
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 260,
'expiration_date': '2026-03-28T16:32:06Z',
'fuel_type': 'petrol',
'id': 'b79e52d5-7216-5b83-9ff0-2b2e8efb8266',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC29722',
'listing': 'auction',
'make': 'Dodge',
'model': 'Nitro',
'odometer': 126228,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-06',
'seller_name': None,
'title': 'Dodge Nitro 4.0 V6 R/T',
'transmission': 'automatic',
'trim': 'R/T',
'year': 2013}
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC29722%27 HTTP/1.1" 200 None
2026-03-27 10:40:27 [auto1.de] INFO: Saving data for FC29722: {'auction_closing_time': 1774715526.0, 'created_time': 1773305217.884571, 'last_price_update_time': 1774608027.036555}
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC29722') HTTP/1.1" 204 0
2026-03-27 10:40:27 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF83287%27 HTTP/1.1" 200 None
2026-03-27 10:40:27 [auto1.de] INFO: Scrape type for XF83287: 2
2026-03-27 10:40:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 182166df-a758-5861-8c9c-caf74e2fa5ad with identifier: XF83287
2026-03-27 10:40:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 182166df-a758-5861-8c9c-caf74e2fa5ad with scrape type 2
2026-03-27 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 182166df-a758-5861-8c9c-caf74e2fa5ad with scrape type 2
2026-03-27 10:40:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 182166df-a758-5861-8c9c-caf74e2fa5ad, identifier: XF83287
2026-03-27 10:40:27 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX44464%27 HTTP/1.1" 200 None
2026-03-27 10:40:27 [auto1.de] INFO: Scrape type for HX44464: 2
2026-03-27 10:40:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b407ee1-70ee-5b4c-b546-311fca521be5 with identifier: HX44464
2026-03-27 10:40:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b407ee1-70ee-5b4c-b546-311fca521be5 with scrape type 2
2026-03-27 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b407ee1-70ee-5b4c-b546-311fca521be5 with scrape type 2
2026-03-27 10:40:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b407ee1-70ee-5b4c-b546-311fca521be5, identifier: HX44464
2026-03-27 10:40:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 182166df-a758-5861-8c9c-caf74e2fa5ad with identifier: XF83287
2026-03-27 10:40:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 182166df-a758-5861-8c9c-caf74e2fa5ad with identifier: XF83287
2026-03-27 10:40:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 182166df-a758-5861-8c9c-caf74e2fa5ad with identifier: XF83287 to the API
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:43:08Z',
'fuel_type': 'petrol',
'id': '182166df-a758-5861-8c9c-caf74e2fa5ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF83287',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 202722,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-09',
'seller_name': None,
'title': 'Audi A4 2.0 TFSI S line Sportpaket plus',
'transmission': 'manual',
'trim': 'S line Sportpaket plus',
'year': 2009}
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF83287%27 HTTP/1.1" 200 None
2026-03-27 10:40:27 [auto1.de] INFO: Saving data for XF83287: {'auction_closing_time': 1774716188.0, 'created_time': 1774262939.739456, 'last_price_update_time': 1774608027.621945}
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF83287') HTTP/1.1" 204 0
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_600fcb2317d1f393412cda17d84552ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_600fcb2317d1f393412cda17d84552ce.jpg not downloaded yet
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F82%252Fe282e533e039a47dc64f213d8cfabde4%252Fpa%252FCK84203_27f602b4f262e80a3490fd628a98cb49.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_27f602b4f262e80a3490fd628a98cb49.jpg not downloaded yet
2026-03-27 10:40:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b407ee1-70ee-5b4c-b546-311fca521be5 with identifier: HX44464
2026-03-27 10:40:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b407ee1-70ee-5b4c-b546-311fca521be5 with identifier: HX44464
2026-03-27 10:40:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b407ee1-70ee-5b4c-b546-311fca521be5 with identifier: HX44464 to the API
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 510,
'expiration_date': '2026-03-28T16:16:00Z',
'fuel_type': 'petrol',
'id': '2b407ee1-70ee-5b4c-b546-311fca521be5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX44464',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Range Rover Sport',
'odometer': 103768,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-14',
'seller_name': None,
'title': 'Land Rover Range Rover Sport 5.0 V8 HSE Dynamic',
'transmission': 'automatic',
'trim': 'HSE Dynamic',
'year': 2017}
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX44464%27 HTTP/1.1" 200 None
2026-03-27 10:40:28 [auto1.de] INFO: Saving data for HX44464: {'auction_closing_time': 1774714560.0, 'created_time': 1773685866.871994, 'last_price_update_time': 1774608028.163241}
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX44464') HTTP/1.1" 204 0
2026-03-27 10:40:28 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65077%27 HTTP/1.1" 200 None
2026-03-27 10:40:28 [auto1.de] INFO: Scrape type for LJ65077: 2
2026-03-27 10:40:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de5a2bb0-d02f-5b12-9f1c-78afc3302cfc with identifier: LJ65077
2026-03-27 10:40:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de5a2bb0-d02f-5b12-9f1c-78afc3302cfc with scrape type 2
2026-03-27 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de5a2bb0-d02f-5b12-9f1c-78afc3302cfc with scrape type 2
2026-03-27 10:40:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de5a2bb0-d02f-5b12-9f1c-78afc3302cfc, identifier: LJ65077
2026-03-27 10:40:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 with identifier: ZL15649
2026-03-27 10:40:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 with scrape type 1
2026-03-27 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab86ac41-15e4-5a0a-95d5-ebcacf93ad20
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_6d1e69edd1d5e89eea217e9bde0a9dae.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_6d1e69edd1d5e89eea217e9bde0a9dae.jpg not downloaded yet
2026-03-27 10:40:28 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-27 10:40:28 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-27 10:40:28 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR86063%27 HTTP/1.1" 200 None
2026-03-27 10:40:28 [auto1.de] INFO: Scrape type for GR86063: 2
2026-03-27 10:40:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7de6619-83d8-5976-bb53-a9b4512f9c09 with identifier: GR86063
2026-03-27 10:40:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7de6619-83d8-5976-bb53-a9b4512f9c09 with scrape type 2
2026-03-27 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7de6619-83d8-5976-bb53-a9b4512f9c09 with scrape type 2
2026-03-27 10:40:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7de6619-83d8-5976-bb53-a9b4512f9c09, identifier: GR86063
2026-03-27 10:40:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de5a2bb0-d02f-5b12-9f1c-78afc3302cfc with identifier: LJ65077
2026-03-27 10:40:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de5a2bb0-d02f-5b12-9f1c-78afc3302cfc with identifier: LJ65077
2026-03-27 10:40:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de5a2bb0-d02f-5b12-9f1c-78afc3302cfc with identifier: LJ65077 to the API
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:57:44Z',
'fuel_type': 'diesel',
'id': 'de5a2bb0-d02f-5b12-9f1c-78afc3302cfc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ65077',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 294927,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-07',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2019}
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65077%27 HTTP/1.1" 200 None
2026-03-27 10:40:28 [auto1.de] INFO: Saving data for LJ65077: {'auction_closing_time': 1774717064.0, 'created_time': 1773427287.035825, 'last_price_update_time': 1774608028.842182}
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ65077') HTTP/1.1" 204 0
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_3b62b856c05acb2dbaeaed6d673c4992.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_3b62b856c05acb2dbaeaed6d673c4992.jpg not downloaded yet
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F82%252Fe282e533e039a47dc64f213d8cfabde4%252Fpa%252FCK84203_4e41c5e8fa72a2f898f69376b02dc299.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_4e41c5e8fa72a2f898f69376b02dc299.jpg not downloaded yet
2026-03-27 10:40:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7de6619-83d8-5976-bb53-a9b4512f9c09 with identifier: GR86063
2026-03-27 10:40:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7de6619-83d8-5976-bb53-a9b4512f9c09 with identifier: GR86063
2026-03-27 10:40:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7de6619-83d8-5976-bb53-a9b4512f9c09 with identifier: GR86063 to the API
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:22:41Z',
'fuel_type': 'diesel',
'id': 'c7de6619-83d8-5976-bb53-a9b4512f9c09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR86063',
'listing': 'auction',
'make': 'Citroen',
'model': 'C5',
'odometer': 207463,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-22',
'seller_name': None,
'title': 'Citroen C5 2.0 HDi Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2009}
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR86063%27 HTTP/1.1" 200 None
2026-03-27 10:40:29 [auto1.de] INFO: Saving data for GR86063: {'auction_closing_time': 1774714961.0, 'created_time': 1773305461.178113, 'last_price_update_time': 1774608029.375501}
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR86063') HTTP/1.1" 204 0
2026-03-27 10:40:29 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL63918%27 HTTP/1.1" 200 None
2026-03-27 10:40:29 [auto1.de] INFO: Scrape type for YL63918: 2
2026-03-27 10:40:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ada1d1f-9b7e-5032-b57f-04208056cf3a with identifier: YL63918
2026-03-27 10:40:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ada1d1f-9b7e-5032-b57f-04208056cf3a with scrape type 2
2026-03-27 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ada1d1f-9b7e-5032-b57f-04208056cf3a with scrape type 2
2026-03-27 10:40:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ada1d1f-9b7e-5032-b57f-04208056cf3a, identifier: YL63918
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_48fa7101be619b26c9854cb0930fe5e4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_48fa7101be619b26c9854cb0930fe5e4.jpg not downloaded yet
2026-03-27 10:40:29 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-27 10:40:29 [auto1.de] INFO: Found listing with ID: YM75197
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM75197%27 HTTP/1.1" 200 None
2026-03-27 10:40:29 [auto1.de] INFO: Scrape type for YM75197: 2
2026-03-27 10:40:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9eee2f6c-fa09-50f9-9efa-589af2df66c7 with identifier: YM75197
2026-03-27 10:40:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eee2f6c-fa09-50f9-9efa-589af2df66c7 with scrape type 2
2026-03-27 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9eee2f6c-fa09-50f9-9efa-589af2df66c7 with scrape type 2
2026-03-27 10:40:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9eee2f6c-fa09-50f9-9efa-589af2df66c7, identifier: YM75197
2026-03-27 10:40:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ada1d1f-9b7e-5032-b57f-04208056cf3a with identifier: YL63918
2026-03-27 10:40:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ada1d1f-9b7e-5032-b57f-04208056cf3a with identifier: YL63918
2026-03-27 10:40:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ada1d1f-9b7e-5032-b57f-04208056cf3a with identifier: YL63918 to the API
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:05:36Z',
'fuel_type': 'diesel',
'id': '8ada1d1f-9b7e-5032-b57f-04208056cf3a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL63918',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 141156,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-23',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2015}
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL63918%27 HTTP/1.1" 200 None
2026-03-27 10:40:30 [auto1.de] INFO: Saving data for YL63918: {'auction_closing_time': 1774713936.0, 'created_time': 1773772242.996943, 'last_price_update_time': 1774608030.168586}
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL63918') HTTP/1.1" 204 0
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_70c260148de45a1bd42902a1feeadb79.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_70c260148de45a1bd42902a1feeadb79.jpg not downloaded yet
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F82%252Fe282e533e039a47dc64f213d8cfabde4%252Fpa%252FCK84203_d9e85338f995d28f4d5b6717fc7d45da.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_d9e85338f995d28f4d5b6717fc7d45da.jpg not downloaded yet
2026-03-27 10:40:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9eee2f6c-fa09-50f9-9efa-589af2df66c7 with identifier: YM75197
2026-03-27 10:40:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9eee2f6c-fa09-50f9-9efa-589af2df66c7 with identifier: YM75197
2026-03-27 10:40:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9eee2f6c-fa09-50f9-9efa-589af2df66c7 with identifier: YM75197 to the API
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-28T16:48:44Z',
'fuel_type': 'hybrid',
'id': '9eee2f6c-fa09-50f9-9efa-589af2df66c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM75197',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 106950,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-03',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 350e 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2017}
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM75197%27 HTTP/1.1" 200 None
2026-03-27 10:40:30 [auto1.de] INFO: Saving data for YM75197: {'auction_closing_time': 1774716524.0, 'created_time': 1774291964.290181, 'last_price_update_time': 1774608030.559459}
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM75197') HTTP/1.1" 204 0
2026-03-27 10:40:30 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-27 10:40:30 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN14580%27 HTTP/1.1" 200 None
2026-03-27 10:40:30 [auto1.de] INFO: Scrape type for TN14580: 2
2026-03-27 10:40:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2091fc1-4213-5c12-ad43-254edc496c33 with identifier: TN14580
2026-03-27 10:40:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2091fc1-4213-5c12-ad43-254edc496c33 with scrape type 2
2026-03-27 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2091fc1-4213-5c12-ad43-254edc496c33 with scrape type 2
2026-03-27 10:40:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2091fc1-4213-5c12-ad43-254edc496c33, identifier: TN14580
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_b2fc64ddd4c0dc78c5939f89db48362d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_b2fc64ddd4c0dc78c5939f89db48362d.jpg not downloaded yet
2026-03-27 10:40:30 [auto1.de] INFO: Found listing with ID: PE37736
2026-03-27 10:40:30 [auto1.de] INFO: Found listing with ID: YW50252
2026-03-27 10:40:30 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50717%27 HTTP/1.1" 200 None
2026-03-27 10:40:30 [auto1.de] INFO: Scrape type for XS50717: 2
2026-03-27 10:40:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ce99cba-2e69-5b5f-9d47-a22d9de18873 with identifier: XS50717
2026-03-27 10:40:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ce99cba-2e69-5b5f-9d47-a22d9de18873 with scrape type 2
2026-03-27 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ce99cba-2e69-5b5f-9d47-a22d9de18873 with scrape type 2
2026-03-27 10:40:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ce99cba-2e69-5b5f-9d47-a22d9de18873, identifier: XS50717
2026-03-27 10:40:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2091fc1-4213-5c12-ad43-254edc496c33 with identifier: TN14580
2026-03-27 10:40:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2091fc1-4213-5c12-ad43-254edc496c33 with identifier: TN14580
2026-03-27 10:40:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2091fc1-4213-5c12-ad43-254edc496c33 with identifier: TN14580 to the API
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:35:38Z',
'fuel_type': 'diesel',
'id': 'd2091fc1-4213-5c12-ad43-254edc496c33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN14580',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 197243,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-01',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2015}
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN14580%27 HTTP/1.1" 200 None
2026-03-27 10:40:31 [auto1.de] INFO: Saving data for TN14580: {'auction_closing_time': 1774715738.0, 'created_time': 1774263125.266287, 'last_price_update_time': 1774608031.430836}
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN14580') HTTP/1.1" 204 0
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_4df7d427e82ab0297e0131281a32f8ee.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_4df7d427e82ab0297e0131281a32f8ee.jpg not downloaded yet
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F82%252Fe282e533e039a47dc64f213d8cfabde4%252Fpa%252FCK84203_0725fc6e5224034c5c51e2892783b3da.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_0725fc6e5224034c5c51e2892783b3da.jpg not downloaded yet
2026-03-27 10:40:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ce99cba-2e69-5b5f-9d47-a22d9de18873 with identifier: XS50717
2026-03-27 10:40:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ce99cba-2e69-5b5f-9d47-a22d9de18873 with identifier: XS50717
2026-03-27 10:40:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ce99cba-2e69-5b5f-9d47-a22d9de18873 with identifier: XS50717 to the API
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:02:15Z',
'fuel_type': 'diesel',
'id': '1ce99cba-2e69-5b5f-9d47-a22d9de18873',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS50717',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 186763,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-10',
'seller_name': None,
'title': 'BMW 3er 316d Sport Line',
'transmission': 'manual',
'trim': 'Sport Line',
'year': 2016}
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50717%27 HTTP/1.1" 200 None
2026-03-27 10:40:31 [auto1.de] INFO: Saving data for XS50717: {'auction_closing_time': 1774713735.0, 'created_time': 1774349102.194211, 'last_price_update_time': 1774608031.923428}
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS50717') HTTP/1.1" 204 0
2026-03-27 10:40:31 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-27 10:40:31 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-27 10:40:31 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN13363%27 HTTP/1.1" 200 None
2026-03-27 10:40:31 [auto1.de] INFO: Scrape type for AN13363: 2
2026-03-27 10:40:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea377221-4d6e-5a72-9b42-5f52df4920c1 with identifier: AN13363
2026-03-27 10:40:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea377221-4d6e-5a72-9b42-5f52df4920c1 with scrape type 2
2026-03-27 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea377221-4d6e-5a72-9b42-5f52df4920c1 with scrape type 2
2026-03-27 10:40:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea377221-4d6e-5a72-9b42-5f52df4920c1, identifier: AN13363
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_8fbf31a49d6ba66d35b9756e85bc875c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_8fbf31a49d6ba66d35b9756e85bc875c.jpg not downloaded yet
2026-03-27 10:40:32 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL70410%27 HTTP/1.1" 200 None
2026-03-27 10:40:32 [auto1.de] INFO: Scrape type for UL70410: 2
2026-03-27 10:40:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8108484-dca2-5f28-a753-328ff9449450 with identifier: UL70410
2026-03-27 10:40:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8108484-dca2-5f28-a753-328ff9449450 with scrape type 2
2026-03-27 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8108484-dca2-5f28-a753-328ff9449450 with scrape type 2
2026-03-27 10:40:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8108484-dca2-5f28-a753-328ff9449450, identifier: UL70410
2026-03-27 10:40:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea377221-4d6e-5a72-9b42-5f52df4920c1 with identifier: AN13363
2026-03-27 10:40:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea377221-4d6e-5a72-9b42-5f52df4920c1 with identifier: AN13363
2026-03-27 10:40:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea377221-4d6e-5a72-9b42-5f52df4920c1 with identifier: AN13363 to the API
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:53:57Z',
'fuel_type': 'petrol',
'id': 'ea377221-4d6e-5a72-9b42-5f52df4920c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN13363',
'listing': 'auction',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 167227,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'Skoda Yeti 1.4 TSI Ambition Plus Edition',
'transmission': 'manual',
'trim': 'Ambition Plus Edition',
'year': 2012}
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN13363%27 HTTP/1.1" 200 None
2026-03-27 10:40:32 [auto1.de] INFO: Saving data for AN13363: {'auction_closing_time': 1774716837.0, 'created_time': 1773858712.672628, 'last_price_update_time': 1774608032.73419}
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN13363') HTTP/1.1" 204 0
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_bc7c0f28927a84a76ca8d89daa839855.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_bc7c0f28927a84a76ca8d89daa839855.jpg not downloaded yet
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F82%252Fe282e533e039a47dc64f213d8cfabde4%252Fpa%252FCK84203_1c57e7b0ec7fc53ee0d06fb60647bf13.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_1c57e7b0ec7fc53ee0d06fb60647bf13.jpg not downloaded yet
2026-03-27 10:40:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8108484-dca2-5f28-a753-328ff9449450 with identifier: UL70410
2026-03-27 10:40:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8108484-dca2-5f28-a753-328ff9449450 with identifier: UL70410
2026-03-27 10:40:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8108484-dca2-5f28-a753-328ff9449450 with identifier: UL70410 to the API
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:47:31Z',
'fuel_type': 'petrol',
'id': 'd8108484-dca2-5f28-a753-328ff9449450',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL70410',
'listing': 'auction',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 37200,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-03',
'seller_name': None,
'title': 'Seat Tarraco 1.5 TSI ACT FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2023}
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL70410%27 HTTP/1.1" 200 None
2026-03-27 10:40:33 [auto1.de] INFO: Saving data for UL70410: {'auction_closing_time': 1774716451.0, 'created_time': 1773661899.48174, 'last_price_update_time': 1774608033.210476}
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL70410') HTTP/1.1" 204 0
2026-03-27 10:40:33 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD09657%27 HTTP/1.1" 200 None
2026-03-27 10:40:33 [auto1.de] INFO: Scrape type for YD09657: 2
2026-03-27 10:40:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9bc550b-3356-58e5-9670-73a40cd2f56b with identifier: YD09657
2026-03-27 10:40:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9bc550b-3356-58e5-9670-73a40cd2f56b with scrape type 2
2026-03-27 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9bc550b-3356-58e5-9670-73a40cd2f56b with scrape type 2
2026-03-27 10:40:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9bc550b-3356-58e5-9670-73a40cd2f56b, identifier: YD09657
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_658abe3ce61d28b0ba6fc5fc91cadb40.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_658abe3ce61d28b0ba6fc5fc91cadb40.jpg not downloaded yet
2026-03-27 10:40:33 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-27 10:40:33 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT00605%27 HTTP/1.1" 200 None
2026-03-27 10:40:33 [auto1.de] INFO: Scrape type for CT00605: 2
2026-03-27 10:40:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce5318ef-9eac-5353-b196-ac0aac83978b with identifier: CT00605
2026-03-27 10:40:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce5318ef-9eac-5353-b196-ac0aac83978b with scrape type 2
2026-03-27 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce5318ef-9eac-5353-b196-ac0aac83978b with scrape type 2
2026-03-27 10:40:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce5318ef-9eac-5353-b196-ac0aac83978b, identifier: CT00605
2026-03-27 10:40:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9bc550b-3356-58e5-9670-73a40cd2f56b with identifier: YD09657
2026-03-27 10:40:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9bc550b-3356-58e5-9670-73a40cd2f56b with identifier: YD09657
2026-03-27 10:40:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9bc550b-3356-58e5-9670-73a40cd2f56b with identifier: YD09657 to the API
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:12:46Z',
'fuel_type': 'diesel',
'id': 'f9bc550b-3356-58e5-9670-73a40cd2f56b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD09657',
'listing': 'auction',
'make': 'Audi',
'model': 'A3',
'odometer': 164379,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-19',
'seller_name': None,
'title': 'Audi A3 2.0 TDI S line Sportpaket plus',
'transmission': 'manual',
'trim': 'S line Sportpaket plus',
'year': 2010}
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD09657%27 HTTP/1.1" 200 None
2026-03-27 10:40:33 [auto1.de] INFO: Saving data for YD09657: {'auction_closing_time': 1774714366.0, 'created_time': 1774290713.92599, 'last_price_update_time': 1774608033.800617}
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD09657') HTTP/1.1" 204 0
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_788547af15c1a6aee9ad7a9faab2eb2e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_788547af15c1a6aee9ad7a9faab2eb2e.jpg not downloaded yet
2026-03-27 10:40:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce5318ef-9eac-5353-b196-ac0aac83978b with identifier: CT00605
2026-03-27 10:40:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce5318ef-9eac-5353-b196-ac0aac83978b with identifier: CT00605
2026-03-27 10:40:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce5318ef-9eac-5353-b196-ac0aac83978b with identifier: CT00605 to the API
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:35:11Z',
'fuel_type': 'diesel',
'id': 'ce5318ef-9eac-5353-b196-ac0aac83978b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT00605',
'listing': 'auction',
'make': 'Renault',
'model': 'Master',
'odometer': 107098,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-21',
'seller_name': None,
'title': 'Renault Master 2.3 dCi L4H2 HKa 3,5t',
'transmission': 'manual',
'trim': 'L4H2 HKa 3,5t',
'year': 2012}
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT00605%27 HTTP/1.1" 200 None
2026-03-27 10:40:34 [auto1.de] INFO: Saving data for CT00605: {'auction_closing_time': 1774715711.0, 'created_time': 1774291296.789796, 'last_price_update_time': 1774608034.187337}
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT00605') HTTP/1.1" 204 0
2026-03-27 10:40:34 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW35011%27 HTTP/1.1" 200 None
2026-03-27 10:40:34 [auto1.de] INFO: Scrape type for NW35011: 2
2026-03-27 10:40:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4 with identifier: NW35011
2026-03-27 10:40:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4 with scrape type 2
2026-03-27 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4 with scrape type 2
2026-03-27 10:40:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4, identifier: NW35011
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_60b8f91ecb86de4bb6bfc400c6d749f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_60b8f91ecb86de4bb6bfc400c6d749f3.jpg not downloaded yet
2026-03-27 10:40:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4 with identifier: NW35011
2026-03-27 10:40:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4 with identifier: NW35011
2026-03-27 10:40:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4 with identifier: NW35011 to the API
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:44:57Z',
'fuel_type': 'petrol',
'id': '9a19e9c9-f905-5aea-9ffc-e6aa6d91ccd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW35011',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 165892,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-20',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2014}
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW35011%27 HTTP/1.1" 200 None
2026-03-27 10:40:34 [auto1.de] INFO: Saving data for NW35011: {'auction_closing_time': 1774716297.0, 'created_time': 1773303376.421663, 'last_price_update_time': 1774608034.697814}
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW35011') HTTP/1.1" 204 0
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_b534a1d51f52df2c0e0fd03f843b151d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_b534a1d51f52df2c0e0fd03f843b151d.jpg not downloaded yet
2026-03-27 10:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY09817> (referer: https://www.auto1.com/v1/car-details-view/NY09817/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:34 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-27 10:40:34 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU42459%27 HTTP/1.1" 200 None
2026-03-27 10:40:34 [auto1.de] INFO: Scrape type for ZU42459: 2
2026-03-27 10:40:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fc8146a-c68a-538c-9f2c-f86396a85877 with identifier: ZU42459
2026-03-27 10:40:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fc8146a-c68a-538c-9f2c-f86396a85877 with scrape type 2
2026-03-27 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fc8146a-c68a-538c-9f2c-f86396a85877 with scrape type 2
2026-03-27 10:40:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fc8146a-c68a-538c-9f2c-f86396a85877, identifier: ZU42459
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_651b42b6785d90c6f41d4dfc30b2fc28.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_651b42b6785d90c6f41d4dfc30b2fc28.jpg not downloaded yet
2026-03-27 10:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_f51e3eadb4b2dc721c5a25ea5c3ae526.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fc8146a-c68a-538c-9f2c-f86396a85877 with identifier: ZU42459
2026-03-27 10:40:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fc8146a-c68a-538c-9f2c-f86396a85877 with identifier: ZU42459
2026-03-27 10:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fc8146a-c68a-538c-9f2c-f86396a85877 with identifier: ZU42459 to the API
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:32:59Z',
'fuel_type': 'petrol',
'id': '4fc8146a-c68a-538c-9f2c-f86396a85877',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU42459',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 126061,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-23',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Cool Edition',
'transmission': 'manual',
'trim': 'Cool Edition',
'year': 2011}
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU42459%27 HTTP/1.1" 200 None
2026-03-27 10:40:35 [auto1.de] INFO: Saving data for ZU42459: {'auction_closing_time': 1774715579.0, 'created_time': 1773553623.348858, 'last_price_update_time': 1774608035.266625}
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU42459') HTTP/1.1" 204 0
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_6d44f211013461c34d0cf6c55a05fdf7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_6d44f211013461c34d0cf6c55a05fdf7.jpg not downloaded yet
2026-03-27 10:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_600fcb2317d1f393412cda17d84552ce.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_27f602b4f262e80a3490fd628a98cb49.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:35 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-27 10:40:35 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ36407%27 HTTP/1.1" 200 None
2026-03-27 10:40:35 [auto1.de] INFO: Scrape type for GJ36407: 2
2026-03-27 10:40:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fc638e2-5f9a-5427-83ef-8968cffef920 with identifier: GJ36407
2026-03-27 10:40:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fc638e2-5f9a-5427-83ef-8968cffef920 with scrape type 2
2026-03-27 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fc638e2-5f9a-5427-83ef-8968cffef920 with scrape type 2
2026-03-27 10:40:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9fc638e2-5f9a-5427-83ef-8968cffef920, identifier: GJ36407
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_1cdae101ad46c4767fbad5a7fbd58889.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_1cdae101ad46c4767fbad5a7fbd58889.jpg not downloaded yet
2026-03-27 10:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL29911> (referer: https://www.auto1.com/v1/car-details-view/KL29911/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_4e41c5e8fa72a2f898f69376b02dc299.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9fc638e2-5f9a-5427-83ef-8968cffef920 with identifier: GJ36407
2026-03-27 10:40:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9fc638e2-5f9a-5427-83ef-8968cffef920 with identifier: GJ36407
2026-03-27 10:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9fc638e2-5f9a-5427-83ef-8968cffef920 with identifier: GJ36407 to the API
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 178,
'expiration_date': '2026-03-28T16:11:00Z',
'fuel_type': 'petrol',
'id': '9fc638e2-5f9a-5427-83ef-8968cffef920',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ36407',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 17861,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-28',
'seller_name': None,
'title': 'MINI Countryman Cooper S Classic Trim',
'transmission': 'automatic',
'trim': 'Classic Trim',
'year': 2022}
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ36407%27 HTTP/1.1" 200 None
2026-03-27 10:40:35 [auto1.de] INFO: Saving data for GJ36407: {'auction_closing_time': 1774714260.0, 'created_time': 1774262881.080456, 'last_price_update_time': 1774608035.992532}
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ36407') HTTP/1.1" 204 0
2026-03-27 10:40:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_3b62b856c05acb2dbaeaed6d673c4992.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:36 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN51512%27 HTTP/1.1" 200 None
2026-03-27 10:40:36 [auto1.de] INFO: Scrape type for XN51512: 2
2026-03-27 10:40:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b82473b4-4037-5be2-b3d5-3d5392bfd397 with identifier: XN51512
2026-03-27 10:40:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b82473b4-4037-5be2-b3d5-3d5392bfd397 with scrape type 2
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b82473b4-4037-5be2-b3d5-3d5392bfd397 with scrape type 2
2026-03-27 10:40:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b82473b4-4037-5be2-b3d5-3d5392bfd397, identifier: XN51512
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_996da63bacd699244a642e2610c5baa5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_996da63bacd699244a642e2610c5baa5.jpg not downloaded yet
2026-03-27 10:40:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 957d5b54-b9d7-5f17-9a31-2ece5d6101a4 with identifier: NY09817
2026-03-27 10:40:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 957d5b54-b9d7-5f17-9a31-2ece5d6101a4 with scrape type 1
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 957d5b54-b9d7-5f17-9a31-2ece5d6101a4
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fde%252Facde683da289e4a021e252f14f32ea56%252Fpa%252FNY09817_4e417db51e9b09b534ccd379fcb4b54a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_4e417db51e9b09b534ccd379fcb4b54a.jpg already downloaded
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fde%252Facde683da289e4a021e252f14f32ea56%252Fpa%252FNY09817_d6751e38e7d642e437e4f9c528e8903d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_d6751e38e7d642e437e4f9c528e8903d.jpg already downloaded
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fde%252Facde683da289e4a021e252f14f32ea56%252Fpa%252FNY09817_7f1a4fe5b030d7715c074e974935b108.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_7f1a4fe5b030d7715c074e974935b108.jpg already downloaded
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fde%252Facde683da289e4a021e252f14f32ea56%252Fpa%252FNY09817_f755dbabd00cf8b7964f236c4dc0faa9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_f755dbabd00cf8b7964f236c4dc0faa9.jpg already downloaded
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fde%252Facde683da289e4a021e252f14f32ea56%252Fpa%252FNY09817_b64d407aec5874491ffbe65f270ce60f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_b64d407aec5874491ffbe65f270ce60f.jpg already downloaded
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fde%252Facde683da289e4a021e252f14f32ea56%252Fpa%252FNY09817_585c78ca1543602ba1a0f128877189b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_585c78ca1543602ba1a0f128877189b9.jpg already downloaded
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fde%252Facde683da289e4a021e252f14f32ea56%252Fpa%252FNY09817_2ff4dbe323f7bb1148961d62782d7171.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_2ff4dbe323f7bb1148961d62782d7171.jpg already downloaded
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fde%252Facde683da289e4a021e252f14f32ea56%252Fpa%252FNY09817_4676778b18b0986b6de956f2a12ea784.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_4676778b18b0986b6de956f2a12ea784.jpg already downloaded
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fde%252Facde683da289e4a021e252f14f32ea56%252Fpa%252FNY09817_ffc528277b5c17ff1c38b1c9b09acbb3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_ffc528277b5c17ff1c38b1c9b09acbb3.jpg already downloaded
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fde%252Facde683da289e4a021e252f14f32ea56%252Fpa%252FNY09817_8b1a61c30a118eb51a7597c68c101564.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_8b1a61c30a118eb51a7597c68c101564.jpg already downloaded
2026-03-27 10:40:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 957d5b54-b9d7-5f17-9a31-2ece5d6101a4, identifier: NY09817
2026-03-27 10:40:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f7d50>
2026-03-27 10:40:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93a00916-98b5-5ed9-92af-a78295bc84fc/93a00916-98b5-5ed9-92af-a78295bc84fc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F82%252Fe282e533e039a47dc64f213d8cfabde4%252Fpa%252FCK84203_f51e3eadb4b2dc721c5a25ea5c3ae526.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_f51e3eadb4b2dc721c5a25ea5c3ae526.jpg saved to cache
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93a00916-98b5-5ed9-92af-a78295bc84fc
2026-03-27 10:40:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_d9e85338f995d28f4d5b6717fc7d45da.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b82473b4-4037-5be2-b3d5-3d5392bfd397 with identifier: XN51512
2026-03-27 10:40:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b82473b4-4037-5be2-b3d5-3d5392bfd397 with identifier: XN51512
2026-03-27 10:40:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b82473b4-4037-5be2-b3d5-3d5392bfd397 with identifier: XN51512 to the API
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:35:26Z',
'fuel_type': 'diesel',
'id': 'b82473b4-4037-5be2-b3d5-3d5392bfd397',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN51512',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 260433,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-25',
'seller_name': None,
'title': 'Ford Focus 1.5 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2017}
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN51512%27 HTTP/1.1" 200 None
2026-03-27 10:40:36 [auto1.de] INFO: Saving data for XN51512: {'auction_closing_time': 1774715726.0, 'created_time': 1772728754.130929, 'last_price_update_time': 1774608036.97426}
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN51512') HTTP/1.1" 204 0
2026-03-27 10:40:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 957d5b54-b9d7-5f17-9a31-2ece5d6101a4 with identifier: NY09817
2026-03-27 10:40:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 957d5b54-b9d7-5f17-9a31-2ece5d6101a4 with identifier: NY09817
2026-03-27 10:40:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 957d5b54-b9d7-5f17-9a31-2ece5d6101a4 with identifier: NY09817 to the API
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NY09817>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:10:03Z',
'fuel_type': 'petrol',
'id': '957d5b54-b9d7-5f17-9a31-2ece5d6101a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY09817',
'listing': 'auction',
'location': 'DE, Hemau',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 167683,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_4e417db51e9b09b534ccd379fcb4b54a.jpg',
'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_d6751e38e7d642e437e4f9c528e8903d.jpg',
'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_7f1a4fe5b030d7715c074e974935b108.jpg',
'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_f755dbabd00cf8b7964f236c4dc0faa9.jpg',
'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_b64d407aec5874491ffbe65f270ce60f.jpg',
'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_585c78ca1543602ba1a0f128877189b9.jpg',
'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_2ff4dbe323f7bb1148961d62782d7171.jpg',
'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_4676778b18b0986b6de956f2a12ea784.jpg',
'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_ffc528277b5c17ff1c38b1c9b09acbb3.jpg',
'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_8b1a61c30a118eb51a7597c68c101564.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_957d5b54-b9d7-5f17-9a31-2ece5d6101a4/957d5b54-b9d7-5f17-9a31-2ece5d6101a4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69304,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_4e417db51e9b09b534ccd379fcb4b54a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_957d5b54-b9d7-5f17-9a31-2ece5d6101a4/957d5b54-b9d7-5f17-9a31-2ece5d6101a4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70631,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_d6751e38e7d642e437e4f9c528e8903d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_957d5b54-b9d7-5f17-9a31-2ece5d6101a4/957d5b54-b9d7-5f17-9a31-2ece5d6101a4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_7f1a4fe5b030d7715c074e974935b108.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_957d5b54-b9d7-5f17-9a31-2ece5d6101a4/957d5b54-b9d7-5f17-9a31-2ece5d6101a4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66194,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_f755dbabd00cf8b7964f236c4dc0faa9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_957d5b54-b9d7-5f17-9a31-2ece5d6101a4/957d5b54-b9d7-5f17-9a31-2ece5d6101a4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63679,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_b64d407aec5874491ffbe65f270ce60f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_957d5b54-b9d7-5f17-9a31-2ece5d6101a4/957d5b54-b9d7-5f17-9a31-2ece5d6101a4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70051,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_585c78ca1543602ba1a0f128877189b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_957d5b54-b9d7-5f17-9a31-2ece5d6101a4/957d5b54-b9d7-5f17-9a31-2ece5d6101a4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_2ff4dbe323f7bb1148961d62782d7171.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_957d5b54-b9d7-5f17-9a31-2ece5d6101a4/957d5b54-b9d7-5f17-9a31-2ece5d6101a4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_4676778b18b0986b6de956f2a12ea784.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_957d5b54-b9d7-5f17-9a31-2ece5d6101a4/957d5b54-b9d7-5f17-9a31-2ece5d6101a4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62897,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_ffc528277b5c17ff1c38b1c9b09acbb3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_957d5b54-b9d7-5f17-9a31-2ece5d6101a4/957d5b54-b9d7-5f17-9a31-2ece5d6101a4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69174,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/de/acde683da289e4a021e252f14f32ea56/pa/NY09817_8b1a61c30a118eb51a7597c68c101564.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-03',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.5 TSI ACT Carat BlueMotion',
'transmission': 'automatic',
'trim': 'Carat BlueMotion',
'year': 2018}
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY09817%27 HTTP/1.1" 200 None
2026-03-27 10:40:37 [auto1.de] INFO: Saving data for NY09817: {'created_time': 1774608037.358498, 'last_price_update_time': 1774608037.358512, 'auction_closing_time': 1774714203.0}
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY09817') HTTP/1.1" 204 0
2026-03-27 10:40:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_b2fc64ddd4c0dc78c5939f89db48362d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:37 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-27 10:40:37 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM84530%27 HTTP/1.1" 200 None
2026-03-27 10:40:37 [auto1.de] INFO: Scrape type for NM84530: 2
2026-03-27 10:40:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10 with identifier: NM84530
2026-03-27 10:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10 with scrape type 2
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10 with scrape type 2
2026-03-27 10:40:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10, identifier: NM84530
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_88fcd27b430c4f2064b093b97cabdb5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_88fcd27b430c4f2064b093b97cabdb5a.jpg not downloaded yet
2026-03-27 10:40:37 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 10513 | hits on page: 40
2026-03-27 10:40:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be008910>
2026-03-27 10:40:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_600fcb2317d1f393412cda17d84552ce.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_600fcb2317d1f393412cda17d84552ce.jpg saved to cache
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea075bdd-3169-5676-9ecf-9541e96e4a78
2026-03-27 10:40:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2830d0>
2026-03-27 10:40:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93a00916-98b5-5ed9-92af-a78295bc84fc/93a00916-98b5-5ed9-92af-a78295bc84fc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F82%252Fe282e533e039a47dc64f213d8cfabde4%252Fpa%252FCK84203_27f602b4f262e80a3490fd628a98cb49.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_27f602b4f262e80a3490fd628a98cb49.jpg saved to cache
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 93a00916-98b5-5ed9-92af-a78295bc84fc
2026-03-27 10:40:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d8551cd-58a9-5767-88fd-643a920471c4 with identifier: KL29911
2026-03-27 10:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d8551cd-58a9-5767-88fd-643a920471c4 with scrape type 1
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d8551cd-58a9-5767-88fd-643a920471c4
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_be2a6454e2936f8ff518d5daebc8d50c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_be2a6454e2936f8ff518d5daebc8d50c.jpg not downloaded yet
2026-03-27 10:40:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1c1310>
2026-03-27 10:40:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93a00916-98b5-5ed9-92af-a78295bc84fc/93a00916-98b5-5ed9-92af-a78295bc84fc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F82%252Fe282e533e039a47dc64f213d8cfabde4%252Fpa%252FCK84203_4e41c5e8fa72a2f898f69376b02dc299.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_4e41c5e8fa72a2f898f69376b02dc299.jpg saved to cache
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 93a00916-98b5-5ed9-92af-a78295bc84fc
2026-03-27 10:40:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_70c260148de45a1bd42902a1feeadb79.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10 with identifier: NM84530
2026-03-27 10:40:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10 with identifier: NM84530
2026-03-27 10:40:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d0d6a08-8052-5feb-9cec-bf4e6c5bae10 with identifier: NM84530 to the API
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:52:38Z',
'fuel_type': 'diesel',
'id': '0d0d6a08-8052-5feb-9cec-bf4e6c5bae10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM84530',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 118782,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-29',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2019}
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM84530%27 HTTP/1.1" 200 None
2026-03-27 10:40:38 [auto1.de] INFO: Saving data for NM84530: {'auction_closing_time': 1774716758.0, 'created_time': 1773468227.047045, 'last_price_update_time': 1774608038.118275}
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM84530') HTTP/1.1" 204 0
2026-03-27 10:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_8fbf31a49d6ba66d35b9756e85bc875c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:38 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-27 10:40:38 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS73974%27 HTTP/1.1" 200 None
2026-03-27 10:40:38 [auto1.de] INFO: Scrape type for MS73974: 2
2026-03-27 10:40:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95f2dc29-fad0-5f6f-84fb-346c1535ef71 with identifier: MS73974
2026-03-27 10:40:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f2dc29-fad0-5f6f-84fb-346c1535ef71 with scrape type 2
2026-03-27 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95f2dc29-fad0-5f6f-84fb-346c1535ef71 with scrape type 2
2026-03-27 10:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95f2dc29-fad0-5f6f-84fb-346c1535ef71, identifier: MS73974
2026-03-27 10:40:38 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18739%27 HTTP/1.1" 200 None
2026-03-27 10:40:38 [auto1.de] INFO: Scrape type for TV18739: 2
2026-03-27 10:40:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a346cde0-3651-5cfc-85a0-4438ac05b9c4 with identifier: TV18739
2026-03-27 10:40:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a346cde0-3651-5cfc-85a0-4438ac05b9c4 with scrape type 2
2026-03-27 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a346cde0-3651-5cfc-85a0-4438ac05b9c4 with scrape type 2
2026-03-27 10:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a346cde0-3651-5cfc-85a0-4438ac05b9c4, identifier: TV18739
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_b9851957556a5d3f1daf5dbd6faf82f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_b9851957556a5d3f1daf5dbd6faf82f0.jpg not downloaded yet
2026-03-27 10:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_651b42b6785d90c6f41d4dfc30b2fc28.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95f2dc29-fad0-5f6f-84fb-346c1535ef71 with identifier: MS73974
2026-03-27 10:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95f2dc29-fad0-5f6f-84fb-346c1535ef71 with identifier: MS73974
2026-03-27 10:40:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95f2dc29-fad0-5f6f-84fb-346c1535ef71 with identifier: MS73974 to the API
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:42:01Z',
'fuel_type': 'diesel',
'id': '95f2dc29-fad0-5f6f-84fb-346c1535ef71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS73974',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 156030,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-08',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.0 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2013}
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS73974%27 HTTP/1.1" 200 None
2026-03-27 10:40:38 [auto1.de] INFO: Saving data for MS73974: {'auction_closing_time': 1774716121.0, 'created_time': 1773230356.63605, 'last_price_update_time': 1774608038.86859}
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS73974') HTTP/1.1" 204 0
2026-03-27 10:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a346cde0-3651-5cfc-85a0-4438ac05b9c4 with identifier: TV18739
2026-03-27 10:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a346cde0-3651-5cfc-85a0-4438ac05b9c4 with identifier: TV18739
2026-03-27 10:40:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a346cde0-3651-5cfc-85a0-4438ac05b9c4 with identifier: TV18739 to the API
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:51:21Z',
'fuel_type': 'petrol',
'id': 'a346cde0-3651-5cfc-85a0-4438ac05b9c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV18739',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 50535,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-11',
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'manual',
'trim': '',
'year': 2017}
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18739%27 HTTP/1.1" 200 None
2026-03-27 10:40:39 [auto1.de] INFO: Saving data for TV18739: {'auction_closing_time': 1774716681.0, 'created_time': 1773514026.253043, 'last_price_update_time': 1774608039.23679}
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV18739') HTTP/1.1" 204 0
2026-03-27 10:40:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2d8750>
2026-03-27 10:40:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_3b62b856c05acb2dbaeaed6d673c4992.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_3b62b856c05acb2dbaeaed6d673c4992.jpg saved to cache
2026-03-27 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea075bdd-3169-5676-9ecf-9541e96e4a78
2026-03-27 10:40:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be024290>
2026-03-27 10:40:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93a00916-98b5-5ed9-92af-a78295bc84fc/93a00916-98b5-5ed9-92af-a78295bc84fc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F82%252Fe282e533e039a47dc64f213d8cfabde4%252Fpa%252FCK84203_d9e85338f995d28f4d5b6717fc7d45da.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_d9e85338f995d28f4d5b6717fc7d45da.jpg saved to cache
2026-03-27 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 93a00916-98b5-5ed9-92af-a78295bc84fc
2026-03-27 10:40:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be085290>
2026-03-27 10:40:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_b2fc64ddd4c0dc78c5939f89db48362d.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_b2fc64ddd4c0dc78c5939f89db48362d.jpg saved to cache
2026-03-27 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab86ac41-15e4-5a0a-95d5-ebcacf93ad20
2026-03-27 10:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_60b8f91ecb86de4bb6bfc400c6d749f3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:39 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS21942%27 HTTP/1.1" 200 None
2026-03-27 10:40:39 [auto1.de] INFO: Scrape type for AS21942: 2
2026-03-27 10:40:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6090e202-fd22-588b-a67a-0c1db55df362 with identifier: AS21942
2026-03-27 10:40:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6090e202-fd22-588b-a67a-0c1db55df362 with scrape type 2
2026-03-27 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6090e202-fd22-588b-a67a-0c1db55df362 with scrape type 2
2026-03-27 10:40:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6090e202-fd22-588b-a67a-0c1db55df362, identifier: AS21942
2026-03-27 10:40:39 [auto1.de] INFO: Found listing with ID: ZG62657
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG62657%27 HTTP/1.1" 200 None
2026-03-27 10:40:39 [auto1.de] INFO: Scrape type for ZG62657: 2
2026-03-27 10:40:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 013e5d1f-cfc7-54b4-be37-ee6a70b1586d with identifier: ZG62657
2026-03-27 10:40:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 013e5d1f-cfc7-54b4-be37-ee6a70b1586d with scrape type 2
2026-03-27 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 013e5d1f-cfc7-54b4-be37-ee6a70b1586d with scrape type 2
2026-03-27 10:40:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 013e5d1f-cfc7-54b4-be37-ee6a70b1586d, identifier: ZG62657
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_a1ad5cd0e62019f90b6c88c06ee3a3dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_a1ad5cd0e62019f90b6c88c06ee3a3dd.jpg not downloaded yet
2026-03-27 10:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_b534a1d51f52df2c0e0fd03f843b151d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6090e202-fd22-588b-a67a-0c1db55df362 with identifier: AS21942
2026-03-27 10:40:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6090e202-fd22-588b-a67a-0c1db55df362 with identifier: AS21942
2026-03-27 10:40:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6090e202-fd22-588b-a67a-0c1db55df362 with identifier: AS21942 to the API
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:48:14Z',
'fuel_type': 'petrol',
'id': '6090e202-fd22-588b-a67a-0c1db55df362',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS21942',
'listing': 'auction',
'make': 'Audi',
'model': 'A1',
'odometer': 115739,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-15',
'seller_name': None,
'title': 'Audi A1 1.2 TFSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2014}
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS21942%27 HTTP/1.1" 200 None
2026-03-27 10:40:39 [auto1.de] INFO: Saving data for AS21942: {'auction_closing_time': 1774716494.0, 'created_time': 1773303444.607229, 'last_price_update_time': 1774608039.957031}
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS21942') HTTP/1.1" 204 0
2026-03-27 10:40:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 013e5d1f-cfc7-54b4-be37-ee6a70b1586d with identifier: ZG62657
2026-03-27 10:40:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 013e5d1f-cfc7-54b4-be37-ee6a70b1586d with identifier: ZG62657
2026-03-27 10:40:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 013e5d1f-cfc7-54b4-be37-ee6a70b1586d with identifier: ZG62657 to the API
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:12:23Z',
'fuel_type': 'petrol',
'id': '013e5d1f-cfc7-54b4-be37-ee6a70b1586d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG62657',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 142280,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-29',
'seller_name': None,
'title': 'Ford Focus 1.5 EcoBoost ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2019}
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG62657%27 HTTP/1.1" 200 None
2026-03-27 10:40:40 [auto1.de] INFO: Saving data for ZG62657: {'auction_closing_time': 1774714343.0, 'created_time': 1773400788.519768, 'last_price_update_time': 1774608040.33819}
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG62657') HTTP/1.1" 204 0
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be021c10>
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_70c260148de45a1bd42902a1feeadb79.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_70c260148de45a1bd42902a1feeadb79.jpg saved to cache
2026-03-27 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea075bdd-3169-5676-9ecf-9541e96e4a78
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0ad6d0>
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_8fbf31a49d6ba66d35b9756e85bc875c.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_8fbf31a49d6ba66d35b9756e85bc875c.jpg saved to cache
2026-03-27 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab86ac41-15e4-5a0a-95d5-ebcacf93ad20
2026-03-27 10:40:40 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN46305%27 HTTP/1.1" 200 None
2026-03-27 10:40:40 [auto1.de] INFO: Scrape type for VN46305: 2
2026-03-27 10:40:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 872d93b7-c682-5bd5-b48f-91f1eb807f59 with identifier: VN46305
2026-03-27 10:40:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 872d93b7-c682-5bd5-b48f-91f1eb807f59 with scrape type 2
2026-03-27 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 872d93b7-c682-5bd5-b48f-91f1eb807f59 with scrape type 2
2026-03-27 10:40:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 872d93b7-c682-5bd5-b48f-91f1eb807f59, identifier: VN46305
2026-03-27 10:40:40 [auto1.de] INFO: Found listing with ID: LZ15789
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ15789%27 HTTP/1.1" 200 None
2026-03-27 10:40:40 [auto1.de] INFO: Scrape type for LZ15789: 2
2026-03-27 10:40:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dada859d-a71c-5cab-a9e5-5b702ddfe659 with identifier: LZ15789
2026-03-27 10:40:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dada859d-a71c-5cab-a9e5-5b702ddfe659 with scrape type 2
2026-03-27 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dada859d-a71c-5cab-a9e5-5b702ddfe659 with scrape type 2
2026-03-27 10:40:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dada859d-a71c-5cab-a9e5-5b702ddfe659, identifier: LZ15789
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_d2c8b6d51e7b77b95cac7f7f4ffafc22.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_d2c8b6d51e7b77b95cac7f7f4ffafc22.jpg not downloaded yet
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf41e490>
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_651b42b6785d90c6f41d4dfc30b2fc28.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_651b42b6785d90c6f41d4dfc30b2fc28.jpg saved to cache
2026-03-27 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab86ac41-15e4-5a0a-95d5-ebcacf93ad20
2026-03-27 10:40:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_658abe3ce61d28b0ba6fc5fc91cadb40.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_788547af15c1a6aee9ad7a9faab2eb2e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 872d93b7-c682-5bd5-b48f-91f1eb807f59 with identifier: VN46305
2026-03-27 10:40:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 872d93b7-c682-5bd5-b48f-91f1eb807f59 with identifier: VN46305
2026-03-27 10:40:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 872d93b7-c682-5bd5-b48f-91f1eb807f59 with identifier: VN46305 to the API
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 450,
'expiration_date': '2026-03-28T16:34:39Z',
'fuel_type': 'petrol',
'id': '872d93b7-c682-5bd5-b48f-91f1eb807f59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN46305',
'listing': 'auction',
'make': 'BMW',
'model': '7er',
'odometer': 180981,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-21',
'seller_name': None,
'title': 'BMW 7er 750i',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-27 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN46305%27 HTTP/1.1" 200 None
2026-03-27 10:40:41 [auto1.de] INFO: Saving data for VN46305: {'auction_closing_time': 1774715679.0, 'created_time': 1774262458.17038, 'last_price_update_time': 1774608041.590819}
2026-03-27 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN46305') HTTP/1.1" 204 0
2026-03-27 10:40:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dada859d-a71c-5cab-a9e5-5b702ddfe659 with identifier: LZ15789
2026-03-27 10:40:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dada859d-a71c-5cab-a9e5-5b702ddfe659 with identifier: LZ15789
2026-03-27 10:40:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dada859d-a71c-5cab-a9e5-5b702ddfe659 with identifier: LZ15789 to the API
2026-03-27 10:40:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:41:54Z',
'fuel_type': 'diesel',
'id': 'dada859d-a71c-5cab-a9e5-5b702ddfe659',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ15789',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 322491,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-28',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI RS',
'transmission': 'manual',
'trim': 'RS',
'year': 2014}
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ15789%27 HTTP/1.1" 200 None
2026-03-27 10:40:42 [auto1.de] INFO: Saving data for LZ15789: {'auction_closing_time': 1774716114.0, 'created_time': 1772547110.62759, 'last_price_update_time': 1774608042.010539}
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ15789') HTTP/1.1" 204 0
2026-03-27 10:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_1cdae101ad46c4767fbad5a7fbd58889.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:42 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-27 10:40:42 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV11727%27 HTTP/1.1" 200 None
2026-03-27 10:40:42 [auto1.de] INFO: Scrape type for TV11727: 2
2026-03-27 10:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dea8b217-5d60-5c42-ae50-137a48d1420d with identifier: TV11727
2026-03-27 10:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dea8b217-5d60-5c42-ae50-137a48d1420d with scrape type 2
2026-03-27 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dea8b217-5d60-5c42-ae50-137a48d1420d with scrape type 2
2026-03-27 10:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dea8b217-5d60-5c42-ae50-137a48d1420d, identifier: TV11727
2026-03-27 10:40:42 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN31203%27 HTTP/1.1" 200 None
2026-03-27 10:40:42 [auto1.de] INFO: Scrape type for PN31203: 2
2026-03-27 10:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70 with identifier: PN31203
2026-03-27 10:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70 with scrape type 2
2026-03-27 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70 with scrape type 2
2026-03-27 10:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70, identifier: PN31203
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_dbc0244c903537a1d7287af37834f014.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_dbc0244c903537a1d7287af37834f014.jpg not downloaded yet
2026-03-27 10:40:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1eabd0>
2026-03-27 10:40:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_60b8f91ecb86de4bb6bfc400c6d749f3.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_60b8f91ecb86de4bb6bfc400c6d749f3.jpg saved to cache
2026-03-27 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab86ac41-15e4-5a0a-95d5-ebcacf93ad20
2026-03-27 10:40:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf3e350>
2026-03-27 10:40:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_b534a1d51f52df2c0e0fd03f843b151d.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_b534a1d51f52df2c0e0fd03f843b151d.jpg saved to cache
2026-03-27 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea075bdd-3169-5676-9ecf-9541e96e4a78
2026-03-27 10:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_6d44f211013461c34d0cf6c55a05fdf7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dea8b217-5d60-5c42-ae50-137a48d1420d with identifier: TV11727
2026-03-27 10:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dea8b217-5d60-5c42-ae50-137a48d1420d with identifier: TV11727
2026-03-27 10:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dea8b217-5d60-5c42-ae50-137a48d1420d with identifier: TV11727 to the API
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-28T16:22:42Z',
'fuel_type': 'petrol',
'id': 'dea8b217-5d60-5c42-ae50-137a48d1420d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV11727',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 121447,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-23',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic Exclusive',
'transmission': 'automatic',
'trim': '4Matic Exclusive',
'year': 2018}
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV11727%27 HTTP/1.1" 200 None
2026-03-27 10:40:42 [auto1.de] INFO: Saving data for TV11727: {'auction_closing_time': 1774714962.0, 'created_time': 1773401041.48768, 'last_price_update_time': 1774608042.866456}
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV11727') HTTP/1.1" 204 0
2026-03-27 10:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70 with identifier: PN31203
2026-03-27 10:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70 with identifier: PN31203
2026-03-27 10:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69ad4ae9-5eaa-5f68-b40c-9ee546dfee70 with identifier: PN31203 to the API
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:23:02Z',
'fuel_type': 'diesel',
'id': '69ad4ae9-5eaa-5f68-b40c-9ee546dfee70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN31203',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 166216,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-30',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2019}
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN31203%27 HTTP/1.1" 200 None
2026-03-27 10:40:43 [auto1.de] INFO: Saving data for PN31203: {'auction_closing_time': 1774714982.0, 'created_time': 1773466901.443638, 'last_price_update_time': 1774608043.260413}
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN31203') HTTP/1.1" 204 0
2026-03-27 10:40:43 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-27 10:40:43 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK39186%27 HTTP/1.1" 200 None
2026-03-27 10:40:43 [auto1.de] INFO: Scrape type for JK39186: 2
2026-03-27 10:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb061c3b-9e55-5a10-9085-4141d8fcdcdd with identifier: JK39186
2026-03-27 10:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb061c3b-9e55-5a10-9085-4141d8fcdcdd with scrape type 2
2026-03-27 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb061c3b-9e55-5a10-9085-4141d8fcdcdd with scrape type 2
2026-03-27 10:40:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb061c3b-9e55-5a10-9085-4141d8fcdcdd, identifier: JK39186
2026-03-27 10:40:43 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC76019%27 HTTP/1.1" 200 None
2026-03-27 10:40:43 [auto1.de] INFO: Scrape type for FC76019: 2
2026-03-27 10:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5b138fc-5bd4-5ea9-a304-6254cfb0812c with identifier: FC76019
2026-03-27 10:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5b138fc-5bd4-5ea9-a304-6254cfb0812c with scrape type 2
2026-03-27 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5b138fc-5bd4-5ea9-a304-6254cfb0812c with scrape type 2
2026-03-27 10:40:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5b138fc-5bd4-5ea9-a304-6254cfb0812c, identifier: FC76019
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_37f9a5692d3f334e128a1be0e3c331c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_37f9a5692d3f334e128a1be0e3c331c2.jpg not downloaded yet
2026-03-27 10:40:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0ac290>
2026-03-27 10:40:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_658abe3ce61d28b0ba6fc5fc91cadb40.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_658abe3ce61d28b0ba6fc5fc91cadb40.jpg saved to cache
2026-03-27 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab86ac41-15e4-5a0a-95d5-ebcacf93ad20
2026-03-27 10:40:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be195e50>
2026-03-27 10:40:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_788547af15c1a6aee9ad7a9faab2eb2e.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_788547af15c1a6aee9ad7a9faab2eb2e.jpg saved to cache
2026-03-27 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea075bdd-3169-5676-9ecf-9541e96e4a78
2026-03-27 10:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_bc7c0f28927a84a76ca8d89daa839855.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb061c3b-9e55-5a10-9085-4141d8fcdcdd with identifier: JK39186
2026-03-27 10:40:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb061c3b-9e55-5a10-9085-4141d8fcdcdd with identifier: JK39186
2026-03-27 10:40:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb061c3b-9e55-5a10-9085-4141d8fcdcdd with identifier: JK39186 to the API
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:16:40Z',
'fuel_type': 'petrol',
'id': 'fb061c3b-9e55-5a10-9085-4141d8fcdcdd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK39186',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 109317,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-12',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 FSI CrossPolo',
'transmission': 'manual',
'trim': 'Cross',
'year': 2010}
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK39186%27 HTTP/1.1" 200 None
2026-03-27 10:40:44 [auto1.de] INFO: Saving data for JK39186: {'auction_closing_time': 1774714600.0, 'created_time': 1773304591.34334, 'last_price_update_time': 1774608044.588392}
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK39186') HTTP/1.1" 204 0
2026-03-27 10:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5b138fc-5bd4-5ea9-a304-6254cfb0812c with identifier: FC76019
2026-03-27 10:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5b138fc-5bd4-5ea9-a304-6254cfb0812c with identifier: FC76019
2026-03-27 10:40:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5b138fc-5bd4-5ea9-a304-6254cfb0812c with identifier: FC76019 to the API
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:30:27Z',
'fuel_type': 'diesel',
'id': 'b5b138fc-5bd4-5ea9-a304-6254cfb0812c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC76019',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 243152,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-22',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Joy',
'transmission': 'automatic',
'trim': 'Joy',
'year': 2017}
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC76019%27 HTTP/1.1" 200 None
2026-03-27 10:40:45 [auto1.de] INFO: Saving data for FC76019: {'auction_closing_time': 1774715427.0, 'created_time': 1772541082.608511, 'last_price_update_time': 1774608045.047903}
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC76019') HTTP/1.1" 204 0
2026-03-27 10:40:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be289250>
2026-03-27 10:40:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_1cdae101ad46c4767fbad5a7fbd58889.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_1cdae101ad46c4767fbad5a7fbd58889.jpg saved to cache
2026-03-27 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab86ac41-15e4-5a0a-95d5-ebcacf93ad20
2026-03-27 10:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_1c57e7b0ec7fc53ee0d06fb60647bf13.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_996da63bacd699244a642e2610c5baa5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:45 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD63050%27 HTTP/1.1" 200 None
2026-03-27 10:40:45 [auto1.de] INFO: Scrape type for RD63050: 2
2026-03-27 10:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 373e7dad-f1ce-5295-9c9b-2c9d07066e8c with identifier: RD63050
2026-03-27 10:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 373e7dad-f1ce-5295-9c9b-2c9d07066e8c with scrape type 2
2026-03-27 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 373e7dad-f1ce-5295-9c9b-2c9d07066e8c with scrape type 2
2026-03-27 10:40:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 373e7dad-f1ce-5295-9c9b-2c9d07066e8c, identifier: RD63050
2026-03-27 10:40:45 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG09102%27 HTTP/1.1" 200 None
2026-03-27 10:40:45 [auto1.de] INFO: Scrape type for FG09102: 2
2026-03-27 10:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 691e4556-610d-5f26-b273-26021a1321f0 with identifier: FG09102
2026-03-27 10:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 691e4556-610d-5f26-b273-26021a1321f0 with scrape type 2
2026-03-27 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 691e4556-610d-5f26-b273-26021a1321f0 with scrape type 2
2026-03-27 10:40:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 691e4556-610d-5f26-b273-26021a1321f0, identifier: FG09102
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_3ec5843577e0ee476387b465a7e46038.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_3ec5843577e0ee476387b465a7e46038.jpg not downloaded yet
2026-03-27 10:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_0725fc6e5224034c5c51e2892783b3da.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 373e7dad-f1ce-5295-9c9b-2c9d07066e8c with identifier: RD63050
2026-03-27 10:40:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 373e7dad-f1ce-5295-9c9b-2c9d07066e8c with identifier: RD63050
2026-03-27 10:40:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 373e7dad-f1ce-5295-9c9b-2c9d07066e8c with identifier: RD63050 to the API
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:56:56Z',
'fuel_type': 'diesel',
'id': '373e7dad-f1ce-5295-9c9b-2c9d07066e8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD63050',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 127550,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-14',
'seller_name': None,
'title': 'Audi Q5 40 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD63050%27 HTTP/1.1" 200 None
2026-03-27 10:40:45 [auto1.de] INFO: Saving data for RD63050: {'auction_closing_time': 1774717016.0, 'created_time': 1773307953.531655, 'last_price_update_time': 1774608045.692828}
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD63050') HTTP/1.1" 204 0
2026-03-27 10:40:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 691e4556-610d-5f26-b273-26021a1321f0 with identifier: FG09102
2026-03-27 10:40:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 691e4556-610d-5f26-b273-26021a1321f0 with identifier: FG09102
2026-03-27 10:40:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 691e4556-610d-5f26-b273-26021a1321f0 with identifier: FG09102 to the API
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:45:31Z',
'fuel_type': 'diesel',
'id': '691e4556-610d-5f26-b273-26021a1321f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG09102',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 167170,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-09-17',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
'transmission': 'automatic',
'trim': 'Sport & Style 4Motion',
'year': 2008}
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG09102%27 HTTP/1.1" 200 None
2026-03-27 10:40:46 [auto1.de] INFO: Saving data for FG09102: {'auction_closing_time': 1774716331.0, 'created_time': 1774262256.235742, 'last_price_update_time': 1774608046.089712}
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG09102') HTTP/1.1" 204 0
2026-03-27 10:40:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be16b8d0>
2026-03-27 10:40:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_6d44f211013461c34d0cf6c55a05fdf7.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_6d44f211013461c34d0cf6c55a05fdf7.jpg saved to cache
2026-03-27 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea075bdd-3169-5676-9ecf-9541e96e4a78
2026-03-27 10:40:46 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-27 10:40:46 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87284%27 HTTP/1.1" 200 None
2026-03-27 10:40:46 [auto1.de] INFO: Scrape type for FK87284: 2
2026-03-27 10:40:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbdc3010-4710-5e62-b105-bfacf1c7d836 with identifier: FK87284
2026-03-27 10:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbdc3010-4710-5e62-b105-bfacf1c7d836 with scrape type 2
2026-03-27 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbdc3010-4710-5e62-b105-bfacf1c7d836 with scrape type 2
2026-03-27 10:40:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbdc3010-4710-5e62-b105-bfacf1c7d836, identifier: FK87284
2026-03-27 10:40:46 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-27 10:40:46 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-27 10:40:46 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35044%27 HTTP/1.1" 200 None
2026-03-27 10:40:46 [auto1.de] INFO: Scrape type for JG35044: 0
2026-03-27 10:40:46 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-27 10:40:46 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18365%27 HTTP/1.1" 200 None
2026-03-27 10:40:46 [auto1.de] INFO: Scrape type for BY18365: 2
2026-03-27 10:40:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eca5d5e-4fd9-5d81-b41b-fa5387c208af with identifier: BY18365
2026-03-27 10:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eca5d5e-4fd9-5d81-b41b-fa5387c208af with scrape type 2
2026-03-27 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3eca5d5e-4fd9-5d81-b41b-fa5387c208af with scrape type 2
2026-03-27 10:40:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3eca5d5e-4fd9-5d81-b41b-fa5387c208af, identifier: BY18365
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_d7144056746e456b03070e94225cf926.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_d7144056746e456b03070e94225cf926.jpg not downloaded yet
2026-03-27 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_be2a6454e2936f8ff518d5daebc8d50c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbdc3010-4710-5e62-b105-bfacf1c7d836 with identifier: FK87284
2026-03-27 10:40:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbdc3010-4710-5e62-b105-bfacf1c7d836 with identifier: FK87284
2026-03-27 10:40:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbdc3010-4710-5e62-b105-bfacf1c7d836 with identifier: FK87284 to the API
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:50:13Z',
'fuel_type': 'diesel',
'id': 'dbdc3010-4710-5e62-b105-bfacf1c7d836',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK87284',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 140458,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-06',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 CDI',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87284%27 HTTP/1.1" 200 None
2026-03-27 10:40:46 [auto1.de] INFO: Saving data for FK87284: {'auction_closing_time': 1774716613.0, 'created_time': 1774291966.938551, 'last_price_update_time': 1774608046.764107}
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK87284') HTTP/1.1" 204 0
2026-03-27 10:40:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3eca5d5e-4fd9-5d81-b41b-fa5387c208af with identifier: BY18365
2026-03-27 10:40:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3eca5d5e-4fd9-5d81-b41b-fa5387c208af with identifier: BY18365
2026-03-27 10:40:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3eca5d5e-4fd9-5d81-b41b-fa5387c208af with identifier: BY18365 to the API
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 83,
'expiration_date': '2026-03-28T16:11:41Z',
'fuel_type': 'petrol',
'id': '3eca5d5e-4fd9-5d81-b41b-fa5387c208af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY18365',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Ignis',
'odometer': 18764,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-12-03',
'seller_name': None,
'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2024}
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18365%27 HTTP/1.1" 200 None
2026-03-27 10:40:47 [auto1.de] INFO: Saving data for BY18365: {'auction_closing_time': 1774714301.0, 'created_time': 1774293976.229033, 'last_price_update_time': 1774608047.105303}
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY18365') HTTP/1.1" 204 0
2026-03-27 10:40:47 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX75388%27 HTTP/1.1" 200 None
2026-03-27 10:40:47 [auto1.de] INFO: Scrape type for HX75388: 2
2026-03-27 10:40:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9 with identifier: HX75388
2026-03-27 10:40:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9 with scrape type 2
2026-03-27 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9 with scrape type 2
2026-03-27 10:40:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9, identifier: HX75388
2026-03-27 10:40:47 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE52525%27 HTTP/1.1" 200 None
2026-03-27 10:40:47 [auto1.de] INFO: Scrape type for BE52525: 2
2026-03-27 10:40:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 406642a3-d969-5745-8934-74863490bf24 with identifier: BE52525
2026-03-27 10:40:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 406642a3-d969-5745-8934-74863490bf24 with scrape type 2
2026-03-27 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 406642a3-d969-5745-8934-74863490bf24 with scrape type 2
2026-03-27 10:40:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 406642a3-d969-5745-8934-74863490bf24, identifier: BE52525
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_a2236aa989f87343bd7658f7f21e07ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_a2236aa989f87343bd7658f7f21e07ac.jpg not downloaded yet
2026-03-27 10:40:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be025fd0>
2026-03-27 10:40:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_bc7c0f28927a84a76ca8d89daa839855.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_bc7c0f28927a84a76ca8d89daa839855.jpg saved to cache
2026-03-27 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea075bdd-3169-5676-9ecf-9541e96e4a78
2026-03-27 10:40:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf41e010>
2026-03-27 10:40:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93a00916-98b5-5ed9-92af-a78295bc84fc/93a00916-98b5-5ed9-92af-a78295bc84fc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F82%252Fe282e533e039a47dc64f213d8cfabde4%252Fpa%252FCK84203_1c57e7b0ec7fc53ee0d06fb60647bf13.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_1c57e7b0ec7fc53ee0d06fb60647bf13.jpg saved to cache
2026-03-27 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 93a00916-98b5-5ed9-92af-a78295bc84fc
2026-03-27 10:40:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0a47d0>
2026-03-27 10:40:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_996da63bacd699244a642e2610c5baa5.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_996da63bacd699244a642e2610c5baa5.jpg saved to cache
2026-03-27 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab86ac41-15e4-5a0a-95d5-ebcacf93ad20
2026-03-27 10:40:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf24850>
2026-03-27 10:40:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93a00916-98b5-5ed9-92af-a78295bc84fc/93a00916-98b5-5ed9-92af-a78295bc84fc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F82%252Fe282e533e039a47dc64f213d8cfabde4%252Fpa%252FCK84203_0725fc6e5224034c5c51e2892783b3da.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_0725fc6e5224034c5c51e2892783b3da.jpg saved to cache
2026-03-27 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 93a00916-98b5-5ed9-92af-a78295bc84fc
2026-03-27 10:40:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93a00916-98b5-5ed9-92af-a78295bc84fc, skipping ID generation
2026-03-27 10:40:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93a00916-98b5-5ed9-92af-a78295bc84fc with scrape type 1
2026-03-27 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93a00916-98b5-5ed9-92af-a78295bc84fc sending to next pipeline
2026-03-27 10:40:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93a00916-98b5-5ed9-92af-a78295bc84fc, identifier: CK84203
2026-03-27 10:40:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_d2c8b6d51e7b77b95cac7f7f4ffafc22.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_88fcd27b430c4f2064b093b97cabdb5a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_b9851957556a5d3f1daf5dbd6faf82f0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9 with identifier: HX75388
2026-03-27 10:40:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9 with identifier: HX75388
2026-03-27 10:40:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9 with identifier: HX75388 to the API
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-28T16:03:06Z',
'fuel_type': 'petrol',
'id': '9ba4e8c0-17a3-5470-b0a7-6bf1ffcaeaf9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX75388',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 50443,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-15',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2020}
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX75388%27 HTTP/1.1" 200 None
2026-03-27 10:40:48 [auto1.de] INFO: Saving data for HX75388: {'auction_closing_time': 1774713786.0, 'created_time': 1773305150.079249, 'last_price_update_time': 1774608048.046541}
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX75388') HTTP/1.1" 204 0
2026-03-27 10:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 406642a3-d969-5745-8934-74863490bf24 with identifier: BE52525
2026-03-27 10:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 406642a3-d969-5745-8934-74863490bf24 with identifier: BE52525
2026-03-27 10:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 406642a3-d969-5745-8934-74863490bf24 with identifier: BE52525 to the API
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:14:57Z',
'fuel_type': 'diesel',
'id': '406642a3-d969-5745-8934-74863490bf24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE52525',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 235302,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-03',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2012}
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE52525%27 HTTP/1.1" 200 None
2026-03-27 10:40:48 [auto1.de] INFO: Saving data for BE52525: {'auction_closing_time': 1774714497.0, 'created_time': 1774251040.727605, 'last_price_update_time': 1774608048.546508}
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE52525') HTTP/1.1" 204 0
2026-03-27 10:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93a00916-98b5-5ed9-92af-a78295bc84fc with identifier: CK84203
2026-03-27 10:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93a00916-98b5-5ed9-92af-a78295bc84fc with identifier: CK84203
2026-03-27 10:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93a00916-98b5-5ed9-92af-a78295bc84fc with identifier: CK84203 to the API
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_0725fc6e5224034c5c51e2892783b3da.jpg>
{'auction_title': '',
'c_o_2_emission_value': 198,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:44:44Z',
'fuel_type': 'petrol',
'id': '93a00916-98b5-5ed9-92af-a78295bc84fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK84203',
'listing': 'auction',
'location': 'Zweibrücken',
'make': 'Subaru',
'model': 'Forester',
'odometer': 227605,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93a00916-98b5-5ed9-92af-a78295bc84fc/93a00916-98b5-5ed9-92af-a78295bc84fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87813,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_f51e3eadb4b2dc721c5a25ea5c3ae526.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93a00916-98b5-5ed9-92af-a78295bc84fc/93a00916-98b5-5ed9-92af-a78295bc84fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82322,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_27f602b4f262e80a3490fd628a98cb49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93a00916-98b5-5ed9-92af-a78295bc84fc/93a00916-98b5-5ed9-92af-a78295bc84fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63879,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_4e41c5e8fa72a2f898f69376b02dc299.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93a00916-98b5-5ed9-92af-a78295bc84fc/93a00916-98b5-5ed9-92af-a78295bc84fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57344,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_d9e85338f995d28f4d5b6717fc7d45da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93a00916-98b5-5ed9-92af-a78295bc84fc/93a00916-98b5-5ed9-92af-a78295bc84fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_0725fc6e5224034c5c51e2892783b3da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93a00916-98b5-5ed9-92af-a78295bc84fc/93a00916-98b5-5ed9-92af-a78295bc84fc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/82/e282e533e039a47dc64f213d8cfabde4/pa/CK84203_1c57e7b0ec7fc53ee0d06fb60647bf13.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-07-29',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Forester 2.0 Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2008}
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK84203%27 HTTP/1.1" 200 None
2026-03-27 10:40:48 [auto1.de] INFO: Saving data for CK84203: {'created_time': 1774608048.970035, 'last_price_update_time': 1774608048.970052, 'auction_closing_time': 1774716284.0}
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK84203') HTTP/1.1" 204 0
2026-03-27 10:40:48 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-27 10:40:48 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE68759%27 HTTP/1.1" 200 None
2026-03-27 10:40:49 [auto1.de] INFO: Scrape type for CE68759: 2
2026-03-27 10:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726 with identifier: CE68759
2026-03-27 10:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726 with scrape type 2
2026-03-27 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726 with scrape type 2
2026-03-27 10:40:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726, identifier: CE68759
2026-03-27 10:40:49 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB36683%27 HTTP/1.1" 200 None
2026-03-27 10:40:49 [auto1.de] INFO: Scrape type for MB36683: 2
2026-03-27 10:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b3942e3-179c-5a20-be04-a6124833a0fc with identifier: MB36683
2026-03-27 10:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b3942e3-179c-5a20-be04-a6124833a0fc with scrape type 2
2026-03-27 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b3942e3-179c-5a20-be04-a6124833a0fc with scrape type 2
2026-03-27 10:40:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b3942e3-179c-5a20-be04-a6124833a0fc, identifier: MB36683
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_c9eb7459d34357578fc784a66bb1aa0e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_c9eb7459d34357578fc784a66bb1aa0e.jpg not downloaded yet
2026-03-27 10:40:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726 with identifier: CE68759
2026-03-27 10:40:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726 with identifier: CE68759
2026-03-27 10:40:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96cf5e01-aa9b-58b6-9c21-0f3e50dd5726 with identifier: CE68759 to the API
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:12:15Z',
'fuel_type': 'diesel',
'id': '96cf5e01-aa9b-58b6-9c21-0f3e50dd5726',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE68759',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i40',
'odometer': 127384,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-12',
'seller_name': None,
'title': 'Hyundai i40 1.7 CRDi Premium Blue',
'transmission': 'manual',
'trim': 'Premium Blue',
'year': 2015}
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE68759%27 HTTP/1.1" 200 None
2026-03-27 10:40:49 [auto1.de] INFO: Saving data for CE68759: {'auction_closing_time': 1774714335.0, 'created_time': 1773138249.071629, 'last_price_update_time': 1774608049.618679}
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE68759') HTTP/1.1" 204 0
2026-03-27 10:40:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b3942e3-179c-5a20-be04-a6124833a0fc with identifier: MB36683
2026-03-27 10:40:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b3942e3-179c-5a20-be04-a6124833a0fc with identifier: MB36683
2026-03-27 10:40:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b3942e3-179c-5a20-be04-a6124833a0fc with identifier: MB36683 to the API
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 530,
'expiration_date': '2026-03-28T16:36:03Z',
'fuel_type': 'petrol',
'id': '8b3942e3-179c-5a20-be04-a6124833a0fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB36683',
'listing': 'auction',
'make': 'BMW',
'model': '8er',
'odometer': 61140,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-16',
'seller_name': None,
'title': 'BMW 8er M850i Gran Coupe xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2021}
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB36683%27 HTTP/1.1" 200 None
2026-03-27 10:40:50 [auto1.de] INFO: Saving data for MB36683: {'auction_closing_time': 1774715763.0, 'created_time': 1773772269.797104, 'last_price_update_time': 1774608050.028792}
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB36683') HTTP/1.1" 204 0
2026-03-27 10:40:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c4249dd0>
2026-03-27 10:40:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_be2a6454e2936f8ff518d5daebc8d50c.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_be2a6454e2936f8ff518d5daebc8d50c.jpg saved to cache
2026-03-27 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d8551cd-58a9-5767-88fd-643a920471c4
2026-03-27 10:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_a1ad5cd0e62019f90b6c88c06ee3a3dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:50 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX30716%27 HTTP/1.1" 200 None
2026-03-27 10:40:50 [auto1.de] INFO: Scrape type for UX30716: 2
2026-03-27 10:40:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1e9fcfe-67df-57e9-8230-d565870f1a92 with identifier: UX30716
2026-03-27 10:40:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1e9fcfe-67df-57e9-8230-d565870f1a92 with scrape type 2
2026-03-27 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1e9fcfe-67df-57e9-8230-d565870f1a92 with scrape type 2
2026-03-27 10:40:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1e9fcfe-67df-57e9-8230-d565870f1a92, identifier: UX30716
2026-03-27 10:40:50 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT08625%27 HTTP/1.1" 200 None
2026-03-27 10:40:50 [auto1.de] INFO: Scrape type for PT08625: 2
2026-03-27 10:40:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b65ed8c8-5731-5d43-aac3-c0d408dd8f9d with identifier: PT08625
2026-03-27 10:40:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b65ed8c8-5731-5d43-aac3-c0d408dd8f9d with scrape type 2
2026-03-27 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b65ed8c8-5731-5d43-aac3-c0d408dd8f9d with scrape type 2
2026-03-27 10:40:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b65ed8c8-5731-5d43-aac3-c0d408dd8f9d, identifier: PT08625
2026-03-27 10:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_37f9a5692d3f334e128a1be0e3c331c2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_dbc0244c903537a1d7287af37834f014.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_4df7d427e82ab0297e0131281a32f8ee.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1e9fcfe-67df-57e9-8230-d565870f1a92 with identifier: UX30716
2026-03-27 10:40:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1e9fcfe-67df-57e9-8230-d565870f1a92 with identifier: UX30716
2026-03-27 10:40:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1e9fcfe-67df-57e9-8230-d565870f1a92 with identifier: UX30716 to the API
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:06:56Z',
'fuel_type': 'petrol',
'id': 'f1e9fcfe-67df-57e9-8230-d565870f1a92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX30716',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 162477,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-15',
'seller_name': None,
'title': 'Skoda Fabia 1.4 TSI RS',
'transmission': 'automatic',
'trim': 'RS',
'year': 2013}
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX30716%27 HTTP/1.1" 200 None
2026-03-27 10:40:50 [auto1.de] INFO: Saving data for UX30716: {'auction_closing_time': 1774714016.0, 'created_time': 1773400616.322835, 'last_price_update_time': 1774608050.768173}
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX30716') HTTP/1.1" 204 0
2026-03-27 10:40:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b65ed8c8-5731-5d43-aac3-c0d408dd8f9d with identifier: PT08625
2026-03-27 10:40:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b65ed8c8-5731-5d43-aac3-c0d408dd8f9d with identifier: PT08625
2026-03-27 10:40:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b65ed8c8-5731-5d43-aac3-c0d408dd8f9d with identifier: PT08625 to the API
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:41:43Z',
'fuel_type': 'diesel',
'id': 'b65ed8c8-5731-5d43-aac3-c0d408dd8f9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT08625',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 209275,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-22',
'seller_name': None,
'title': 'Audi A4 35 TDI Mild-Hybrid S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2019}
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT08625%27 HTTP/1.1" 200 None
2026-03-27 10:40:51 [auto1.de] INFO: Saving data for PT08625: {'auction_closing_time': 1774716103.0, 'created_time': 1774290707.975346, 'last_price_update_time': 1774608051.131821}
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT08625') HTTP/1.1" 204 0
2026-03-27 10:40:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c4248090>
2026-03-27 10:40:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_d2c8b6d51e7b77b95cac7f7f4ffafc22.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_d2c8b6d51e7b77b95cac7f7f4ffafc22.jpg saved to cache
2026-03-27 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d8551cd-58a9-5767-88fd-643a920471c4
2026-03-27 10:40:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf5bc90>
2026-03-27 10:40:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_88fcd27b430c4f2064b093b97cabdb5a.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_88fcd27b430c4f2064b093b97cabdb5a.jpg saved to cache
2026-03-27 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab86ac41-15e4-5a0a-95d5-ebcacf93ad20
2026-03-27 10:40:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be084110>
2026-03-27 10:40:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_b9851957556a5d3f1daf5dbd6faf82f0.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_b9851957556a5d3f1daf5dbd6faf82f0.jpg saved to cache
2026-03-27 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d8551cd-58a9-5767-88fd-643a920471c4
2026-03-27 10:40:51 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ96817%27 HTTP/1.1" 200 None
2026-03-27 10:40:51 [auto1.de] INFO: Scrape type for BZ96817: 2
2026-03-27 10:40:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8813e3d3-be1d-5c4a-ab65-59260910fd45 with identifier: BZ96817
2026-03-27 10:40:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8813e3d3-be1d-5c4a-ab65-59260910fd45 with scrape type 2
2026-03-27 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8813e3d3-be1d-5c4a-ab65-59260910fd45 with scrape type 2
2026-03-27 10:40:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8813e3d3-be1d-5c4a-ab65-59260910fd45, identifier: BZ96817
2026-03-27 10:40:51 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-27 10:40:51 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-27 10:40:51 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24864%27 HTTP/1.1" 200 None
2026-03-27 10:40:51 [auto1.de] INFO: Scrape type for PG24864: 2
2026-03-27 10:40:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17237763-604c-519f-93bb-46962e1d116c with identifier: PG24864
2026-03-27 10:40:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17237763-604c-519f-93bb-46962e1d116c with scrape type 2
2026-03-27 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17237763-604c-519f-93bb-46962e1d116c with scrape type 2
2026-03-27 10:40:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17237763-604c-519f-93bb-46962e1d116c, identifier: PG24864
2026-03-27 10:40:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8813e3d3-be1d-5c4a-ab65-59260910fd45 with identifier: BZ96817
2026-03-27 10:40:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8813e3d3-be1d-5c4a-ab65-59260910fd45 with identifier: BZ96817
2026-03-27 10:40:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8813e3d3-be1d-5c4a-ab65-59260910fd45 with identifier: BZ96817 to the API
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:57:28Z',
'fuel_type': 'petrol',
'id': '8813e3d3-be1d-5c4a-ab65-59260910fd45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ96817',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 44288,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-24',
'seller_name': None,
'title': 'Jeep Renegade 1.4 M-Air Limited 4WD',
'transmission': 'automatic',
'trim': 'Limited 4WD',
'year': 2017}
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ96817%27 HTTP/1.1" 200 None
2026-03-27 10:40:51 [auto1.de] INFO: Saving data for BZ96817: {'auction_closing_time': 1774717048.0, 'created_time': 1773427048.339126, 'last_price_update_time': 1774608051.880941}
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ96817') HTTP/1.1" 204 0
2026-03-27 10:40:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17237763-604c-519f-93bb-46962e1d116c with identifier: PG24864
2026-03-27 10:40:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17237763-604c-519f-93bb-46962e1d116c with identifier: PG24864
2026-03-27 10:40:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17237763-604c-519f-93bb-46962e1d116c with identifier: PG24864 to the API
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:52:15Z',
'fuel_type': 'petrol',
'id': '17237763-604c-519f-93bb-46962e1d116c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG24864',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Giulietta',
'odometer': 53276,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-26',
'seller_name': None,
'title': 'Alfa Romeo Giulietta 1.4 Turbo Super',
'transmission': 'manual',
'trim': 'Super',
'year': 2012}
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24864%27 HTTP/1.1" 200 None
2026-03-27 10:40:52 [auto1.de] INFO: Saving data for PG24864: {'auction_closing_time': 1774716735.0, 'created_time': 1773308284.390759, 'last_price_update_time': 1774608052.252875}
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG24864') HTTP/1.1" 204 0
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf373ad0>
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_a1ad5cd0e62019f90b6c88c06ee3a3dd.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_a1ad5cd0e62019f90b6c88c06ee3a3dd.jpg saved to cache
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d8551cd-58a9-5767-88fd-643a920471c4
2026-03-27 10:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_3ec5843577e0ee476387b465a7e46038.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:52 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX44757%27 HTTP/1.1" 200 None
2026-03-27 10:40:52 [auto1.de] INFO: Scrape type for EX44757: 2
2026-03-27 10:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 066ffbf9-6508-598f-af05-dcba518c9392 with identifier: EX44757
2026-03-27 10:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 066ffbf9-6508-598f-af05-dcba518c9392 with scrape type 2
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 066ffbf9-6508-598f-af05-dcba518c9392 with scrape type 2
2026-03-27 10:40:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 066ffbf9-6508-598f-af05-dcba518c9392, identifier: EX44757
2026-03-27 10:40:52 [auto1.de] INFO: Found listing with ID: YD14218
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD14218%27 HTTP/1.1" 200 None
2026-03-27 10:40:52 [auto1.de] INFO: Scrape type for YD14218: 2
2026-03-27 10:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fcc3f24-5aa5-50fe-b845-76ab66bedd54 with identifier: YD14218
2026-03-27 10:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fcc3f24-5aa5-50fe-b845-76ab66bedd54 with scrape type 2
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fcc3f24-5aa5-50fe-b845-76ab66bedd54 with scrape type 2
2026-03-27 10:40:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fcc3f24-5aa5-50fe-b845-76ab66bedd54, identifier: YD14218
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be085b50>
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_37f9a5692d3f334e128a1be0e3c331c2.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_37f9a5692d3f334e128a1be0e3c331c2.jpg saved to cache
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d8551cd-58a9-5767-88fd-643a920471c4
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1eb750>
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_dbc0244c903537a1d7287af37834f014.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_dbc0244c903537a1d7287af37834f014.jpg saved to cache
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d8551cd-58a9-5767-88fd-643a920471c4
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1eba50>
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_4df7d427e82ab0297e0131281a32f8ee.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_4df7d427e82ab0297e0131281a32f8ee.jpg saved to cache
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea075bdd-3169-5676-9ecf-9541e96e4a78
2026-03-27 10:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_c9eb7459d34357578fc784a66bb1aa0e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_a2236aa989f87343bd7658f7f21e07ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_d7144056746e456b03070e94225cf926.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 066ffbf9-6508-598f-af05-dcba518c9392 with identifier: EX44757
2026-03-27 10:40:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 066ffbf9-6508-598f-af05-dcba518c9392 with identifier: EX44757
2026-03-27 10:40:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 066ffbf9-6508-598f-af05-dcba518c9392 with identifier: EX44757 to the API
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:05:38Z',
'fuel_type': 'diesel',
'id': '066ffbf9-6508-598f-af05-dcba518c9392',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX44757',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 144259,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-16',
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi ST',
'transmission': 'automatic',
'trim': 'ST',
'year': 2016}
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX44757%27 HTTP/1.1" 200 None
2026-03-27 10:40:53 [auto1.de] INFO: Saving data for EX44757: {'auction_closing_time': 1774713938.0, 'created_time': 1774293911.519362, 'last_price_update_time': 1774608053.085079}
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX44757') HTTP/1.1" 204 0
2026-03-27 10:40:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fcc3f24-5aa5-50fe-b845-76ab66bedd54 with identifier: YD14218
2026-03-27 10:40:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fcc3f24-5aa5-50fe-b845-76ab66bedd54 with identifier: YD14218
2026-03-27 10:40:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fcc3f24-5aa5-50fe-b845-76ab66bedd54 with identifier: YD14218 to the API
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:10:35Z',
'fuel_type': 'petrol',
'id': '1fcc3f24-5aa5-50fe-b845-76ab66bedd54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD14218',
'listing': 'auction',
'make': 'Jeep',
'model': 'Compass',
'odometer': 83502,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-25',
'seller_name': None,
'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
'transmission': 'automatic',
'trim': 'Limited 4WD',
'year': 2019}
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD14218%27 HTTP/1.1" 200 None
2026-03-27 10:40:53 [auto1.de] INFO: Saving data for YD14218: {'auction_closing_time': 1774714235.0, 'created_time': 1774292994.735569, 'last_price_update_time': 1774608053.540908}
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD14218') HTTP/1.1" 204 0
2026-03-27 10:40:53 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42572%27 HTTP/1.1" 200 None
2026-03-27 10:40:53 [auto1.de] INFO: Scrape type for DE42572: 2
2026-03-27 10:40:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 557a104b-0f7c-5ec8-b511-88add1c586ed with identifier: DE42572
2026-03-27 10:40:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 557a104b-0f7c-5ec8-b511-88add1c586ed with scrape type 2
2026-03-27 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 557a104b-0f7c-5ec8-b511-88add1c586ed with scrape type 2
2026-03-27 10:40:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 557a104b-0f7c-5ec8-b511-88add1c586ed, identifier: DE42572
2026-03-27 10:40:53 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-27 10:40:53 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ38333%27 HTTP/1.1" 200 None
2026-03-27 10:40:53 [auto1.de] INFO: Scrape type for YZ38333: 2
2026-03-27 10:40:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fd05870-8ece-588f-b3e9-a1a146a40638 with identifier: YZ38333
2026-03-27 10:40:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fd05870-8ece-588f-b3e9-a1a146a40638 with scrape type 2
2026-03-27 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fd05870-8ece-588f-b3e9-a1a146a40638 with scrape type 2
2026-03-27 10:40:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fd05870-8ece-588f-b3e9-a1a146a40638, identifier: YZ38333
2026-03-27 10:40:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 557a104b-0f7c-5ec8-b511-88add1c586ed with identifier: DE42572
2026-03-27 10:40:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 557a104b-0f7c-5ec8-b511-88add1c586ed with identifier: DE42572
2026-03-27 10:40:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 557a104b-0f7c-5ec8-b511-88add1c586ed with identifier: DE42572 to the API
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-28T16:15:23Z',
'fuel_type': 'diesel',
'id': '557a104b-0f7c-5ec8-b511-88add1c586ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE42572',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 148669,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-28',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
'transmission': 'manual',
'trim': 'Sports-Line AWD',
'year': 2016}
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42572%27 HTTP/1.1" 200 None
2026-03-27 10:40:54 [auto1.de] INFO: Saving data for DE42572: {'auction_closing_time': 1774714523.0, 'created_time': 1772545084.892825, 'last_price_update_time': 1774608054.24998}
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE42572') HTTP/1.1" 204 0
2026-03-27 10:40:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fd05870-8ece-588f-b3e9-a1a146a40638 with identifier: YZ38333
2026-03-27 10:40:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fd05870-8ece-588f-b3e9-a1a146a40638 with identifier: YZ38333
2026-03-27 10:40:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fd05870-8ece-588f-b3e9-a1a146a40638 with identifier: YZ38333 to the API
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-28T16:56:40Z',
'fuel_type': 'petrol',
'id': '1fd05870-8ece-588f-b3e9-a1a146a40638',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ38333',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 125343,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-23',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 United',
'transmission': 'manual',
'trim': 'United',
'year': 2009}
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ38333%27 HTTP/1.1" 200 None
2026-03-27 10:40:54 [auto1.de] INFO: Saving data for YZ38333: {'auction_closing_time': 1774717000.0, 'created_time': 1773776269.351749, 'last_price_update_time': 1774608054.627828}
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ38333') HTTP/1.1" 204 0
2026-03-27 10:40:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf383d10>
2026-03-27 10:40:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_3ec5843577e0ee476387b465a7e46038.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_3ec5843577e0ee476387b465a7e46038.jpg saved to cache
2026-03-27 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d8551cd-58a9-5767-88fd-643a920471c4
2026-03-27 10:40:54 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-27 10:40:54 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG17640%27 HTTP/1.1" 200 None
2026-03-27 10:40:54 [auto1.de] INFO: Scrape type for SG17640: 2
2026-03-27 10:40:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d24fdf72-8f38-5f2a-8daf-4114237b5712 with identifier: SG17640
2026-03-27 10:40:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d24fdf72-8f38-5f2a-8daf-4114237b5712 with scrape type 2
2026-03-27 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d24fdf72-8f38-5f2a-8daf-4114237b5712 with scrape type 2
2026-03-27 10:40:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d24fdf72-8f38-5f2a-8daf-4114237b5712, identifier: SG17640
2026-03-27 10:40:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d24fdf72-8f38-5f2a-8daf-4114237b5712 with identifier: SG17640
2026-03-27 10:40:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d24fdf72-8f38-5f2a-8daf-4114237b5712 with identifier: SG17640
2026-03-27 10:40:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d24fdf72-8f38-5f2a-8daf-4114237b5712 with identifier: SG17640 to the API
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:10:28Z',
'fuel_type': 'petrol',
'id': 'd24fdf72-8f38-5f2a-8daf-4114237b5712',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG17640',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 77728,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-05',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Allstar BlueMotion Tech',
'transmission': 'manual',
'trim': 'Allstar BlueMotion Tech',
'year': 2017}
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG17640%27 HTTP/1.1" 200 None
2026-03-27 10:40:55 [auto1.de] INFO: Saving data for SG17640: {'auction_closing_time': 1774714228.0, 'created_time': 1773306899.596154, 'last_price_update_time': 1774608055.184219}
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG17640') HTTP/1.1" 204 0
2026-03-27 10:40:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be197950>
2026-03-27 10:40:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_c9eb7459d34357578fc784a66bb1aa0e.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_c9eb7459d34357578fc784a66bb1aa0e.jpg saved to cache
2026-03-27 10:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2d8551cd-58a9-5767-88fd-643a920471c4
2026-03-27 10:40:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3c7dd0>
2026-03-27 10:40:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_a2236aa989f87343bd7658f7f21e07ac.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_a2236aa989f87343bd7658f7f21e07ac.jpg saved to cache
2026-03-27 10:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d8551cd-58a9-5767-88fd-643a920471c4
2026-03-27 10:40:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be262810>
2026-03-27 10:40:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F35%252F0b352abee86ed911fc0eede71ee93ed7%252Fpa%252FKL29911_d7144056746e456b03070e94225cf926.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_d7144056746e456b03070e94225cf926.jpg saved to cache
2026-03-27 10:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d8551cd-58a9-5767-88fd-643a920471c4
2026-03-27 10:40:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d8551cd-58a9-5767-88fd-643a920471c4, skipping ID generation
2026-03-27 10:40:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d8551cd-58a9-5767-88fd-643a920471c4 with scrape type 1
2026-03-27 10:40:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d8551cd-58a9-5767-88fd-643a920471c4 sending to next pipeline
2026-03-27 10:40:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d8551cd-58a9-5767-88fd-643a920471c4, identifier: KL29911
2026-03-27 10:40:55 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-27 10:40:55 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-27 10:40:55 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB26225%27 HTTP/1.1" 200 None
2026-03-27 10:40:55 [auto1.de] INFO: Scrape type for AB26225: 2
2026-03-27 10:40:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33 with identifier: AB26225
2026-03-27 10:40:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33 with scrape type 2
2026-03-27 10:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33 with scrape type 2
2026-03-27 10:40:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33, identifier: AB26225
2026-03-27 10:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d8551cd-58a9-5767-88fd-643a920471c4 with identifier: KL29911
2026-03-27 10:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d8551cd-58a9-5767-88fd-643a920471c4 with identifier: KL29911
2026-03-27 10:40:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d8551cd-58a9-5767-88fd-643a920471c4 with identifier: KL29911 to the API
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_d7144056746e456b03070e94225cf926.jpg>
{'auction_title': '',
'c_o_2_emission_value': 188,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 231,
'expiration_date': '2026-03-28T16:46:44Z',
'fuel_type': 'diesel',
'id': '2d8551cd-58a9-5767-88fd-643a920471c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL29911',
'listing': 'auction',
'location': 'DE, Göttingen',
'make': 'Audi',
'model': 'A6',
'odometer': 60565,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_be2a6454e2936f8ff518d5daebc8d50c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82277,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_b9851957556a5d3f1daf5dbd6faf82f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_a1ad5cd0e62019f90b6c88c06ee3a3dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69544,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_d2c8b6d51e7b77b95cac7f7f4ffafc22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70499,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_dbc0244c903537a1d7287af37834f014.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79065,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_37f9a5692d3f334e128a1be0e3c331c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_3ec5843577e0ee476387b465a7e46038.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_d7144056746e456b03070e94225cf926.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_a2236aa989f87343bd7658f7f21e07ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d8551cd-58a9-5767-88fd-643a920471c4/2d8551cd-58a9-5767-88fd-643a920471c4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77434,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/35/0b352abee86ed911fc0eede71ee93ed7/pa/KL29911_c9eb7459d34357578fc784a66bb1aa0e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-12-12',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL29911%27 HTTP/1.1" 200 None
2026-03-27 10:40:55 [auto1.de] INFO: Saving data for KL29911: {'created_time': 1774608055.967395, 'last_price_update_time': 1774608055.967409, 'auction_closing_time': 1774716404.0}
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL29911') HTTP/1.1" 204 0
2026-03-27 10:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33 with identifier: AB26225
2026-03-27 10:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33 with identifier: AB26225
2026-03-27 10:40:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33 with identifier: AB26225 to the API
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:45:47Z',
'fuel_type': 'diesel',
'id': '63c1f834-1ac9-5b0a-a245-1f4bc5d5fb33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB26225',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 25742,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-22',
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 2.0 TDI R-Line 4Motion',
'transmission': 'automatic',
'trim': 'R-Line 4Motion',
'year': 2024}
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB26225%27 HTTP/1.1" 200 None
2026-03-27 10:40:56 [auto1.de] INFO: Saving data for AB26225: {'auction_closing_time': 1774716347.0, 'created_time': 1773773960.64453, 'last_price_update_time': 1774608056.353699}
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB26225') HTTP/1.1" 204 0
2026-03-27 10:40:56 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS33010%27 HTTP/1.1" 200 None
2026-03-27 10:40:56 [auto1.de] INFO: Scrape type for GS33010: 2
2026-03-27 10:40:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68add022-1957-5f1e-b41c-9cc43047c1e6 with identifier: GS33010
2026-03-27 10:40:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68add022-1957-5f1e-b41c-9cc43047c1e6 with scrape type 2
2026-03-27 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68add022-1957-5f1e-b41c-9cc43047c1e6 with scrape type 2
2026-03-27 10:40:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68add022-1957-5f1e-b41c-9cc43047c1e6, identifier: GS33010
2026-03-27 10:40:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68add022-1957-5f1e-b41c-9cc43047c1e6 with identifier: GS33010
2026-03-27 10:40:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68add022-1957-5f1e-b41c-9cc43047c1e6 with identifier: GS33010
2026-03-27 10:40:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68add022-1957-5f1e-b41c-9cc43047c1e6 with identifier: GS33010 to the API
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:00:57Z',
'fuel_type': 'diesel',
'id': '68add022-1957-5f1e-b41c-9cc43047c1e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS33010',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 136487,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-28',
'seller_name': None,
'title': 'Renault Kadjar 1.5 dCi Energy Bose Edition',
'transmission': 'automatic',
'trim': 'Bose Edition',
'year': 2016}
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS33010%27 HTTP/1.1" 200 None
2026-03-27 10:40:56 [auto1.de] INFO: Saving data for GS33010: {'auction_closing_time': 1774713657.0, 'created_time': 1773306688.360531, 'last_price_update_time': 1774608056.824828}
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS33010') HTTP/1.1" 204 0
2026-03-27 10:40:56 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-27 10:40:56 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-27 10:40:56 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE32009%27 HTTP/1.1" 200 None
2026-03-27 10:40:56 [auto1.de] INFO: Scrape type for SE32009: 2
2026-03-27 10:40:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1388515-9030-558e-8089-f77320185b27 with identifier: SE32009
2026-03-27 10:40:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1388515-9030-558e-8089-f77320185b27 with scrape type 2
2026-03-27 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1388515-9030-558e-8089-f77320185b27 with scrape type 2
2026-03-27 10:40:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1388515-9030-558e-8089-f77320185b27, identifier: SE32009
2026-03-27 10:40:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1388515-9030-558e-8089-f77320185b27 with identifier: SE32009
2026-03-27 10:40:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1388515-9030-558e-8089-f77320185b27 with identifier: SE32009
2026-03-27 10:40:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1388515-9030-558e-8089-f77320185b27 with identifier: SE32009 to the API
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:19:46Z',
'fuel_type': 'diesel',
'id': 'd1388515-9030-558e-8089-f77320185b27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE32009',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 284650,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-09',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Cup BlueMotion Tech',
'transmission': 'manual',
'trim': 'Cup BlueMotion Tech',
'year': 2015}
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE32009%27 HTTP/1.1" 200 None
2026-03-27 10:40:57 [auto1.de] INFO: Saving data for SE32009: {'auction_closing_time': 1774714786.0, 'created_time': 1773775854.531316, 'last_price_update_time': 1774608057.323031}
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE32009') HTTP/1.1" 204 0
2026-03-27 10:40:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_39b36dbfb1bb86afcb4627581d2b2198.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:57 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK17231%27 HTTP/1.1" 200 None
2026-03-27 10:40:57 [auto1.de] INFO: Scrape type for LK17231: 2
2026-03-27 10:40:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 726745aa-17cc-59d9-8902-f42288787c70 with identifier: LK17231
2026-03-27 10:40:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 726745aa-17cc-59d9-8902-f42288787c70 with scrape type 2
2026-03-27 10:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 726745aa-17cc-59d9-8902-f42288787c70 with scrape type 2
2026-03-27 10:40:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 726745aa-17cc-59d9-8902-f42288787c70, identifier: LK17231
2026-03-27 10:40:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 726745aa-17cc-59d9-8902-f42288787c70 with identifier: LK17231
2026-03-27 10:40:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 726745aa-17cc-59d9-8902-f42288787c70 with identifier: LK17231
2026-03-27 10:40:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 726745aa-17cc-59d9-8902-f42288787c70 with identifier: LK17231 to the API
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-28T16:05:44Z',
'fuel_type': 'petrol',
'id': '726745aa-17cc-59d9-8902-f42288787c70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK17231',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 57672,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-07-31',
'seller_name': None,
'title': 'Citroen C3 1.4 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2007}
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK17231%27 HTTP/1.1" 200 None
2026-03-27 10:40:57 [auto1.de] INFO: Saving data for LK17231: {'auction_closing_time': 1774713944.0, 'created_time': 1773138506.134942, 'last_price_update_time': 1774608057.880579}
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK17231') HTTP/1.1" 204 0
2026-03-27 10:40:57 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-27 10:40:57 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-27 10:40:57 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR41525%27 HTTP/1.1" 200 None
2026-03-27 10:40:57 [auto1.de] INFO: Scrape type for RR41525: 1
2026-03-27 10:40:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_81d9847665e0460273898c50e5a8d510.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_6d1e69edd1d5e89eea217e9bde0a9dae.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:40:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be169050>
2026-03-27 10:40:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_39b36dbfb1bb86afcb4627581d2b2198.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_39b36dbfb1bb86afcb4627581d2b2198.jpg saved to cache
2026-03-27 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea075bdd-3169-5676-9ecf-9541e96e4a78
2026-03-27 10:40:58 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV40367%27 HTTP/1.1" 200 None
2026-03-27 10:40:58 [auto1.de] INFO: Scrape type for ZV40367: 2
2026-03-27 10:40:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 343825b6-49dc-5a85-9088-4793f940efd8 with identifier: ZV40367
2026-03-27 10:40:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 343825b6-49dc-5a85-9088-4793f940efd8 with scrape type 2
2026-03-27 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 343825b6-49dc-5a85-9088-4793f940efd8 with scrape type 2
2026-03-27 10:40:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 343825b6-49dc-5a85-9088-4793f940efd8, identifier: ZV40367
2026-03-27 10:40:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 343825b6-49dc-5a85-9088-4793f940efd8 with identifier: ZV40367
2026-03-27 10:40:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 343825b6-49dc-5a85-9088-4793f940efd8 with identifier: ZV40367
2026-03-27 10:40:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 343825b6-49dc-5a85-9088-4793f940efd8 with identifier: ZV40367 to the API
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-28T16:24:00Z',
'fuel_type': 'diesel',
'id': '343825b6-49dc-5a85-9088-4793f940efd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV40367',
'listing': 'auction',
'make': 'Kia',
'model': 'XCeed',
'odometer': 165182,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-26',
'seller_name': None,
'title': 'Kia XCeed 1.6 CRDi Mild-Hybrid Platinum Edition',
'transmission': 'automatic',
'trim': 'Platinum Edition',
'year': 2020}
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV40367%27 HTTP/1.1" 200 None
2026-03-27 10:40:58 [auto1.de] INFO: Saving data for ZV40367: {'auction_closing_time': 1774715040.0, 'created_time': 1774293764.556894, 'last_price_update_time': 1774608058.628579}
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV40367') HTTP/1.1" 204 0
2026-03-27 10:40:58 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ71992%27 HTTP/1.1" 200 None
2026-03-27 10:40:58 [auto1.de] INFO: Scrape type for YJ71992: 2
2026-03-27 10:40:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e075a32-3f89-5397-83f9-ea619d98c775 with identifier: YJ71992
2026-03-27 10:40:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e075a32-3f89-5397-83f9-ea619d98c775 with scrape type 2
2026-03-27 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e075a32-3f89-5397-83f9-ea619d98c775 with scrape type 2
2026-03-27 10:40:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e075a32-3f89-5397-83f9-ea619d98c775, identifier: YJ71992
2026-03-27 10:40:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e075a32-3f89-5397-83f9-ea619d98c775 with identifier: YJ71992
2026-03-27 10:40:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e075a32-3f89-5397-83f9-ea619d98c775 with identifier: YJ71992
2026-03-27 10:40:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e075a32-3f89-5397-83f9-ea619d98c775 with identifier: YJ71992 to the API
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:46:58Z',
'fuel_type': 'petrol',
'id': '6e075a32-3f89-5397-83f9-ea619d98c775',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ71992',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 98553,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-27',
'seller_name': None,
'title': 'Hyundai i20 1.0 TGDI Passion blue',
'transmission': 'manual',
'trim': 'Passion blue',
'year': 2017}
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ71992%27 HTTP/1.1" 200 None
2026-03-27 10:40:59 [auto1.de] INFO: Saving data for YJ71992: {'auction_closing_time': 1774716418.0, 'created_time': 1773399081.076848, 'last_price_update_time': 1774608059.244512}
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ71992') HTTP/1.1" 204 0
2026-03-27 10:40:59 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ40966%27 HTTP/1.1" 200 None
2026-03-27 10:40:59 [auto1.de] INFO: Scrape type for PZ40966: 2
2026-03-27 10:40:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754 with identifier: PZ40966
2026-03-27 10:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754 with scrape type 2
2026-03-27 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754 with scrape type 2
2026-03-27 10:40:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754, identifier: PZ40966
2026-03-27 10:40:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:40:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3d7190>
2026-03-27 10:40:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fe4%252F25e436cd10cc36169e2179e053e84bbc%252Fpa%252FXX11179_81d9847665e0460273898c50e5a8d510.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_81d9847665e0460273898c50e5a8d510.jpg saved to cache
2026-03-27 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea075bdd-3169-5676-9ecf-9541e96e4a78
2026-03-27 10:40:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea075bdd-3169-5676-9ecf-9541e96e4a78, skipping ID generation
2026-03-27 10:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea075bdd-3169-5676-9ecf-9541e96e4a78 with scrape type 1
2026-03-27 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea075bdd-3169-5676-9ecf-9541e96e4a78 sending to next pipeline
2026-03-27 10:40:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea075bdd-3169-5676-9ecf-9541e96e4a78, identifier: XX11179
2026-03-27 10:40:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:40:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1eb310>
2026-03-27 10:40:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_6d1e69edd1d5e89eea217e9bde0a9dae.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_6d1e69edd1d5e89eea217e9bde0a9dae.jpg saved to cache
2026-03-27 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab86ac41-15e4-5a0a-95d5-ebcacf93ad20
2026-03-27 10:40:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754 with identifier: PZ40966
2026-03-27 10:40:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754 with identifier: PZ40966
2026-03-27 10:40:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fad701c-4d70-5dbe-86d4-b3e0b5f9c754 with identifier: PZ40966 to the API
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:26:02Z',
'fuel_type': 'diesel',
'id': '6fad701c-4d70-5dbe-86d4-b3e0b5f9c754',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ40966',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 315753,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-16',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2012}
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ40966%27 HTTP/1.1" 200 None
2026-03-27 10:41:00 [auto1.de] INFO: Saving data for PZ40966: {'auction_closing_time': 1774715162.0, 'created_time': 1774264778.726008, 'last_price_update_time': 1774608060.082881}
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ40966') HTTP/1.1" 204 0
2026-03-27 10:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea075bdd-3169-5676-9ecf-9541e96e4a78 with identifier: XX11179
2026-03-27 10:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea075bdd-3169-5676-9ecf-9541e96e4a78 with identifier: XX11179
2026-03-27 10:41:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea075bdd-3169-5676-9ecf-9541e96e4a78 with identifier: XX11179 to the API
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_81d9847665e0460273898c50e5a8d510.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:20:48Z',
'fuel_type': 'diesel',
'id': 'ea075bdd-3169-5676-9ecf-9541e96e4a78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX11179',
'listing': 'auction',
'location': 'DE, Chemnitz',
'make': 'Peugeot',
'model': '308',
'odometer': 243707,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2976620,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_39b36dbfb1bb86afcb4627581d2b2198.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3002331,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_81d9847665e0460273898c50e5a8d510.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70375,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_600fcb2317d1f393412cda17d84552ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_3b62b856c05acb2dbaeaed6d673c4992.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63979,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_70c260148de45a1bd42902a1feeadb79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_4df7d427e82ab0297e0131281a32f8ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61628,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_bc7c0f28927a84a76ca8d89daa839855.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_788547af15c1a6aee9ad7a9faab2eb2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_b534a1d51f52df2c0e0fd03f843b151d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea075bdd-3169-5676-9ecf-9541e96e4a78/ea075bdd-3169-5676-9ecf-9541e96e4a78_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71063,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/e4/25e436cd10cc36169e2179e053e84bbc/pa/XX11179_6d44f211013461c34d0cf6c55a05fdf7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2016}
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX11179%27 HTTP/1.1" 200 None
2026-03-27 10:41:00 [auto1.de] INFO: Saving data for XX11179: {'created_time': 1774608060.630387, 'last_price_update_time': 1774608060.630401, 'auction_closing_time': 1774714848.0}
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX11179') HTTP/1.1" 204 0
2026-03-27 10:41:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_48fa7101be619b26c9854cb0930fe5e4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:00 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-27 10:41:00 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-27 10:41:00 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ15757%27 HTTP/1.1" 200 None
2026-03-27 10:41:00 [auto1.de] INFO: Scrape type for CJ15757: 2
2026-03-27 10:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09438e73-d914-53f3-bada-408f83318c2d with identifier: CJ15757
2026-03-27 10:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09438e73-d914-53f3-bada-408f83318c2d with scrape type 2
2026-03-27 10:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09438e73-d914-53f3-bada-408f83318c2d with scrape type 2
2026-03-27 10:41:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09438e73-d914-53f3-bada-408f83318c2d, identifier: CJ15757
2026-03-27 10:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09438e73-d914-53f3-bada-408f83318c2d with identifier: CJ15757
2026-03-27 10:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09438e73-d914-53f3-bada-408f83318c2d with identifier: CJ15757
2026-03-27 10:41:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09438e73-d914-53f3-bada-408f83318c2d with identifier: CJ15757 to the API
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:23:15Z',
'fuel_type': 'petrol',
'id': '09438e73-d914-53f3-bada-408f83318c2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ15757',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 80798,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-01-31',
'seller_name': None,
'title': 'Ford Mondeo 1.8 Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2000}
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ15757%27 HTTP/1.1" 200 None
2026-03-27 10:41:01 [auto1.de] INFO: Saving data for CJ15757: {'auction_closing_time': 1774714995.0, 'created_time': 1774290787.757626, 'last_price_update_time': 1774608061.286613}
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ15757') HTTP/1.1" 204 0
2026-03-27 10:41:01 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19748%27 HTTP/1.1" 200 None
2026-03-27 10:41:01 [auto1.de] INFO: Scrape type for ED19748: 2
2026-03-27 10:41:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ebe3833-29fb-5033-941d-3bb64549385d with identifier: ED19748
2026-03-27 10:41:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ebe3833-29fb-5033-941d-3bb64549385d with scrape type 2
2026-03-27 10:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ebe3833-29fb-5033-941d-3bb64549385d with scrape type 2
2026-03-27 10:41:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ebe3833-29fb-5033-941d-3bb64549385d, identifier: ED19748
2026-03-27 10:41:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ebe3833-29fb-5033-941d-3bb64549385d with identifier: ED19748
2026-03-27 10:41:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ebe3833-29fb-5033-941d-3bb64549385d with identifier: ED19748
2026-03-27 10:41:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ebe3833-29fb-5033-941d-3bb64549385d with identifier: ED19748 to the API
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:01:06Z',
'fuel_type': 'diesel',
'id': '4ebe3833-29fb-5033-941d-3bb64549385d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED19748',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 308342,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-03',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline BlueTDI',
'transmission': 'automatic',
'trim': 'Highline BlueTDI',
'year': 2011}
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19748%27 HTTP/1.1" 200 None
2026-03-27 10:41:01 [auto1.de] INFO: Saving data for ED19748: {'auction_closing_time': 1774713666.0, 'created_time': 1773772239.384143, 'last_price_update_time': 1774608061.809927}
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED19748') HTTP/1.1" 204 0
2026-03-27 10:41:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be283b90>
2026-03-27 10:41:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F0a%252F080a788534a16e3c40d76efe3c57a033%252Fpa%252FZL15649_48fa7101be619b26c9854cb0930fe5e4.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_48fa7101be619b26c9854cb0930fe5e4.jpg saved to cache
2026-03-27 10:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab86ac41-15e4-5a0a-95d5-ebcacf93ad20
2026-03-27 10:41:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab86ac41-15e4-5a0a-95d5-ebcacf93ad20, skipping ID generation
2026-03-27 10:41:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 with scrape type 1
2026-03-27 10:41:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 sending to next pipeline
2026-03-27 10:41:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab86ac41-15e4-5a0a-95d5-ebcacf93ad20, identifier: ZL15649
2026-03-27 10:41:02 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-27 10:41:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 with identifier: ZL15649
2026-03-27 10:41:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 with identifier: ZL15649
2026-03-27 10:41:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab86ac41-15e4-5a0a-95d5-ebcacf93ad20 with identifier: ZL15649 to the API
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_48fa7101be619b26c9854cb0930fe5e4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-03-28T16:21:52Z',
'fuel_type': 'diesel',
'id': 'ab86ac41-15e4-5a0a-95d5-ebcacf93ad20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL15649',
'listing': 'auction',
'location': 'DE, Kempten (Allgäu)',
'make': 'Dacia',
'model': 'Duster',
'odometer': 158866,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2868622,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_6d1e69edd1d5e89eea217e9bde0a9dae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3076399,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_48fa7101be619b26c9854cb0930fe5e4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87337,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_b2fc64ddd4c0dc78c5939f89db48362d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69541,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_8fbf31a49d6ba66d35b9756e85bc875c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_658abe3ce61d28b0ba6fc5fc91cadb40.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_60b8f91ecb86de4bb6bfc400c6d749f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50734,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_651b42b6785d90c6f41d4dfc30b2fc28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_1cdae101ad46c4767fbad5a7fbd58889.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79994,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_996da63bacd699244a642e2610c5baa5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab86ac41-15e4-5a0a-95d5-ebcacf93ad20/ab86ac41-15e4-5a0a-95d5-ebcacf93ad20_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/0a/080a788534a16e3c40d76efe3c57a033/pa/ZL15649_88fcd27b430c4f2064b093b97cabdb5a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.5 Blue dCi Prestige 4x4',
'transmission': 'manual',
'trim': 'Prestige 4x4',
'year': 2019}
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL15649%27 HTTP/1.1" 200 None
2026-03-27 10:41:02 [auto1.de] INFO: Saving data for ZL15649: {'created_time': 1774608062.530867, 'last_price_update_time': 1774608062.530882, 'auction_closing_time': 1774714912.0}
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL15649') HTTP/1.1" 204 0
2026-03-27 10:41:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:02 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 10515 | hits on page: 40
2026-03-27 10:41:02 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19748%27 HTTP/1.1" 200 None
2026-03-27 10:41:02 [auto1.de] INFO: Scrape type for ED19748: 0
2026-03-27 10:41:02 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-27 10:41:02 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72792%27 HTTP/1.1" 200 None
2026-03-27 10:41:02 [auto1.de] INFO: Scrape type for MZ72792: 2
2026-03-27 10:41:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d010d4d-9a59-5c69-a014-5c837822749c with identifier: MZ72792
2026-03-27 10:41:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d010d4d-9a59-5c69-a014-5c837822749c with scrape type 2
2026-03-27 10:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d010d4d-9a59-5c69-a014-5c837822749c with scrape type 2
2026-03-27 10:41:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d010d4d-9a59-5c69-a014-5c837822749c, identifier: MZ72792
2026-03-27 10:41:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d010d4d-9a59-5c69-a014-5c837822749c with identifier: MZ72792
2026-03-27 10:41:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d010d4d-9a59-5c69-a014-5c837822749c with identifier: MZ72792
2026-03-27 10:41:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d010d4d-9a59-5c69-a014-5c837822749c with identifier: MZ72792 to the API
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:48:52Z',
'fuel_type': 'petrol',
'id': '2d010d4d-9a59-5c69-a014-5c837822749c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ72792',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 68453,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-29',
'seller_name': None,
'title': 'Fiat 500X 1.6 Pop',
'transmission': 'manual',
'trim': 'Pop',
'year': 2015}
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72792%27 HTTP/1.1" 200 None
2026-03-27 10:41:03 [auto1.de] INFO: Saving data for MZ72792: {'auction_closing_time': 1774716532.0, 'created_time': 1774294843.294277, 'last_price_update_time': 1774608063.147452}
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ72792') HTTP/1.1" 204 0
2026-03-27 10:41:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:03 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48150%27 HTTP/1.1" 200 None
2026-03-27 10:41:03 [auto1.de] INFO: Scrape type for WP48150: 1
2026-03-27 10:41:03 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH13363%27 HTTP/1.1" 200 None
2026-03-27 10:41:03 [auto1.de] INFO: Scrape type for DH13363: 2
2026-03-27 10:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f6be045-35c8-5181-bff7-9484fde1cc59 with identifier: DH13363
2026-03-27 10:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f6be045-35c8-5181-bff7-9484fde1cc59 with scrape type 2
2026-03-27 10:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f6be045-35c8-5181-bff7-9484fde1cc59 with scrape type 2
2026-03-27 10:41:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f6be045-35c8-5181-bff7-9484fde1cc59, identifier: DH13363
2026-03-27 10:41:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f6be045-35c8-5181-bff7-9484fde1cc59 with identifier: DH13363
2026-03-27 10:41:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f6be045-35c8-5181-bff7-9484fde1cc59 with identifier: DH13363
2026-03-27 10:41:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f6be045-35c8-5181-bff7-9484fde1cc59 with identifier: DH13363 to the API
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 394,
'expiration_date': '2026-03-28T16:47:09Z',
'fuel_type': 'hybrid',
'id': '9f6be045-35c8-5181-bff7-9484fde1cc59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH13363',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 86712,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-07',
'seller_name': None,
'title': 'BMW 5er 545e xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2020}
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH13363%27 HTTP/1.1" 200 None
2026-03-27 10:41:03 [auto1.de] INFO: Saving data for DH13363: {'auction_closing_time': 1774716429.0, 'created_time': 1772541914.691906, 'last_price_update_time': 1774608063.663774}
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH13363') HTTP/1.1" 204 0
2026-03-27 10:41:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:03 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-27 10:41:03 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-27 10:41:03 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-27 10:41:03 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-27 10:41:03 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE69852%27 HTTP/1.1" 200 None
2026-03-27 10:41:03 [auto1.de] INFO: Scrape type for YE69852: 2
2026-03-27 10:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd270fc7-7388-5dbe-b8e0-a314ba978fd3 with identifier: YE69852
2026-03-27 10:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd270fc7-7388-5dbe-b8e0-a314ba978fd3 with scrape type 2
2026-03-27 10:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd270fc7-7388-5dbe-b8e0-a314ba978fd3 with scrape type 2
2026-03-27 10:41:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd270fc7-7388-5dbe-b8e0-a314ba978fd3, identifier: YE69852
2026-03-27 10:41:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd270fc7-7388-5dbe-b8e0-a314ba978fd3 with identifier: YE69852
2026-03-27 10:41:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd270fc7-7388-5dbe-b8e0-a314ba978fd3 with identifier: YE69852
2026-03-27 10:41:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd270fc7-7388-5dbe-b8e0-a314ba978fd3 with identifier: YE69852 to the API
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:25:06Z',
'fuel_type': 'diesel',
'id': 'cd270fc7-7388-5dbe-b8e0-a314ba978fd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE69852',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 162044,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-28',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Elegance 4Motion',
'transmission': 'automatic',
'trim': 'Elegance 4Motion',
'year': 2022}
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE69852%27 HTTP/1.1" 200 None
2026-03-27 10:41:04 [auto1.de] INFO: Saving data for YE69852: {'auction_closing_time': 1774715106.0, 'created_time': 1774292323.627707, 'last_price_update_time': 1774608064.224556}
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE69852') HTTP/1.1" 204 0
2026-03-27 10:41:04 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-27 10:41:04 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT10840%27 HTTP/1.1" 200 None
2026-03-27 10:41:04 [auto1.de] INFO: Scrape type for KT10840: 2
2026-03-27 10:41:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9482a3f-a4d1-5e4e-9de1-bae9acefdff3 with identifier: KT10840
2026-03-27 10:41:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9482a3f-a4d1-5e4e-9de1-bae9acefdff3 with scrape type 2
2026-03-27 10:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9482a3f-a4d1-5e4e-9de1-bae9acefdff3 with scrape type 2
2026-03-27 10:41:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9482a3f-a4d1-5e4e-9de1-bae9acefdff3, identifier: KT10840
2026-03-27 10:41:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9482a3f-a4d1-5e4e-9de1-bae9acefdff3 with identifier: KT10840
2026-03-27 10:41:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9482a3f-a4d1-5e4e-9de1-bae9acefdff3 with identifier: KT10840
2026-03-27 10:41:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9482a3f-a4d1-5e4e-9de1-bae9acefdff3 with identifier: KT10840 to the API
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:28:46Z',
'fuel_type': 'diesel',
'id': 'a9482a3f-a4d1-5e4e-9de1-bae9acefdff3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT10840',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 159916,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-13',
'seller_name': None,
'title': 'Nissan Qashqai 1.6 dCi I-Way',
'transmission': 'manual',
'trim': 'I-Way',
'year': 2012}
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT10840%27 HTTP/1.1" 200 None
2026-03-27 10:41:04 [auto1.de] INFO: Saving data for KT10840: {'auction_closing_time': 1774715326.0, 'created_time': 1773859686.043765, 'last_price_update_time': 1774608064.853793}
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT10840') HTTP/1.1" 204 0
2026-03-27 10:41:04 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-27 10:41:04 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-27 10:41:04 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-27 10:41:04 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-27 10:41:04 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS46633%27 HTTP/1.1" 200 None
2026-03-27 10:41:04 [auto1.de] INFO: Scrape type for ZS46633: 2
2026-03-27 10:41:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16a8ca54-f1c9-54af-8c63-909933dca976 with identifier: ZS46633
2026-03-27 10:41:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16a8ca54-f1c9-54af-8c63-909933dca976 with scrape type 2
2026-03-27 10:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16a8ca54-f1c9-54af-8c63-909933dca976 with scrape type 2
2026-03-27 10:41:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16a8ca54-f1c9-54af-8c63-909933dca976, identifier: ZS46633
2026-03-27 10:41:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16a8ca54-f1c9-54af-8c63-909933dca976 with identifier: ZS46633
2026-03-27 10:41:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16a8ca54-f1c9-54af-8c63-909933dca976 with identifier: ZS46633
2026-03-27 10:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16a8ca54-f1c9-54af-8c63-909933dca976 with identifier: ZS46633 to the API
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 195,
'expiration_date': '2026-03-28T16:51:50Z',
'fuel_type': 'diesel',
'id': '16a8ca54-f1c9-54af-8c63-909933dca976',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS46633',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 120588,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-14',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2018}
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS46633%27 HTTP/1.1" 200 None
2026-03-27 10:41:05 [auto1.de] INFO: Saving data for ZS46633: {'auction_closing_time': 1774716710.0, 'created_time': 1774294707.804659, 'last_price_update_time': 1774608065.355684}
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS46633') HTTP/1.1" 204 0
2026-03-27 10:41:05 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-27 10:41:05 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-27 10:41:05 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-27 10:41:05 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-27 10:41:05 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA97502%27 HTTP/1.1" 200 None
2026-03-27 10:41:05 [auto1.de] INFO: Scrape type for PA97502: 2
2026-03-27 10:41:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa with identifier: PA97502
2026-03-27 10:41:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa with scrape type 2
2026-03-27 10:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa with scrape type 2
2026-03-27 10:41:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa, identifier: PA97502
2026-03-27 10:41:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa with identifier: PA97502
2026-03-27 10:41:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa with identifier: PA97502
2026-03-27 10:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d559c7c-361b-5c58-a8ca-c2bc92fd41aa with identifier: PA97502 to the API
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:06:00Z',
'fuel_type': 'petrol',
'id': '9d559c7c-361b-5c58-a8ca-c2bc92fd41aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA97502',
'listing': 'auction',
'make': 'Suzuki',
'model': 'SX4',
'odometer': 21785,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-27',
'seller_name': None,
'title': 'Suzuki SX4 1.0 BoosterJet Comfort',
'transmission': 'automatic',
'trim': 'Comfort',
'year': 2018}
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA97502%27 HTTP/1.1" 200 None
2026-03-27 10:41:05 [auto1.de] INFO: Saving data for PA97502: {'auction_closing_time': 1774713960.0, 'created_time': 1773513855.997175, 'last_price_update_time': 1774608065.913654}
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA97502') HTTP/1.1" 204 0
2026-03-27 10:41:06 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW94281%27 HTTP/1.1" 200 None
2026-03-27 10:41:06 [auto1.de] INFO: Scrape type for DW94281: 2
2026-03-27 10:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 192065ea-4837-5530-b55a-136c4bd63fb6 with identifier: DW94281
2026-03-27 10:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 192065ea-4837-5530-b55a-136c4bd63fb6 with scrape type 2
2026-03-27 10:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 192065ea-4837-5530-b55a-136c4bd63fb6 with scrape type 2
2026-03-27 10:41:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 192065ea-4837-5530-b55a-136c4bd63fb6, identifier: DW94281
2026-03-27 10:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 192065ea-4837-5530-b55a-136c4bd63fb6 with identifier: DW94281
2026-03-27 10:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 192065ea-4837-5530-b55a-136c4bd63fb6 with identifier: DW94281
2026-03-27 10:41:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 192065ea-4837-5530-b55a-136c4bd63fb6 with identifier: DW94281 to the API
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:56:02Z',
'fuel_type': 'petrol',
'id': '192065ea-4837-5530-b55a-136c4bd63fb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW94281',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 188120,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-31',
'seller_name': None,
'title': 'Ford Focus 1.6 Viva',
'transmission': 'manual',
'trim': 'Viva',
'year': 2010}
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW94281%27 HTTP/1.1" 200 None
2026-03-27 10:41:06 [auto1.de] INFO: Saving data for DW94281: {'auction_closing_time': 1774716962.0, 'created_time': 1773399868.924884, 'last_price_update_time': 1774608066.709665}
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW94281') HTTP/1.1" 204 0
2026-03-27 10:41:06 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL76152%27 HTTP/1.1" 200 None
2026-03-27 10:41:06 [auto1.de] INFO: Scrape type for ZL76152: 2
2026-03-27 10:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d38d383-9e06-5511-a737-bad9cc168a9f with identifier: ZL76152
2026-03-27 10:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d38d383-9e06-5511-a737-bad9cc168a9f with scrape type 2
2026-03-27 10:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d38d383-9e06-5511-a737-bad9cc168a9f with scrape type 2
2026-03-27 10:41:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d38d383-9e06-5511-a737-bad9cc168a9f, identifier: ZL76152
2026-03-27 10:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d38d383-9e06-5511-a737-bad9cc168a9f with identifier: ZL76152
2026-03-27 10:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d38d383-9e06-5511-a737-bad9cc168a9f with identifier: ZL76152
2026-03-27 10:41:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d38d383-9e06-5511-a737-bad9cc168a9f with identifier: ZL76152 to the API
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:19:49Z',
'fuel_type': 'petrol',
'id': '8d38d383-9e06-5511-a737-bad9cc168a9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL76152',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 105595,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-27',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 250 CGI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2011}
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL76152%27 HTTP/1.1" 200 None
2026-03-27 10:41:07 [auto1.de] INFO: Saving data for ZL76152: {'auction_closing_time': 1774714789.0, 'created_time': 1773860325.950857, 'last_price_update_time': 1774608067.282046}
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL76152') HTTP/1.1" 204 0
2026-03-27 10:41:07 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-27 10:41:07 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM62598%27 HTTP/1.1" 200 None
2026-03-27 10:41:07 [auto1.de] INFO: Scrape type for XM62598: 2
2026-03-27 10:41:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac98c68d-0c56-58a4-be10-88fa949d6da3 with identifier: XM62598
2026-03-27 10:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac98c68d-0c56-58a4-be10-88fa949d6da3 with scrape type 2
2026-03-27 10:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac98c68d-0c56-58a4-be10-88fa949d6da3 with scrape type 2
2026-03-27 10:41:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac98c68d-0c56-58a4-be10-88fa949d6da3, identifier: XM62598
2026-03-27 10:41:07 [scrapy.extensions.logstats] INFO: Crawled 332 pages (at 13 pages/min), scraped 583 items (at 103 items/min)
2026-03-27 10:41:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-27 10:41:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac98c68d-0c56-58a4-be10-88fa949d6da3 with identifier: XM62598
2026-03-27 10:41:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac98c68d-0c56-58a4-be10-88fa949d6da3 with identifier: XM62598
2026-03-27 10:41:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac98c68d-0c56-58a4-be10-88fa949d6da3 with identifier: XM62598 to the API
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-28T16:20:29Z',
'fuel_type': 'diesel',
'id': 'ac98c68d-0c56-58a4-be10-88fa949d6da3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM62598',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 160561,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-28',
'seller_name': None,
'title': 'BMW 5er 530d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2011}
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM62598%27 HTTP/1.1" 200 None
2026-03-27 10:41:07 [auto1.de] INFO: Saving data for XM62598: {'auction_closing_time': 1774714829.0, 'created_time': 1773859175.463235, 'last_price_update_time': 1774608067.86297}
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM62598') HTTP/1.1" 204 0
2026-03-27 10:41:07 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV89057%27 HTTP/1.1" 200 None
2026-03-27 10:41:07 [auto1.de] INFO: Scrape type for CV89057: 2
2026-03-27 10:41:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39e01bac-766d-5890-905e-f1b51cedee13 with identifier: CV89057
2026-03-27 10:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39e01bac-766d-5890-905e-f1b51cedee13 with scrape type 2
2026-03-27 10:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39e01bac-766d-5890-905e-f1b51cedee13 with scrape type 2
2026-03-27 10:41:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39e01bac-766d-5890-905e-f1b51cedee13, identifier: CV89057
2026-03-27 10:41:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39e01bac-766d-5890-905e-f1b51cedee13 with identifier: CV89057
2026-03-27 10:41:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39e01bac-766d-5890-905e-f1b51cedee13 with identifier: CV89057
2026-03-27 10:41:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39e01bac-766d-5890-905e-f1b51cedee13 with identifier: CV89057 to the API
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-28T16:28:56Z',
'fuel_type': 'petrol',
'id': '39e01bac-766d-5890-905e-f1b51cedee13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV89057',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 73793,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-03',
'seller_name': None,
'title': 'BMW 3er 330i Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2019}
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV89057%27 HTTP/1.1" 200 None
2026-03-27 10:41:08 [auto1.de] INFO: Saving data for CV89057: {'auction_closing_time': 1774715336.0, 'created_time': 1773775548.891016, 'last_price_update_time': 1774608068.32654}
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV89057') HTTP/1.1" 204 0
2026-03-27 10:41:08 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV98525%27 HTTP/1.1" 200 None
2026-03-27 10:41:08 [auto1.de] INFO: Scrape type for LV98525: 2
2026-03-27 10:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb222700-2d65-5811-b59a-94d310519ef8 with identifier: LV98525
2026-03-27 10:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb222700-2d65-5811-b59a-94d310519ef8 with scrape type 2
2026-03-27 10:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb222700-2d65-5811-b59a-94d310519ef8 with scrape type 2
2026-03-27 10:41:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb222700-2d65-5811-b59a-94d310519ef8, identifier: LV98525
2026-03-27 10:41:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb222700-2d65-5811-b59a-94d310519ef8 with identifier: LV98525
2026-03-27 10:41:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb222700-2d65-5811-b59a-94d310519ef8 with identifier: LV98525
2026-03-27 10:41:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb222700-2d65-5811-b59a-94d310519ef8 with identifier: LV98525 to the API
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:15:31Z',
'fuel_type': 'petrol',
'id': 'eb222700-2d65-5811-b59a-94d310519ef8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV98525',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 114641,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-28',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TSI Comfortline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline 4Motion BlueMotion',
'year': 2017}
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV98525%27 HTTP/1.1" 200 None
2026-03-27 10:41:08 [auto1.de] INFO: Saving data for LV98525: {'auction_closing_time': 1774714531.0, 'created_time': 1773341874.231617, 'last_price_update_time': 1774608068.766046}
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV98525') HTTP/1.1" 204 0
2026-03-27 10:41:08 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-27 10:41:08 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-27 10:41:08 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL85665%27 HTTP/1.1" 200 None
2026-03-27 10:41:08 [auto1.de] INFO: Scrape type for VL85665: 2
2026-03-27 10:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e577adca-0663-5fe8-a520-8be939a414b4 with identifier: VL85665
2026-03-27 10:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e577adca-0663-5fe8-a520-8be939a414b4 with scrape type 2
2026-03-27 10:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e577adca-0663-5fe8-a520-8be939a414b4 with scrape type 2
2026-03-27 10:41:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e577adca-0663-5fe8-a520-8be939a414b4, identifier: VL85665
2026-03-27 10:41:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e577adca-0663-5fe8-a520-8be939a414b4 with identifier: VL85665
2026-03-27 10:41:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e577adca-0663-5fe8-a520-8be939a414b4 with identifier: VL85665
2026-03-27 10:41:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e577adca-0663-5fe8-a520-8be939a414b4 with identifier: VL85665 to the API
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:50:05Z',
'fuel_type': 'petrol',
'id': 'e577adca-0663-5fe8-a520-8be939a414b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL85665',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 76325,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-04',
'seller_name': None,
'title': 'Kia Sportage 1.6 GDI Dream Team 2WD',
'transmission': 'manual',
'trim': 'Dream Team 2WD',
'year': 2013}
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL85665%27 HTTP/1.1" 200 None
2026-03-27 10:41:09 [auto1.de] INFO: Saving data for VL85665: {'auction_closing_time': 1774716605.0, 'created_time': 1774292314.418907, 'last_price_update_time': 1774608069.235226}
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL85665') HTTP/1.1" 204 0
2026-03-27 10:41:09 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC38320%27 HTTP/1.1" 200 None
2026-03-27 10:41:09 [auto1.de] INFO: Scrape type for EC38320: 2
2026-03-27 10:41:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a6a751a-545c-5e48-a2ef-e082675a23e7 with identifier: EC38320
2026-03-27 10:41:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a6a751a-545c-5e48-a2ef-e082675a23e7 with scrape type 2
2026-03-27 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a6a751a-545c-5e48-a2ef-e082675a23e7 with scrape type 2
2026-03-27 10:41:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a6a751a-545c-5e48-a2ef-e082675a23e7, identifier: EC38320
2026-03-27 10:41:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a6a751a-545c-5e48-a2ef-e082675a23e7 with identifier: EC38320
2026-03-27 10:41:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a6a751a-545c-5e48-a2ef-e082675a23e7 with identifier: EC38320
2026-03-27 10:41:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a6a751a-545c-5e48-a2ef-e082675a23e7 with identifier: EC38320 to the API
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-03-28T16:10:04Z',
'fuel_type': 'petrol',
'id': '6a6a751a-545c-5e48-a2ef-e082675a23e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC38320',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 126278,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-23',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 THP Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2016}
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC38320%27 HTTP/1.1" 200 None
2026-03-27 10:41:09 [auto1.de] INFO: Saving data for EC38320: {'auction_closing_time': 1774714204.0, 'created_time': 1774290672.439097, 'last_price_update_time': 1774608069.691205}
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC38320') HTTP/1.1" 204 0
2026-03-27 10:41:09 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK20650%27 HTTP/1.1" 200 None
2026-03-27 10:41:09 [auto1.de] INFO: Scrape type for KK20650: 2
2026-03-27 10:41:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7 with identifier: KK20650
2026-03-27 10:41:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7 with scrape type 2
2026-03-27 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7 with scrape type 2
2026-03-27 10:41:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7, identifier: KK20650
2026-03-27 10:41:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7 with identifier: KK20650
2026-03-27 10:41:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7 with identifier: KK20650
2026-03-27 10:41:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95ab3343-5ae0-58d5-a0c2-f71d75d86bb7 with identifier: KK20650 to the API
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:15:29Z',
'fuel_type': 'petrol',
'id': '95ab3343-5ae0-58d5-a0c2-f71d75d86bb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK20650',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 222034,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-30',
'seller_name': None,
'title': 'Volkswagen Golf V 1.4 TSI United',
'transmission': 'manual',
'trim': 'United',
'year': 2008}
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK20650%27 HTTP/1.1" 200 None
2026-03-27 10:41:10 [auto1.de] INFO: Saving data for KK20650: {'auction_closing_time': 1774714529.0, 'created_time': 1773858654.076532, 'last_price_update_time': 1774608070.19213}
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK20650') HTTP/1.1" 204 0
2026-03-27 10:41:10 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45914%27 HTTP/1.1" 200 None
2026-03-27 10:41:10 [auto1.de] INFO: Scrape type for UB45914: 2
2026-03-27 10:41:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9b5d624-463b-5ff3-adf8-fda5f7a092b0 with identifier: UB45914
2026-03-27 10:41:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9b5d624-463b-5ff3-adf8-fda5f7a092b0 with scrape type 2
2026-03-27 10:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9b5d624-463b-5ff3-adf8-fda5f7a092b0 with scrape type 2
2026-03-27 10:41:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9b5d624-463b-5ff3-adf8-fda5f7a092b0, identifier: UB45914
2026-03-27 10:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9b5d624-463b-5ff3-adf8-fda5f7a092b0 with identifier: UB45914
2026-03-27 10:41:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9b5d624-463b-5ff3-adf8-fda5f7a092b0 with identifier: UB45914
2026-03-27 10:41:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9b5d624-463b-5ff3-adf8-fda5f7a092b0 with identifier: UB45914 to the API
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:53:45Z',
'fuel_type': 'petrol',
'id': 'b9b5d624-463b-5ff3-adf8-fda5f7a092b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB45914',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 14299,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-26',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2023}
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45914%27 HTTP/1.1" 200 None
2026-03-27 10:41:10 [auto1.de] INFO: Saving data for UB45914: {'auction_closing_time': 1774716825.0, 'created_time': 1773134726.310967, 'last_price_update_time': 1774608070.818263}
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB45914') HTTP/1.1" 204 0
2026-03-27 10:41:10 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY62714%27 HTTP/1.1" 200 None
2026-03-27 10:41:10 [auto1.de] INFO: Scrape type for ZY62714: 2
2026-03-27 10:41:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aac8b8a-e6ff-50e7-ad34-5b5751990815 with identifier: ZY62714
2026-03-27 10:41:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aac8b8a-e6ff-50e7-ad34-5b5751990815 with scrape type 2
2026-03-27 10:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aac8b8a-e6ff-50e7-ad34-5b5751990815 with scrape type 2
2026-03-27 10:41:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9aac8b8a-e6ff-50e7-ad34-5b5751990815, identifier: ZY62714
2026-03-27 10:41:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9aac8b8a-e6ff-50e7-ad34-5b5751990815 with identifier: ZY62714
2026-03-27 10:41:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9aac8b8a-e6ff-50e7-ad34-5b5751990815 with identifier: ZY62714
2026-03-27 10:41:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9aac8b8a-e6ff-50e7-ad34-5b5751990815 with identifier: ZY62714 to the API
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 333,
'expiration_date': '2026-03-28T16:44:19Z',
'fuel_type': 'petrol',
'id': '9aac8b8a-e6ff-50e7-ad34-5b5751990815',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY62714',
'listing': 'auction',
'make': 'Audi',
'model': 'S4',
'odometer': 196122,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-11',
'seller_name': None,
'title': 'Audi S4 3.0 V6 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2012}
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY62714%27 HTTP/1.1" 200 None
2026-03-27 10:41:11 [auto1.de] INFO: Saving data for ZY62714: {'auction_closing_time': 1774716259.0, 'created_time': 1773305612.110451, 'last_price_update_time': 1774608071.349752}
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY62714') HTTP/1.1" 204 0
2026-03-27 10:41:11 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64995%27 HTTP/1.1" 200 None
2026-03-27 10:41:11 [auto1.de] INFO: Scrape type for FT64995: 2
2026-03-27 10:41:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f126b95-5027-5a84-b75f-b2351277ebd4 with identifier: FT64995
2026-03-27 10:41:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f126b95-5027-5a84-b75f-b2351277ebd4 with scrape type 2
2026-03-27 10:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f126b95-5027-5a84-b75f-b2351277ebd4 with scrape type 2
2026-03-27 10:41:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f126b95-5027-5a84-b75f-b2351277ebd4, identifier: FT64995
2026-03-27 10:41:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f126b95-5027-5a84-b75f-b2351277ebd4 with identifier: FT64995
2026-03-27 10:41:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f126b95-5027-5a84-b75f-b2351277ebd4 with identifier: FT64995
2026-03-27 10:41:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f126b95-5027-5a84-b75f-b2351277ebd4 with identifier: FT64995 to the API
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:40:05Z',
'fuel_type': 'petrol',
'id': '8f126b95-5027-5a84-b75f-b2351277ebd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT64995',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 141860,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-06',
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 1.4 TSI ACT Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2018}
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64995%27 HTTP/1.1" 200 None
2026-03-27 10:41:11 [auto1.de] INFO: Saving data for FT64995: {'auction_closing_time': 1774716005.0, 'created_time': 1773427432.40136, 'last_price_update_time': 1774608071.852221}
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT64995') HTTP/1.1" 204 0
2026-03-27 10:41:11 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 10515 | hits on page: 40
2026-03-27 10:41:11 [auto1.de] INFO: Found listing with ID: WL25699
2026-03-27 10:41:11 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM72901%27 HTTP/1.1" 200 None
2026-03-27 10:41:11 [auto1.de] INFO: Scrape type for CM72901: 2
2026-03-27 10:41:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26265610-a3a5-57d7-af23-6a7033a17a58 with identifier: CM72901
2026-03-27 10:41:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26265610-a3a5-57d7-af23-6a7033a17a58 with scrape type 2
2026-03-27 10:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26265610-a3a5-57d7-af23-6a7033a17a58 with scrape type 2
2026-03-27 10:41:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26265610-a3a5-57d7-af23-6a7033a17a58, identifier: CM72901
2026-03-27 10:41:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26265610-a3a5-57d7-af23-6a7033a17a58 with identifier: CM72901
2026-03-27 10:41:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26265610-a3a5-57d7-af23-6a7033a17a58 with identifier: CM72901
2026-03-27 10:41:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26265610-a3a5-57d7-af23-6a7033a17a58 with identifier: CM72901 to the API
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:35:59Z',
'fuel_type': 'petrol',
'id': '26265610-a3a5-57d7-af23-6a7033a17a58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM72901',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 22668,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-16',
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TFSI ACT S line',
'transmission': 'manual',
'trim': 'ACT S line',
'year': 2021}
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM72901%27 HTTP/1.1" 200 None
2026-03-27 10:41:12 [auto1.de] INFO: Saving data for CM72901: {'auction_closing_time': 1774715759.0, 'created_time': 1773305916.665395, 'last_price_update_time': 1774608072.407545}
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM72901') HTTP/1.1" 204 0
2026-03-27 10:41:12 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10430%27 HTTP/1.1" 200 None
2026-03-27 10:41:12 [auto1.de] INFO: Scrape type for HA10430: 2
2026-03-27 10:41:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dd0e221-f794-59ec-8975-d479bc20b4ff with identifier: HA10430
2026-03-27 10:41:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dd0e221-f794-59ec-8975-d479bc20b4ff with scrape type 2
2026-03-27 10:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dd0e221-f794-59ec-8975-d479bc20b4ff with scrape type 2
2026-03-27 10:41:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4dd0e221-f794-59ec-8975-d479bc20b4ff, identifier: HA10430
2026-03-27 10:41:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:12 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-27 10:41:12 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-27 10:41:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4dd0e221-f794-59ec-8975-d479bc20b4ff with identifier: HA10430
2026-03-27 10:41:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4dd0e221-f794-59ec-8975-d479bc20b4ff with identifier: HA10430
2026-03-27 10:41:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4dd0e221-f794-59ec-8975-d479bc20b4ff with identifier: HA10430 to the API
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:46:13Z',
'fuel_type': 'petrol',
'id': '4dd0e221-f794-59ec-8975-d479bc20b4ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA10430',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 216830,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-31',
'seller_name': None,
'title': 'Mitsubishi Outlander 2.0 MIVEC Invite ClearTec 4WD',
'transmission': 'automatic',
'trim': 'Invite ClearTec 4WD',
'year': 2014}
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10430%27 HTTP/1.1" 200 None
2026-03-27 10:41:12 [auto1.de] INFO: Saving data for HA10430: {'auction_closing_time': 1774716373.0, 'created_time': 1773342431.988387, 'last_price_update_time': 1774608072.901341}
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA10430') HTTP/1.1" 204 0
2026-03-27 10:41:12 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD54604%27 HTTP/1.1" 200 None
2026-03-27 10:41:12 [auto1.de] INFO: Scrape type for TD54604: 2
2026-03-27 10:41:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17b15ff8-c947-5a41-9ebe-b88869245f47 with identifier: TD54604
2026-03-27 10:41:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17b15ff8-c947-5a41-9ebe-b88869245f47 with scrape type 2
2026-03-27 10:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17b15ff8-c947-5a41-9ebe-b88869245f47 with scrape type 2
2026-03-27 10:41:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17b15ff8-c947-5a41-9ebe-b88869245f47, identifier: TD54604
2026-03-27 10:41:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17b15ff8-c947-5a41-9ebe-b88869245f47 with identifier: TD54604
2026-03-27 10:41:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17b15ff8-c947-5a41-9ebe-b88869245f47 with identifier: TD54604
2026-03-27 10:41:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17b15ff8-c947-5a41-9ebe-b88869245f47 with identifier: TD54604 to the API
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:53:26Z',
'fuel_type': 'diesel',
'id': '17b15ff8-c947-5a41-9ebe-b88869245f47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD54604',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 195114,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-03',
'seller_name': None,
'title': 'Opel Astra 1.7 CDTI Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2015}
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD54604%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [auto1.de] INFO: Saving data for TD54604: {'auction_closing_time': 1774716806.0, 'created_time': 1773341236.375464, 'last_price_update_time': 1774608073.34125}
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD54604') HTTP/1.1" 204 0
2026-03-27 10:41:13 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-27 10:41:13 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74169%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [auto1.de] INFO: Scrape type for DJ74169: 2
2026-03-27 10:41:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1 with identifier: DJ74169
2026-03-27 10:41:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1 with scrape type 2
2026-03-27 10:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1 with scrape type 2
2026-03-27 10:41:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1, identifier: DJ74169
2026-03-27 10:41:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1 with identifier: DJ74169
2026-03-27 10:41:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1 with identifier: DJ74169
2026-03-27 10:41:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1 with identifier: DJ74169 to the API
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:35:44Z',
'fuel_type': 'petrol',
'id': 'ccbe1b0d-c9cf-53bf-9947-ae2fcbc6f8c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ74169',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 153965,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-27',
'seller_name': None,
'title': 'Peugeot 207 1.4 VTi Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2011}
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74169%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [auto1.de] INFO: Saving data for DJ74169: {'auction_closing_time': 1774715744.0, 'created_time': 1773859441.602751, 'last_price_update_time': 1774608073.820515}
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ74169') HTTP/1.1" 204 0
2026-03-27 10:41:13 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-27 10:41:13 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA26329%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [auto1.de] INFO: Scrape type for GA26329: 2
2026-03-27 10:41:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5802b382-5b34-5132-8e3e-aef61e3dd92f with identifier: GA26329
2026-03-27 10:41:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5802b382-5b34-5132-8e3e-aef61e3dd92f with scrape type 2
2026-03-27 10:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5802b382-5b34-5132-8e3e-aef61e3dd92f with scrape type 2
2026-03-27 10:41:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5802b382-5b34-5132-8e3e-aef61e3dd92f, identifier: GA26329
2026-03-27 10:41:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5802b382-5b34-5132-8e3e-aef61e3dd92f with identifier: GA26329
2026-03-27 10:41:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5802b382-5b34-5132-8e3e-aef61e3dd92f with identifier: GA26329
2026-03-27 10:41:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5802b382-5b34-5132-8e3e-aef61e3dd92f with identifier: GA26329 to the API
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 117,
'expiration_date': '2026-03-28T16:18:55Z',
'fuel_type': 'petrol',
'id': '5802b382-5b34-5132-8e3e-aef61e3dd92f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA26329',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 156840,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-03',
'seller_name': None,
'title': 'Nissan Juke 1.6 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2012}
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA26329%27 HTTP/1.1" 200 None
2026-03-27 10:41:14 [auto1.de] INFO: Saving data for GA26329: {'auction_closing_time': 1774714735.0, 'created_time': 1773138515.917524, 'last_price_update_time': 1774608074.394898}
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA26329') HTTP/1.1" 204 0
2026-03-27 10:41:14 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-27 10:41:14 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-27 10:41:14 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-27 10:41:14 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-27 10:41:14 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD79531%27 HTTP/1.1" 200 None
2026-03-27 10:41:14 [auto1.de] INFO: Scrape type for LD79531: 2
2026-03-27 10:41:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba9ed45b-4afa-5635-9edc-35391ded3f62 with identifier: LD79531
2026-03-27 10:41:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba9ed45b-4afa-5635-9edc-35391ded3f62 with scrape type 2
2026-03-27 10:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba9ed45b-4afa-5635-9edc-35391ded3f62 with scrape type 2
2026-03-27 10:41:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba9ed45b-4afa-5635-9edc-35391ded3f62, identifier: LD79531
2026-03-27 10:41:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba9ed45b-4afa-5635-9edc-35391ded3f62 with identifier: LD79531
2026-03-27 10:41:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba9ed45b-4afa-5635-9edc-35391ded3f62 with identifier: LD79531
2026-03-27 10:41:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba9ed45b-4afa-5635-9edc-35391ded3f62 with identifier: LD79531 to the API
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:01:31Z',
'fuel_type': 'diesel',
'id': 'ba9ed45b-4afa-5635-9edc-35391ded3f62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD79531',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 129735,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-12-03',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2006}
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD79531%27 HTTP/1.1" 200 None
2026-03-27 10:41:14 [auto1.de] INFO: Saving data for LD79531: {'auction_closing_time': 1774713691.0, 'created_time': 1773340486.428731, 'last_price_update_time': 1774608074.915903}
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD79531') HTTP/1.1" 204 0
2026-03-27 10:41:14 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41369%27 HTTP/1.1" 200 None
2026-03-27 10:41:14 [auto1.de] INFO: Scrape type for WX41369: 2
2026-03-27 10:41:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b174d140-f8da-58ec-b72b-b43d631e9093 with identifier: WX41369
2026-03-27 10:41:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b174d140-f8da-58ec-b72b-b43d631e9093 with scrape type 2
2026-03-27 10:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b174d140-f8da-58ec-b72b-b43d631e9093 with scrape type 2
2026-03-27 10:41:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b174d140-f8da-58ec-b72b-b43d631e9093, identifier: WX41369
2026-03-27 10:41:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b174d140-f8da-58ec-b72b-b43d631e9093 with identifier: WX41369
2026-03-27 10:41:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b174d140-f8da-58ec-b72b-b43d631e9093 with identifier: WX41369
2026-03-27 10:41:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b174d140-f8da-58ec-b72b-b43d631e9093 with identifier: WX41369 to the API
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:10:58Z',
'fuel_type': 'petrol',
'id': 'b174d140-f8da-58ec-b72b-b43d631e9093',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX41369',
'listing': 'auction',
'make': 'Opel',
'model': 'Adam',
'odometer': 112785,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-26',
'seller_name': None,
'title': 'Opel Adam 1.0 Turbo Jam ecoFlex',
'transmission': 'manual',
'trim': 'Jam ecoFlex',
'year': 2015}
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41369%27 HTTP/1.1" 200 None
2026-03-27 10:41:15 [auto1.de] INFO: Saving data for WX41369: {'auction_closing_time': 1774714258.0, 'created_time': 1773732648.753932, 'last_price_update_time': 1774608075.370899}
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX41369') HTTP/1.1" 204 0
2026-03-27 10:41:15 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-27 10:41:15 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN68043%27 HTTP/1.1" 200 None
2026-03-27 10:41:15 [auto1.de] INFO: Scrape type for GN68043: 2
2026-03-27 10:41:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dd56c9d-c984-5d14-b99e-3053d8342966 with identifier: GN68043
2026-03-27 10:41:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd56c9d-c984-5d14-b99e-3053d8342966 with scrape type 2
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dd56c9d-c984-5d14-b99e-3053d8342966 with scrape type 2
2026-03-27 10:41:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9dd56c9d-c984-5d14-b99e-3053d8342966, identifier: GN68043
2026-03-27 10:41:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9dd56c9d-c984-5d14-b99e-3053d8342966 with identifier: GN68043
2026-03-27 10:41:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9dd56c9d-c984-5d14-b99e-3053d8342966 with identifier: GN68043
2026-03-27 10:41:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9dd56c9d-c984-5d14-b99e-3053d8342966 with identifier: GN68043 to the API
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:44:14Z',
'fuel_type': 'diesel',
'id': '9dd56c9d-c984-5d14-b99e-3053d8342966',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN68043',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 253628,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-08',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion',
'transmission': 'manual',
'trim': 'Highline BlueMotion',
'year': 2013}
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN68043%27 HTTP/1.1" 200 None
2026-03-27 10:41:15 [auto1.de] INFO: Saving data for GN68043: {'auction_closing_time': 1774716254.0, 'created_time': 1773306614.871053, 'last_price_update_time': 1774608075.841164}
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN68043') HTTP/1.1" 204 0
2026-03-27 10:41:15 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE96933%27 HTTP/1.1" 200 None
2026-03-27 10:41:15 [auto1.de] INFO: Scrape type for HE96933: 2
2026-03-27 10:41:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce with identifier: HE96933
2026-03-27 10:41:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce with scrape type 2
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce with scrape type 2
2026-03-27 10:41:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce, identifier: HE96933
2026-03-27 10:41:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce with identifier: HE96933
2026-03-27 10:41:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce with identifier: HE96933
2026-03-27 10:41:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82c9a233-8f06-5e3b-a244-71c5b7cfc8ce with identifier: HE96933 to the API
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:55:36Z',
'fuel_type': 'diesel',
'id': '82c9a233-8f06-5e3b-a244-71c5b7cfc8ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE96933',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand C-Max',
'odometer': 244830,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-07',
'seller_name': None,
'title': 'Ford Grand C-Max 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2011}
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE96933%27 HTTP/1.1" 200 None
2026-03-27 10:41:16 [auto1.de] INFO: Saving data for HE96933: {'auction_closing_time': 1774716936.0, 'created_time': 1773305051.836881, 'last_price_update_time': 1774608076.339704}
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE96933') HTTP/1.1" 204 0
2026-03-27 10:41:16 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ12441%27 HTTP/1.1" 200 None
2026-03-27 10:41:16 [auto1.de] INFO: Scrape type for WJ12441: 2
2026-03-27 10:41:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aa33add-c523-5d9f-b634-ff71d39e443d with identifier: WJ12441
2026-03-27 10:41:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aa33add-c523-5d9f-b634-ff71d39e443d with scrape type 2
2026-03-27 10:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6aa33add-c523-5d9f-b634-ff71d39e443d with scrape type 2
2026-03-27 10:41:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6aa33add-c523-5d9f-b634-ff71d39e443d, identifier: WJ12441
2026-03-27 10:41:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6aa33add-c523-5d9f-b634-ff71d39e443d with identifier: WJ12441
2026-03-27 10:41:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6aa33add-c523-5d9f-b634-ff71d39e443d with identifier: WJ12441
2026-03-27 10:41:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6aa33add-c523-5d9f-b634-ff71d39e443d with identifier: WJ12441 to the API
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 374,
'expiration_date': '2026-03-28T16:38:27Z',
'fuel_type': 'petrol',
'id': '6aa33add-c523-5d9f-b634-ff71d39e443d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ12441',
'listing': 'auction',
'make': 'BMW',
'model': '4er',
'odometer': 29731,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-05',
'seller_name': None,
'title': 'BMW 4er M440i Gran Coupe Mild-Hybrid xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2022}
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ12441%27 HTTP/1.1" 200 None
2026-03-27 10:41:16 [auto1.de] INFO: Saving data for WJ12441: {'auction_closing_time': 1774715907.0, 'created_time': 1773305269.13445, 'last_price_update_time': 1774608076.928661}
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ12441') HTTP/1.1" 204 0
2026-03-27 10:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP48150/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:16 [auto1.de] INFO: Found listing with ID: PU35807
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU35807%27 HTTP/1.1" 200 None
2026-03-27 10:41:16 [auto1.de] INFO: Scrape type for PU35807: 2
2026-03-27 10:41:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8965b60-f102-5a75-b8c7-81d8914968d8 with identifier: PU35807
2026-03-27 10:41:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8965b60-f102-5a75-b8c7-81d8914968d8 with scrape type 2
2026-03-27 10:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8965b60-f102-5a75-b8c7-81d8914968d8 with scrape type 2
2026-03-27 10:41:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8965b60-f102-5a75-b8c7-81d8914968d8, identifier: PU35807
2026-03-27 10:41:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8965b60-f102-5a75-b8c7-81d8914968d8 with identifier: PU35807
2026-03-27 10:41:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8965b60-f102-5a75-b8c7-81d8914968d8 with identifier: PU35807
2026-03-27 10:41:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8965b60-f102-5a75-b8c7-81d8914968d8 with identifier: PU35807 to the API
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 333,
'expiration_date': '2026-03-28T16:20:40Z',
'fuel_type': 'petrol',
'id': 'b8965b60-f102-5a75-b8c7-81d8914968d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU35807',
'listing': 'auction',
'make': 'Audi',
'model': 'S5 Sportback',
'odometer': 151610,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-05',
'seller_name': None,
'title': 'Audi S5 Sportback 3.0 V6 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2016}
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU35807%27 HTTP/1.1" 200 None
2026-03-27 10:41:17 [auto1.de] INFO: Saving data for PU35807: {'auction_closing_time': 1774714840.0, 'created_time': 1773224108.360448, 'last_price_update_time': 1774608077.393911}
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU35807') HTTP/1.1" 204 0
2026-03-27 10:41:17 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC62608%27 HTTP/1.1" 200 None
2026-03-27 10:41:17 [auto1.de] INFO: Scrape type for ZC62608: 2
2026-03-27 10:41:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a72532a-4689-5c03-9d16-9e00acd0c1ed with identifier: ZC62608
2026-03-27 10:41:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a72532a-4689-5c03-9d16-9e00acd0c1ed with scrape type 2
2026-03-27 10:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a72532a-4689-5c03-9d16-9e00acd0c1ed with scrape type 2
2026-03-27 10:41:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a72532a-4689-5c03-9d16-9e00acd0c1ed, identifier: ZC62608
2026-03-27 10:41:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a72532a-4689-5c03-9d16-9e00acd0c1ed with identifier: ZC62608
2026-03-27 10:41:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a72532a-4689-5c03-9d16-9e00acd0c1ed with identifier: ZC62608
2026-03-27 10:41:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a72532a-4689-5c03-9d16-9e00acd0c1ed with identifier: ZC62608 to the API
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 145,
'expiration_date': '2026-03-28T16:55:18Z',
'fuel_type': 'diesel',
'id': '6a72532a-4689-5c03-9d16-9e00acd0c1ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC62608',
'listing': 'auction',
'make': 'Renault',
'model': 'Trafic',
'odometer': 78140,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-22',
'seller_name': None,
'title': 'Renault Trafic 2.0 dCi L2H1 3,0t Komfort',
'transmission': 'manual',
'trim': 'L2H1 3,0t Komfort',
'year': 2021}
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC62608%27 HTTP/1.1" 200 None
2026-03-27 10:41:17 [auto1.de] INFO: Saving data for ZC62608: {'auction_closing_time': 1774716918.0, 'created_time': 1773774740.948386, 'last_price_update_time': 1774608077.874004}
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC62608') HTTP/1.1" 204 0
2026-03-27 10:41:17 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW28946%27 HTTP/1.1" 200 None
2026-03-27 10:41:17 [auto1.de] INFO: Scrape type for XW28946: 2
2026-03-27 10:41:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f5b8b62-6873-5f31-b225-10d311b0e2d9 with identifier: XW28946
2026-03-27 10:41:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f5b8b62-6873-5f31-b225-10d311b0e2d9 with scrape type 2
2026-03-27 10:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f5b8b62-6873-5f31-b225-10d311b0e2d9 with scrape type 2
2026-03-27 10:41:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f5b8b62-6873-5f31-b225-10d311b0e2d9, identifier: XW28946
2026-03-27 10:41:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f5b8b62-6873-5f31-b225-10d311b0e2d9 with identifier: XW28946
2026-03-27 10:41:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f5b8b62-6873-5f31-b225-10d311b0e2d9 with identifier: XW28946
2026-03-27 10:41:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f5b8b62-6873-5f31-b225-10d311b0e2d9 with identifier: XW28946 to the API
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 333,
'expiration_date': '2026-03-28T16:41:16Z',
'fuel_type': 'petrol',
'id': '7f5b8b62-6873-5f31-b225-10d311b0e2d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW28946',
'listing': 'auction',
'make': 'Audi',
'model': 'S5 Sportback',
'odometer': 183280,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-27',
'seller_name': None,
'title': 'Audi S5 Sportback 3.0 V6 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2013}
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW28946%27 HTTP/1.1" 200 None
2026-03-27 10:41:18 [auto1.de] INFO: Saving data for XW28946: {'auction_closing_time': 1774716076.0, 'created_time': 1773343442.905176, 'last_price_update_time': 1774608078.410281}
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW28946') HTTP/1.1" 204 0
2026-03-27 10:41:18 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH71943%27 HTTP/1.1" 200 None
2026-03-27 10:41:18 [auto1.de] INFO: Scrape type for AH71943: 1
2026-03-27 10:41:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:18 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX82785%27 HTTP/1.1" 200 None
2026-03-27 10:41:18 [auto1.de] INFO: Scrape type for HX82785: 2
2026-03-27 10:41:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30ca088d-784a-53d8-a460-c0e26c2c666b with identifier: HX82785
2026-03-27 10:41:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30ca088d-784a-53d8-a460-c0e26c2c666b with scrape type 2
2026-03-27 10:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30ca088d-784a-53d8-a460-c0e26c2c666b with scrape type 2
2026-03-27 10:41:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30ca088d-784a-53d8-a460-c0e26c2c666b, identifier: HX82785
2026-03-27 10:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30ca088d-784a-53d8-a460-c0e26c2c666b with identifier: HX82785
2026-03-27 10:41:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30ca088d-784a-53d8-a460-c0e26c2c666b with identifier: HX82785
2026-03-27 10:41:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30ca088d-784a-53d8-a460-c0e26c2c666b with identifier: HX82785 to the API
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 367,
'expiration_date': '2026-03-28T16:15:51Z',
'fuel_type': 'petrol',
'id': '30ca088d-784a-53d8-a460-c0e26c2c666b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX82785',
'listing': 'auction',
'make': 'Audi',
'model': 'RS Q3',
'odometer': 140203,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-11',
'seller_name': None,
'title': 'Audi RS Q3 2.5 TFSI quattro Performance',
'transmission': 'automatic',
'trim': 'quattro Performance',
'year': 2016}
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX82785%27 HTTP/1.1" 200 None
2026-03-27 10:41:18 [auto1.de] INFO: Saving data for HX82785: {'auction_closing_time': 1774714551.0, 'created_time': 1773135013.354186, 'last_price_update_time': 1774608078.904883}
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX82785') HTTP/1.1" 204 0
2026-03-27 10:41:18 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-27 10:41:18 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-27 10:41:18 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20328%27 HTTP/1.1" 200 None
2026-03-27 10:41:18 [auto1.de] INFO: Scrape type for BB20328: 2
2026-03-27 10:41:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 169408c3-b369-5eab-a4dc-b53a94b9a0c7 with identifier: BB20328
2026-03-27 10:41:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 169408c3-b369-5eab-a4dc-b53a94b9a0c7 with scrape type 2
2026-03-27 10:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 169408c3-b369-5eab-a4dc-b53a94b9a0c7 with scrape type 2
2026-03-27 10:41:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 169408c3-b369-5eab-a4dc-b53a94b9a0c7, identifier: BB20328
2026-03-27 10:41:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 169408c3-b369-5eab-a4dc-b53a94b9a0c7 with identifier: BB20328
2026-03-27 10:41:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 169408c3-b369-5eab-a4dc-b53a94b9a0c7 with identifier: BB20328
2026-03-27 10:41:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 169408c3-b369-5eab-a4dc-b53a94b9a0c7 with identifier: BB20328 to the API
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:31:53Z',
'fuel_type': 'diesel',
'id': '169408c3-b369-5eab-a4dc-b53a94b9a0c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB20328',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 266848,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-01',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.0 TDI Highline 4Motion',
'transmission': 'automatic',
'trim': 'Highline 4Motion',
'year': 2012}
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20328%27 HTTP/1.1" 200 None
2026-03-27 10:41:19 [auto1.de] INFO: Saving data for BB20328: {'auction_closing_time': 1774715513.0, 'created_time': 1773774729.471735, 'last_price_update_time': 1774608079.401539}
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB20328') HTTP/1.1" 204 0
2026-03-27 10:41:19 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA19141%27 HTTP/1.1" 200 None
2026-03-27 10:41:19 [auto1.de] INFO: Scrape type for ZA19141: 2
2026-03-27 10:41:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecc60949-4263-55a6-a4eb-d8a0491e92d1 with identifier: ZA19141
2026-03-27 10:41:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecc60949-4263-55a6-a4eb-d8a0491e92d1 with scrape type 2
2026-03-27 10:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecc60949-4263-55a6-a4eb-d8a0491e92d1 with scrape type 2
2026-03-27 10:41:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecc60949-4263-55a6-a4eb-d8a0491e92d1, identifier: ZA19141
2026-03-27 10:41:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecc60949-4263-55a6-a4eb-d8a0491e92d1 with identifier: ZA19141
2026-03-27 10:41:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecc60949-4263-55a6-a4eb-d8a0491e92d1 with identifier: ZA19141
2026-03-27 10:41:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecc60949-4263-55a6-a4eb-d8a0491e92d1 with identifier: ZA19141 to the API
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:46:43Z',
'fuel_type': 'petrol',
'id': 'ecc60949-4263-55a6-a4eb-d8a0491e92d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA19141',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 83622,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-15',
'seller_name': None,
'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
'transmission': 'manual',
'trim': 'Highline BlueMotion',
'year': 2020}
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA19141%27 HTTP/1.1" 200 None
2026-03-27 10:41:19 [auto1.de] INFO: Saving data for ZA19141: {'auction_closing_time': 1774716403.0, 'created_time': 1774294492.820083, 'last_price_update_time': 1774608079.897454}
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA19141') HTTP/1.1" 204 0
2026-03-27 10:41:19 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 10517 | hits on page: 40
2026-03-27 10:41:19 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-27 10:41:19 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94001%27 HTTP/1.1" 200 None
2026-03-27 10:41:19 [auto1.de] INFO: Scrape type for GE94001: 2
2026-03-27 10:41:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e618fac-94aa-5c5b-9e49-ba83593bfd3d with identifier: GE94001
2026-03-27 10:41:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e618fac-94aa-5c5b-9e49-ba83593bfd3d with scrape type 2
2026-03-27 10:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e618fac-94aa-5c5b-9e49-ba83593bfd3d with scrape type 2
2026-03-27 10:41:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e618fac-94aa-5c5b-9e49-ba83593bfd3d, identifier: GE94001
2026-03-27 10:41:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e618fac-94aa-5c5b-9e49-ba83593bfd3d with identifier: GE94001
2026-03-27 10:41:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e618fac-94aa-5c5b-9e49-ba83593bfd3d with identifier: GE94001
2026-03-27 10:41:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e618fac-94aa-5c5b-9e49-ba83593bfd3d with identifier: GE94001 to the API
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:57:27Z',
'fuel_type': 'diesel',
'id': '4e618fac-94aa-5c5b-9e49-ba83593bfd3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE94001',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 252005,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-27',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94001%27 HTTP/1.1" 200 None
2026-03-27 10:41:20 [auto1.de] INFO: Saving data for GE94001: {'auction_closing_time': 1774717047.0, 'created_time': 1773660205.167234, 'last_price_update_time': 1774608080.404101}
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE94001') HTTP/1.1" 204 0
2026-03-27 10:41:20 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-27 10:41:20 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-27 10:41:20 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB43693%27 HTTP/1.1" 200 None
2026-03-27 10:41:20 [auto1.de] INFO: Scrape type for XB43693: 2
2026-03-27 10:41:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b1058e7-4540-5f61-b879-830ee46b1b64 with identifier: XB43693
2026-03-27 10:41:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b1058e7-4540-5f61-b879-830ee46b1b64 with scrape type 2
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b1058e7-4540-5f61-b879-830ee46b1b64 with scrape type 2
2026-03-27 10:41:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b1058e7-4540-5f61-b879-830ee46b1b64, identifier: XB43693
2026-03-27 10:41:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:20 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA36034%27 HTTP/1.1" 200 None
2026-03-27 10:41:20 [auto1.de] INFO: Scrape type for BA36034: 2
2026-03-27 10:41:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f410b642-71d6-5523-9cc7-ef811ebbf347 with identifier: BA36034
2026-03-27 10:41:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f410b642-71d6-5523-9cc7-ef811ebbf347 with scrape type 2
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f410b642-71d6-5523-9cc7-ef811ebbf347 with scrape type 2
2026-03-27 10:41:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f410b642-71d6-5523-9cc7-ef811ebbf347, identifier: BA36034
2026-03-27 10:41:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b1058e7-4540-5f61-b879-830ee46b1b64 with identifier: XB43693
2026-03-27 10:41:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b1058e7-4540-5f61-b879-830ee46b1b64 with identifier: XB43693
2026-03-27 10:41:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b1058e7-4540-5f61-b879-830ee46b1b64 with identifier: XB43693 to the API
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:41:20Z',
'fuel_type': 'diesel',
'id': '3b1058e7-4540-5f61-b879-830ee46b1b64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB43693',
'listing': 'auction',
'make': 'Skoda',
'model': 'Rapid Spaceback',
'odometer': 138253,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-31',
'seller_name': None,
'title': 'Skoda Rapid Spaceback 1.6 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2016}
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB43693%27 HTTP/1.1" 200 None
2026-03-27 10:41:21 [auto1.de] INFO: Saving data for XB43693: {'auction_closing_time': 1774716080.0, 'created_time': 1774294167.329932, 'last_price_update_time': 1774608081.077471}
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB43693') HTTP/1.1" 204 0
2026-03-27 10:41:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f410b642-71d6-5523-9cc7-ef811ebbf347 with identifier: BA36034
2026-03-27 10:41:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f410b642-71d6-5523-9cc7-ef811ebbf347 with identifier: BA36034
2026-03-27 10:41:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f410b642-71d6-5523-9cc7-ef811ebbf347 with identifier: BA36034 to the API
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:17:19Z',
'fuel_type': 'petrol',
'id': 'f410b642-71d6-5523-9cc7-ef811ebbf347',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA36034',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 147683,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-25',
'seller_name': None,
'title': 'Dacia Sandero 1.2 Essentiel',
'transmission': 'manual',
'trim': 'Essentiel',
'year': 2015}
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA36034%27 HTTP/1.1" 200 None
2026-03-27 10:41:21 [auto1.de] INFO: Saving data for BA36034: {'auction_closing_time': 1774714639.0, 'created_time': 1774293774.302122, 'last_price_update_time': 1774608081.438808}
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA36034') HTTP/1.1" 204 0
2026-03-27 10:41:21 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV41920%27 HTTP/1.1" 200 None
2026-03-27 10:41:21 [auto1.de] INFO: Scrape type for FV41920: 2
2026-03-27 10:41:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ced39d6-2b53-5571-830a-fae337852c3f with identifier: FV41920
2026-03-27 10:41:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ced39d6-2b53-5571-830a-fae337852c3f with scrape type 2
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ced39d6-2b53-5571-830a-fae337852c3f with scrape type 2
2026-03-27 10:41:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ced39d6-2b53-5571-830a-fae337852c3f, identifier: FV41920
2026-03-27 10:41:21 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-27 10:41:21 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN11419%27 HTTP/1.1" 200 None
2026-03-27 10:41:21 [auto1.de] INFO: Scrape type for DN11419: 2
2026-03-27 10:41:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de7ec40f-8acf-56d7-8ab5-3f2b2ff20614 with identifier: DN11419
2026-03-27 10:41:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de7ec40f-8acf-56d7-8ab5-3f2b2ff20614 with scrape type 2
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de7ec40f-8acf-56d7-8ab5-3f2b2ff20614 with scrape type 2
2026-03-27 10:41:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de7ec40f-8acf-56d7-8ab5-3f2b2ff20614, identifier: DN11419
2026-03-27 10:41:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ced39d6-2b53-5571-830a-fae337852c3f with identifier: FV41920
2026-03-27 10:41:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ced39d6-2b53-5571-830a-fae337852c3f with identifier: FV41920
2026-03-27 10:41:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ced39d6-2b53-5571-830a-fae337852c3f with identifier: FV41920 to the API
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 310,
'expiration_date': '2026-03-28T16:12:38Z',
'fuel_type': 'petrol',
'id': '1ced39d6-2b53-5571-830a-fae337852c3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV41920',
'listing': 'auction',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 14638,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-04',
'seller_name': None,
'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
'transmission': 'automatic',
'trim': 'VZ 4Drive',
'year': 2024}
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV41920%27 HTTP/1.1" 200 None
2026-03-27 10:41:22 [auto1.de] INFO: Saving data for FV41920: {'auction_closing_time': 1774714358.0, 'created_time': 1774293426.868566, 'last_price_update_time': 1774608081.999916}
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV41920') HTTP/1.1" 204 0
2026-03-27 10:41:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de7ec40f-8acf-56d7-8ab5-3f2b2ff20614 with identifier: DN11419
2026-03-27 10:41:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de7ec40f-8acf-56d7-8ab5-3f2b2ff20614 with identifier: DN11419
2026-03-27 10:41:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de7ec40f-8acf-56d7-8ab5-3f2b2ff20614 with identifier: DN11419 to the API
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:05:19Z',
'fuel_type': 'petrol',
'id': 'de7ec40f-8acf-56d7-8ab5-3f2b2ff20614',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN11419',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 15758,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-15',
'seller_name': None,
'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid Nightline Edition',
'transmission': 'automatic',
'trim': 'Nightline Edition',
'year': 2024}
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN11419%27 HTTP/1.1" 200 None
2026-03-27 10:41:22 [auto1.de] INFO: Saving data for DN11419: {'auction_closing_time': 1774713919.0, 'created_time': 1774291795.529176, 'last_price_update_time': 1774608082.357573}
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN11419') HTTP/1.1" 204 0
2026-03-27 10:41:22 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-27 10:41:22 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR30174%27 HTTP/1.1" 200 None
2026-03-27 10:41:22 [auto1.de] INFO: Scrape type for JR30174: 2
2026-03-27 10:41:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54cb350d-5fe5-5e4e-b0fc-259e34488c39 with identifier: JR30174
2026-03-27 10:41:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54cb350d-5fe5-5e4e-b0fc-259e34488c39 with scrape type 2
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54cb350d-5fe5-5e4e-b0fc-259e34488c39 with scrape type 2
2026-03-27 10:41:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54cb350d-5fe5-5e4e-b0fc-259e34488c39, identifier: JR30174
2026-03-27 10:41:22 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-27 10:41:22 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77146%27 HTTP/1.1" 200 None
2026-03-27 10:41:22 [auto1.de] INFO: Scrape type for HL77146: 2
2026-03-27 10:41:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18591d8e-6685-5dda-a802-8e18af14aef7 with identifier: HL77146
2026-03-27 10:41:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18591d8e-6685-5dda-a802-8e18af14aef7 with scrape type 2
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18591d8e-6685-5dda-a802-8e18af14aef7 with scrape type 2
2026-03-27 10:41:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18591d8e-6685-5dda-a802-8e18af14aef7, identifier: HL77146
2026-03-27 10:41:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54cb350d-5fe5-5e4e-b0fc-259e34488c39 with identifier: JR30174
2026-03-27 10:41:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54cb350d-5fe5-5e4e-b0fc-259e34488c39 with identifier: JR30174
2026-03-27 10:41:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54cb350d-5fe5-5e4e-b0fc-259e34488c39 with identifier: JR30174 to the API
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:16:51Z',
'fuel_type': 'diesel',
'id': '54cb350d-5fe5-5e4e-b0fc-259e34488c39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR30174',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 131279,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-12',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Center-Line 2WD',
'transmission': 'manual',
'trim': 'Center-Line 2WD',
'year': 2013}
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR30174%27 HTTP/1.1" 200 None
2026-03-27 10:41:22 [auto1.de] INFO: Saving data for JR30174: {'auction_closing_time': 1774714611.0, 'created_time': 1773302399.342569, 'last_price_update_time': 1774608082.975392}
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR30174') HTTP/1.1" 204 0
2026-03-27 10:41:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18591d8e-6685-5dda-a802-8e18af14aef7 with identifier: HL77146
2026-03-27 10:41:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18591d8e-6685-5dda-a802-8e18af14aef7 with identifier: HL77146
2026-03-27 10:41:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18591d8e-6685-5dda-a802-8e18af14aef7 with identifier: HL77146 to the API
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 192,
'expiration_date': '2026-03-28T16:00:15Z',
'fuel_type': 'petrol',
'id': '18591d8e-6685-5dda-a802-8e18af14aef7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL77146',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 186261,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-27',
'seller_name': None,
'title': 'BMW X1 xDrive 20i xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2016}
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77146%27 HTTP/1.1" 200 None
2026-03-27 10:41:23 [auto1.de] INFO: Saving data for HL77146: {'auction_closing_time': 1774713615.0, 'created_time': 1773399963.704201, 'last_price_update_time': 1774608083.469111}
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL77146') HTTP/1.1" 204 0
2026-03-27 10:41:23 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-27 10:41:23 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ04570%27 HTTP/1.1" 200 None
2026-03-27 10:41:23 [auto1.de] INFO: Scrape type for NZ04570: 2
2026-03-27 10:41:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b463400-3d4f-5b3a-9f36-335d5f2fa506 with identifier: NZ04570
2026-03-27 10:41:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b463400-3d4f-5b3a-9f36-335d5f2fa506 with scrape type 2
2026-03-27 10:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b463400-3d4f-5b3a-9f36-335d5f2fa506 with scrape type 2
2026-03-27 10:41:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b463400-3d4f-5b3a-9f36-335d5f2fa506, identifier: NZ04570
2026-03-27 10:41:23 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM91715%27 HTTP/1.1" 200 None
2026-03-27 10:41:23 [auto1.de] INFO: Scrape type for RM91715: 2
2026-03-27 10:41:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5 with identifier: RM91715
2026-03-27 10:41:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5 with scrape type 2
2026-03-27 10:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5 with scrape type 2
2026-03-27 10:41:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5, identifier: RM91715
2026-03-27 10:41:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b463400-3d4f-5b3a-9f36-335d5f2fa506 with identifier: NZ04570
2026-03-27 10:41:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b463400-3d4f-5b3a-9f36-335d5f2fa506 with identifier: NZ04570
2026-03-27 10:41:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b463400-3d4f-5b3a-9f36-335d5f2fa506 with identifier: NZ04570 to the API
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-28T16:32:10Z',
'fuel_type': 'diesel',
'id': '8b463400-3d4f-5b3a-9f36-335d5f2fa506',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ04570',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 96390,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-28',
'seller_name': None,
'title': 'BMW X3 xDrive 30d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2019}
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ04570%27 HTTP/1.1" 200 None
2026-03-27 10:41:24 [auto1.de] INFO: Saving data for NZ04570: {'auction_closing_time': 1774715530.0, 'created_time': 1773467017.480534, 'last_price_update_time': 1774608084.0772}
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ04570') HTTP/1.1" 204 0
2026-03-27 10:41:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5 with identifier: RM91715
2026-03-27 10:41:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5 with identifier: RM91715
2026-03-27 10:41:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5 with identifier: RM91715 to the API
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:38:43Z',
'fuel_type': 'petrol',
'id': '94b58c49-cb2f-52db-ad4b-bc5a2d0efaf5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM91715',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 154178,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-18',
'seller_name': None,
'title': 'Ford Focus 1.6 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2009}
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM91715%27 HTTP/1.1" 200 None
2026-03-27 10:41:24 [auto1.de] INFO: Saving data for RM91715: {'auction_closing_time': 1774715923.0, 'created_time': 1773772301.289923, 'last_price_update_time': 1774608084.51333}
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM91715') HTTP/1.1" 204 0
2026-03-27 10:41:24 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-27 10:41:24 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-27 10:41:24 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-27 10:41:24 [auto1.de] INFO: Found listing with ID: MM87204
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM87204%27 HTTP/1.1" 200 None
2026-03-27 10:41:24 [auto1.de] INFO: Scrape type for MM87204: 2
2026-03-27 10:41:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 033d937b-b560-503d-9fd8-7324a44d7e37 with identifier: MM87204
2026-03-27 10:41:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 033d937b-b560-503d-9fd8-7324a44d7e37 with scrape type 2
2026-03-27 10:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 033d937b-b560-503d-9fd8-7324a44d7e37 with scrape type 2
2026-03-27 10:41:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 033d937b-b560-503d-9fd8-7324a44d7e37, identifier: MM87204
2026-03-27 10:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RR41525/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:24 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-27 10:41:24 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-27 10:41:24 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52940%27 HTTP/1.1" 200 None
2026-03-27 10:41:24 [auto1.de] INFO: Scrape type for BX52940: 2
2026-03-27 10:41:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1175ce4-7c16-548c-9189-ef5ea835886e with identifier: BX52940
2026-03-27 10:41:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1175ce4-7c16-548c-9189-ef5ea835886e with scrape type 2
2026-03-27 10:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1175ce4-7c16-548c-9189-ef5ea835886e with scrape type 2
2026-03-27 10:41:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1175ce4-7c16-548c-9189-ef5ea835886e, identifier: BX52940
2026-03-27 10:41:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 033d937b-b560-503d-9fd8-7324a44d7e37 with identifier: MM87204
2026-03-27 10:41:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 033d937b-b560-503d-9fd8-7324a44d7e37 with identifier: MM87204
2026-03-27 10:41:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 033d937b-b560-503d-9fd8-7324a44d7e37 with identifier: MM87204 to the API
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 77,
'expiration_date': '2026-03-28T16:39:49Z',
'fuel_type': 'hybrid',
'id': '033d937b-b560-503d-9fd8-7324a44d7e37',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM87204',
'listing': 'auction',
'make': 'Toyota',
'model': 'Prius',
'odometer': 299999,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-07-19',
'seller_name': None,
'title': 'Toyota Prius 1.5 Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2004}
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM87204%27 HTTP/1.1" 200 None
2026-03-27 10:41:25 [auto1.de] INFO: Saving data for MM87204: {'auction_closing_time': 1774715989.0, 'created_time': 1774377583.78017, 'last_price_update_time': 1774608085.223986}
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM87204') HTTP/1.1" 204 0
2026-03-27 10:41:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1175ce4-7c16-548c-9189-ef5ea835886e with identifier: BX52940
2026-03-27 10:41:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1175ce4-7c16-548c-9189-ef5ea835886e with identifier: BX52940
2026-03-27 10:41:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1175ce4-7c16-548c-9189-ef5ea835886e with identifier: BX52940 to the API
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 380,
'expiration_date': '2026-03-28T16:11:32Z',
'fuel_type': 'petrol',
'id': 'd1175ce4-7c16-548c-9189-ef5ea835886e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX52940',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 102653,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 45 AMG 4Matic Sport',
'transmission': 'automatic',
'trim': '4Matic Sport',
'year': 2018}
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52940%27 HTTP/1.1" 200 None
2026-03-27 10:41:25 [auto1.de] INFO: Saving data for BX52940: {'auction_closing_time': 1774714292.0, 'created_time': 1773859485.331411, 'last_price_update_time': 1774608085.539433}
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX52940') HTTP/1.1" 204 0
2026-03-27 10:41:25 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-27 10:41:25 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD21016%27 HTTP/1.1" 200 None
2026-03-27 10:41:25 [auto1.de] INFO: Scrape type for LD21016: 2
2026-03-27 10:41:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 547c35b1-695f-5512-8582-39ff6840a886 with identifier: LD21016
2026-03-27 10:41:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 547c35b1-695f-5512-8582-39ff6840a886 with scrape type 2
2026-03-27 10:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 547c35b1-695f-5512-8582-39ff6840a886 with scrape type 2
2026-03-27 10:41:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 547c35b1-695f-5512-8582-39ff6840a886, identifier: LD21016
2026-03-27 10:41:25 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89104%27 HTTP/1.1" 200 None
2026-03-27 10:41:25 [auto1.de] INFO: Scrape type for HA89104: 2
2026-03-27 10:41:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a1a4486-9c78-5465-9509-4c7b0fdabced with identifier: HA89104
2026-03-27 10:41:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a1a4486-9c78-5465-9509-4c7b0fdabced with scrape type 2
2026-03-27 10:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a1a4486-9c78-5465-9509-4c7b0fdabced with scrape type 2
2026-03-27 10:41:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a1a4486-9c78-5465-9509-4c7b0fdabced, identifier: HA89104
2026-03-27 10:41:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 547c35b1-695f-5512-8582-39ff6840a886 with identifier: LD21016
2026-03-27 10:41:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 547c35b1-695f-5512-8582-39ff6840a886 with identifier: LD21016
2026-03-27 10:41:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 547c35b1-695f-5512-8582-39ff6840a886 with identifier: LD21016 to the API
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:46:54Z',
'fuel_type': 'diesel',
'id': '547c35b1-695f-5512-8582-39ff6840a886',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD21016',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 227356,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-18',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Best of',
'transmission': 'automatic',
'trim': 'Best of',
'year': 2015}
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD21016%27 HTTP/1.1" 200 None
2026-03-27 10:41:26 [auto1.de] INFO: Saving data for LD21016: {'auction_closing_time': 1774716414.0, 'created_time': 1773775532.204878, 'last_price_update_time': 1774608086.1948}
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD21016') HTTP/1.1" 204 0
2026-03-27 10:41:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a1a4486-9c78-5465-9509-4c7b0fdabced with identifier: HA89104
2026-03-27 10:41:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a1a4486-9c78-5465-9509-4c7b0fdabced with identifier: HA89104
2026-03-27 10:41:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a1a4486-9c78-5465-9509-4c7b0fdabced with identifier: HA89104 to the API
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 98,
'expiration_date': '2026-03-28T16:51:08Z',
'fuel_type': 'petrol',
'id': '6a1a4486-9c78-5465-9509-4c7b0fdabced',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA89104',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 100824,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-29',
'seller_name': None,
'title': 'MINI Countryman One',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89104%27 HTTP/1.1" 200 None
2026-03-27 10:41:26 [auto1.de] INFO: Saving data for HA89104: {'auction_closing_time': 1774716668.0, 'created_time': 1774264672.881636, 'last_price_update_time': 1774608086.641302}
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA89104') HTTP/1.1" 204 0
2026-03-27 10:41:26 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-27 10:41:26 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73698%27 HTTP/1.1" 200 None
2026-03-27 10:41:26 [auto1.de] INFO: Scrape type for WK73698: 2
2026-03-27 10:41:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 063e5226-f561-59c4-b604-86ba178dda17 with identifier: WK73698
2026-03-27 10:41:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 063e5226-f561-59c4-b604-86ba178dda17 with scrape type 2
2026-03-27 10:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 063e5226-f561-59c4-b604-86ba178dda17 with scrape type 2
2026-03-27 10:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 063e5226-f561-59c4-b604-86ba178dda17, identifier: WK73698
2026-03-27 10:41:26 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63753%27 HTTP/1.1" 200 None
2026-03-27 10:41:26 [auto1.de] INFO: Scrape type for XB63753: 2
2026-03-27 10:41:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4debdf0a-380f-50b9-a8e0-ca94ac8f9218 with identifier: XB63753
2026-03-27 10:41:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4debdf0a-380f-50b9-a8e0-ca94ac8f9218 with scrape type 2
2026-03-27 10:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4debdf0a-380f-50b9-a8e0-ca94ac8f9218 with scrape type 2
2026-03-27 10:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4debdf0a-380f-50b9-a8e0-ca94ac8f9218, identifier: XB63753
2026-03-27 10:41:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 063e5226-f561-59c4-b604-86ba178dda17 with identifier: WK73698
2026-03-27 10:41:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 063e5226-f561-59c4-b604-86ba178dda17 with identifier: WK73698
2026-03-27 10:41:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 063e5226-f561-59c4-b604-86ba178dda17 with identifier: WK73698 to the API
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:32:18Z',
'fuel_type': 'diesel',
'id': '063e5226-f561-59c4-b604-86ba178dda17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK73698',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 307803,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-24',
'seller_name': None,
'title': 'Audi A6 2.7 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2011}
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73698%27 HTTP/1.1" 200 None
2026-03-27 10:41:27 [auto1.de] INFO: Saving data for WK73698: {'auction_closing_time': 1774715538.0, 'created_time': 1774293139.644653, 'last_price_update_time': 1774608087.304612}
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK73698') HTTP/1.1" 204 0
2026-03-27 10:41:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4debdf0a-380f-50b9-a8e0-ca94ac8f9218 with identifier: XB63753
2026-03-27 10:41:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4debdf0a-380f-50b9-a8e0-ca94ac8f9218 with identifier: XB63753
2026-03-27 10:41:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4debdf0a-380f-50b9-a8e0-ca94ac8f9218 with identifier: XB63753 to the API
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:04:09Z',
'fuel_type': 'diesel',
'id': '4debdf0a-380f-50b9-a8e0-ca94ac8f9218',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB63753',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 219080,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-26',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2011}
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63753%27 HTTP/1.1" 200 None
2026-03-27 10:41:27 [auto1.de] INFO: Saving data for XB63753: {'auction_closing_time': 1774713849.0, 'created_time': 1773858641.025574, 'last_price_update_time': 1774608087.653203}
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB63753') HTTP/1.1" 204 0
2026-03-27 10:41:27 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL16221%27 HTTP/1.1" 200 None
2026-03-27 10:41:27 [auto1.de] INFO: Scrape type for VL16221: 2
2026-03-27 10:41:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78695a34-f65d-54c3-9d90-da9a1f75177b with identifier: VL16221
2026-03-27 10:41:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78695a34-f65d-54c3-9d90-da9a1f75177b with scrape type 2
2026-03-27 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78695a34-f65d-54c3-9d90-da9a1f75177b with scrape type 2
2026-03-27 10:41:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78695a34-f65d-54c3-9d90-da9a1f75177b, identifier: VL16221
2026-03-27 10:41:27 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-27 10:41:27 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-27 10:41:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78695a34-f65d-54c3-9d90-da9a1f75177b with identifier: VL16221
2026-03-27 10:41:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78695a34-f65d-54c3-9d90-da9a1f75177b with identifier: VL16221
2026-03-27 10:41:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78695a34-f65d-54c3-9d90-da9a1f75177b with identifier: VL16221 to the API
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:20:40Z',
'fuel_type': 'diesel',
'id': '78695a34-f65d-54c3-9d90-da9a1f75177b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL16221',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40',
'odometer': 103450,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-15',
'seller_name': None,
'title': 'Volvo V40 2.0 D3 R-Design',
'transmission': 'automatic',
'trim': 'R-Design',
'year': 2019}
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL16221%27 HTTP/1.1" 200 None
2026-03-27 10:41:28 [auto1.de] INFO: Saving data for VL16221: {'auction_closing_time': 1774714840.0, 'created_time': 1774291736.668782, 'last_price_update_time': 1774608088.146698}
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL16221') HTTP/1.1" 204 0
2026-03-27 10:41:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:28 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-27 10:41:28 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG77480%27 HTTP/1.1" 200 None
2026-03-27 10:41:28 [auto1.de] INFO: Scrape type for XG77480: 2
2026-03-27 10:41:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7cd9e71-a84d-59aa-9f21-4ac67d5a0338 with identifier: XG77480
2026-03-27 10:41:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7cd9e71-a84d-59aa-9f21-4ac67d5a0338 with scrape type 2
2026-03-27 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7cd9e71-a84d-59aa-9f21-4ac67d5a0338 with scrape type 2
2026-03-27 10:41:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7cd9e71-a84d-59aa-9f21-4ac67d5a0338, identifier: XG77480
2026-03-27 10:41:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7cd9e71-a84d-59aa-9f21-4ac67d5a0338 with identifier: XG77480
2026-03-27 10:41:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7cd9e71-a84d-59aa-9f21-4ac67d5a0338 with identifier: XG77480
2026-03-27 10:41:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7cd9e71-a84d-59aa-9f21-4ac67d5a0338 with identifier: XG77480 to the API
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:50:53Z',
'fuel_type': 'diesel',
'id': 'f7cd9e71-a84d-59aa-9f21-4ac67d5a0338',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG77480',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 222934,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-07',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2013}
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG77480%27 HTTP/1.1" 200 None
2026-03-27 10:41:28 [auto1.de] INFO: Saving data for XG77480: {'auction_closing_time': 1774716653.0, 'created_time': 1773659518.963642, 'last_price_update_time': 1774608088.675734}
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG77480') HTTP/1.1" 204 0
2026-03-27 10:41:28 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-27 10:41:28 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE85774%27 HTTP/1.1" 200 None
2026-03-27 10:41:28 [auto1.de] INFO: Scrape type for DE85774: 2
2026-03-27 10:41:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f46ea9d-e12f-5120-b499-a62ec61d5e5f with identifier: DE85774
2026-03-27 10:41:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f46ea9d-e12f-5120-b499-a62ec61d5e5f with scrape type 2
2026-03-27 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f46ea9d-e12f-5120-b499-a62ec61d5e5f with scrape type 2
2026-03-27 10:41:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f46ea9d-e12f-5120-b499-a62ec61d5e5f, identifier: DE85774
2026-03-27 10:41:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f46ea9d-e12f-5120-b499-a62ec61d5e5f with identifier: DE85774
2026-03-27 10:41:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f46ea9d-e12f-5120-b499-a62ec61d5e5f with identifier: DE85774
2026-03-27 10:41:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f46ea9d-e12f-5120-b499-a62ec61d5e5f with identifier: DE85774 to the API
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:19:53Z',
'fuel_type': 'petrol',
'id': '5f46ea9d-e12f-5120-b499-a62ec61d5e5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE85774',
'listing': 'auction',
'make': 'Kia',
'model': "cee'd",
'odometer': 176084,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-31',
'seller_name': None,
'title': "Kia cee'd 1.6 Spirit",
'transmission': 'manual',
'trim': 'Spirit',
'year': 2009}
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE85774%27 HTTP/1.1" 200 None
2026-03-27 10:41:29 [auto1.de] INFO: Saving data for DE85774: {'auction_closing_time': 1774714793.0, 'created_time': 1773859923.758039, 'last_price_update_time': 1774608089.159019}
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE85774') HTTP/1.1" 204 0
2026-03-27 10:41:29 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF55313%27 HTTP/1.1" 200 None
2026-03-27 10:41:29 [auto1.de] INFO: Scrape type for KF55313: 2
2026-03-27 10:41:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3 with identifier: KF55313
2026-03-27 10:41:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3 with scrape type 2
2026-03-27 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3 with scrape type 2
2026-03-27 10:41:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3, identifier: KF55313
2026-03-27 10:41:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3 with identifier: KF55313
2026-03-27 10:41:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3 with identifier: KF55313
2026-03-27 10:41:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3 with identifier: KF55313 to the API
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:30:57Z',
'fuel_type': 'petrol',
'id': '5fba0f4d-8c25-51cf-9a0c-9dff4d1fd4c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF55313',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 333094,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-03',
'seller_name': None,
'title': 'Volkswagen Caddy 1.6 Life Gewinner Caddy',
'transmission': 'manual',
'trim': 'Life Gewinner',
'year': 2009}
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF55313%27 HTTP/1.1" 200 None
2026-03-27 10:41:29 [auto1.de] INFO: Saving data for KF55313: {'auction_closing_time': 1774715457.0, 'created_time': 1773732645.104751, 'last_price_update_time': 1774608089.67286}
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF55313') HTTP/1.1" 204 0
2026-03-27 10:41:29 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ09190%27 HTTP/1.1" 200 None
2026-03-27 10:41:29 [auto1.de] INFO: Scrape type for LZ09190: 2
2026-03-27 10:41:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf74005e-8341-5543-ac74-cc35eac3da6c with identifier: LZ09190
2026-03-27 10:41:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf74005e-8341-5543-ac74-cc35eac3da6c with scrape type 2
2026-03-27 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf74005e-8341-5543-ac74-cc35eac3da6c with scrape type 2
2026-03-27 10:41:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf74005e-8341-5543-ac74-cc35eac3da6c, identifier: LZ09190
2026-03-27 10:41:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP48150> (referer: https://www.auto1.com/v1/car-details-view/WP48150/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf74005e-8341-5543-ac74-cc35eac3da6c with identifier: LZ09190
2026-03-27 10:41:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf74005e-8341-5543-ac74-cc35eac3da6c with identifier: LZ09190
2026-03-27 10:41:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf74005e-8341-5543-ac74-cc35eac3da6c with identifier: LZ09190 to the API
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 271,
'expiration_date': '2026-03-28T16:36:43Z',
'fuel_type': 'petrol',
'id': 'cf74005e-8341-5543-ac74-cc35eac3da6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ09190',
'listing': 'auction',
'make': 'Jeep',
'model': 'Wrangler Unlimited',
'odometer': 102704,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-16',
'seller_name': None,
'title': 'Jeep Wrangler Unlimited 2.0 TGDi Sahara',
'transmission': 'automatic',
'trim': 'Sahara',
'year': 2021}
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ09190%27 HTTP/1.1" 200 None
2026-03-27 10:41:30 [auto1.de] INFO: Saving data for LZ09190: {'auction_closing_time': 1774715803.0, 'created_time': 1773830088.489627, 'last_price_update_time': 1774608090.313765}
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ09190') HTTP/1.1" 204 0
2026-03-27 10:41:30 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU55800%27 HTTP/1.1" 200 None
2026-03-27 10:41:30 [auto1.de] INFO: Scrape type for YU55800: 2
2026-03-27 10:41:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0916ffe3-44cd-5787-9fca-947f936d4181 with identifier: YU55800
2026-03-27 10:41:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0916ffe3-44cd-5787-9fca-947f936d4181 with scrape type 2
2026-03-27 10:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0916ffe3-44cd-5787-9fca-947f936d4181 with scrape type 2
2026-03-27 10:41:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0916ffe3-44cd-5787-9fca-947f936d4181, identifier: YU55800
2026-03-27 10:41:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AH71943/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0916ffe3-44cd-5787-9fca-947f936d4181 with identifier: YU55800
2026-03-27 10:41:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0916ffe3-44cd-5787-9fca-947f936d4181 with identifier: YU55800
2026-03-27 10:41:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0916ffe3-44cd-5787-9fca-947f936d4181 with identifier: YU55800 to the API
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:07:14Z',
'fuel_type': 'petrol',
'id': '0916ffe3-44cd-5787-9fca-947f936d4181',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU55800',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 131884,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-20',
'seller_name': None,
'title': 'Renault Megane 1.2 BOSE Edition',
'transmission': 'manual',
'trim': 'BOSE Edition',
'year': 2013}
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU55800%27 HTTP/1.1" 200 None
2026-03-27 10:41:30 [auto1.de] INFO: Saving data for YU55800: {'auction_closing_time': 1774714034.0, 'created_time': 1773775657.535171, 'last_price_update_time': 1774608090.794405}
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU55800') HTTP/1.1" 204 0
2026-03-27 10:41:30 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM23773%27 HTTP/1.1" 200 None
2026-03-27 10:41:30 [auto1.de] INFO: Scrape type for MM23773: 2
2026-03-27 10:41:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0127fa3-ff0d-57ce-9de3-e733be125e5d with identifier: MM23773
2026-03-27 10:41:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0127fa3-ff0d-57ce-9de3-e733be125e5d with scrape type 2
2026-03-27 10:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0127fa3-ff0d-57ce-9de3-e733be125e5d with scrape type 2
2026-03-27 10:41:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0127fa3-ff0d-57ce-9de3-e733be125e5d, identifier: MM23773
2026-03-27 10:41:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0127fa3-ff0d-57ce-9de3-e733be125e5d with identifier: MM23773
2026-03-27 10:41:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0127fa3-ff0d-57ce-9de3-e733be125e5d with identifier: MM23773
2026-03-27 10:41:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0127fa3-ff0d-57ce-9de3-e733be125e5d with identifier: MM23773 to the API
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:15:22Z',
'fuel_type': 'diesel',
'id': 'b0127fa3-ff0d-57ce-9de3-e733be125e5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM23773',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 216498,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-10',
'seller_name': None,
'title': 'BMW 2er 218d Active Tourer Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2015}
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM23773%27 HTTP/1.1" 200 None
2026-03-27 10:41:31 [auto1.de] INFO: Saving data for MM23773: {'auction_closing_time': 1774714522.0, 'created_time': 1774293911.948399, 'last_price_update_time': 1774608091.608536}
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM23773') HTTP/1.1" 204 0
2026-03-27 10:41:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1982e3b9-ef4e-545d-a53b-6cc527e6af8c with identifier: WP48150
2026-03-27 10:41:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1982e3b9-ef4e-545d-a53b-6cc527e6af8c with scrape type 1
2026-03-27 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1982e3b9-ef4e-545d-a53b-6cc527e6af8c
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_f0403256e6c73b529a640334cecea818.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_f0403256e6c73b529a640334cecea818.jpg not downloaded yet
2026-03-27 10:41:31 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-27 10:41:31 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-27 10:41:31 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-27 10:41:31 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74558%27 HTTP/1.1" 200 None
2026-03-27 10:41:31 [auto1.de] INFO: Scrape type for ZA74558: 2
2026-03-27 10:41:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15aaabb6-c342-5cb7-aa23-044bcfe32476 with identifier: ZA74558
2026-03-27 10:41:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15aaabb6-c342-5cb7-aa23-044bcfe32476 with scrape type 2
2026-03-27 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15aaabb6-c342-5cb7-aa23-044bcfe32476 with scrape type 2
2026-03-27 10:41:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15aaabb6-c342-5cb7-aa23-044bcfe32476, identifier: ZA74558
2026-03-27 10:41:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15aaabb6-c342-5cb7-aa23-044bcfe32476 with identifier: ZA74558
2026-03-27 10:41:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15aaabb6-c342-5cb7-aa23-044bcfe32476 with identifier: ZA74558
2026-03-27 10:41:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15aaabb6-c342-5cb7-aa23-044bcfe32476 with identifier: ZA74558 to the API
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:15:34Z',
'fuel_type': 'diesel',
'id': '15aaabb6-c342-5cb7-aa23-044bcfe32476',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA74558',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 292487,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-14',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2014}
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74558%27 HTTP/1.1" 200 None
2026-03-27 10:41:32 [auto1.de] INFO: Saving data for ZA74558: {'auction_closing_time': 1774714534.0, 'created_time': 1773776243.486686, 'last_price_update_time': 1774608092.159848}
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA74558') HTTP/1.1" 204 0
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_97e22c11f17da9aecf7a8a74f9bdd68e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_97e22c11f17da9aecf7a8a74f9bdd68e.jpg not downloaded yet
2026-03-27 10:41:32 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27590%27 HTTP/1.1" 200 None
2026-03-27 10:41:32 [auto1.de] INFO: Scrape type for PE27590: 2
2026-03-27 10:41:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9f8e31a-4bf3-56de-b32f-523fd7d4d402 with identifier: PE27590
2026-03-27 10:41:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9f8e31a-4bf3-56de-b32f-523fd7d4d402 with scrape type 2
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9f8e31a-4bf3-56de-b32f-523fd7d4d402 with scrape type 2
2026-03-27 10:41:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9f8e31a-4bf3-56de-b32f-523fd7d4d402, identifier: PE27590
2026-03-27 10:41:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9f8e31a-4bf3-56de-b32f-523fd7d4d402 with identifier: PE27590
2026-03-27 10:41:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9f8e31a-4bf3-56de-b32f-523fd7d4d402 with identifier: PE27590
2026-03-27 10:41:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9f8e31a-4bf3-56de-b32f-523fd7d4d402 with identifier: PE27590 to the API
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:39:15Z',
'fuel_type': 'diesel',
'id': 'e9f8e31a-4bf3-56de-b32f-523fd7d4d402',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE27590',
'listing': 'auction',
'make': 'Kia',
'model': 'Carens',
'odometer': 134934,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-19',
'seller_name': None,
'title': 'Kia Carens 1.7 CRDi UEFA Euro 2016',
'transmission': 'manual',
'trim': 'UEFA Euro 2016',
'year': 2016}
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27590%27 HTTP/1.1" 200 None
2026-03-27 10:41:32 [auto1.de] INFO: Saving data for PE27590: {'auction_closing_time': 1774715955.0, 'created_time': 1773775233.496432, 'last_price_update_time': 1774608092.762885}
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE27590') HTTP/1.1" 204 0
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_2cf30a51a1a148f8fa06f2e14adb7744.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_2cf30a51a1a148f8fa06f2e14adb7744.jpg not downloaded yet
2026-03-27 10:41:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:32 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-27 10:41:32 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY37454%27 HTTP/1.1" 200 None
2026-03-27 10:41:32 [auto1.de] INFO: Scrape type for PY37454: 2
2026-03-27 10:41:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ca81acb-c9ff-5d2d-9523-136f52758484 with identifier: PY37454
2026-03-27 10:41:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ca81acb-c9ff-5d2d-9523-136f52758484 with scrape type 2
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ca81acb-c9ff-5d2d-9523-136f52758484 with scrape type 2
2026-03-27 10:41:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ca81acb-c9ff-5d2d-9523-136f52758484, identifier: PY37454
2026-03-27 10:41:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ca81acb-c9ff-5d2d-9523-136f52758484 with identifier: PY37454
2026-03-27 10:41:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ca81acb-c9ff-5d2d-9523-136f52758484 with identifier: PY37454
2026-03-27 10:41:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ca81acb-c9ff-5d2d-9523-136f52758484 with identifier: PY37454 to the API
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:41:00Z',
'fuel_type': 'diesel',
'id': '9ca81acb-c9ff-5d2d-9523-136f52758484',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY37454',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 170687,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-04',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.6 TDI Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2013}
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY37454%27 HTTP/1.1" 200 None
2026-03-27 10:41:33 [auto1.de] INFO: Saving data for PY37454: {'auction_closing_time': 1774716060.0, 'created_time': 1773741999.456181, 'last_price_update_time': 1774608093.310814}
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY37454') HTTP/1.1" 204 0
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_9b2b04308dddecefc6101888fc27a4fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_9b2b04308dddecefc6101888fc27a4fa.jpg not downloaded yet
2026-03-27 10:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_f0403256e6c73b529a640334cecea818.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:33 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-27 10:41:33 [auto1.de] INFO: Found listing with ID: ZZ72723
2026-03-27 10:41:33 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX51992%27 HTTP/1.1" 200 None
2026-03-27 10:41:33 [auto1.de] INFO: Scrape type for SX51992: 2
2026-03-27 10:41:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90552867-bda4-5f3a-8027-7ffa30655312 with identifier: SX51992
2026-03-27 10:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90552867-bda4-5f3a-8027-7ffa30655312 with scrape type 2
2026-03-27 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90552867-bda4-5f3a-8027-7ffa30655312 with scrape type 2
2026-03-27 10:41:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90552867-bda4-5f3a-8027-7ffa30655312, identifier: SX51992
2026-03-27 10:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_97e22c11f17da9aecf7a8a74f9bdd68e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90552867-bda4-5f3a-8027-7ffa30655312 with identifier: SX51992
2026-03-27 10:41:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90552867-bda4-5f3a-8027-7ffa30655312 with identifier: SX51992
2026-03-27 10:41:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90552867-bda4-5f3a-8027-7ffa30655312 with identifier: SX51992 to the API
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:16:49Z',
'fuel_type': 'diesel',
'id': '90552867-bda4-5f3a-8027-7ffa30655312',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX51992',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 153379,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-15',
'seller_name': None,
'title': 'Seat Ateca 2.0 TDI Xcellence 4Drive',
'transmission': 'automatic',
'trim': 'Xcellence 4Drive',
'year': 2017}
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX51992%27 HTTP/1.1" 200 None
2026-03-27 10:41:34 [auto1.de] INFO: Saving data for SX51992: {'auction_closing_time': 1774714609.0, 'created_time': 1773427015.614078, 'last_price_update_time': 1774608094.090078}
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX51992') HTTP/1.1" 204 0
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_173f7513d93a5dea9c574cd3ddbca271.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_173f7513d93a5dea9c574cd3ddbca271.jpg not downloaded yet
2026-03-27 10:41:34 [auto1.de] INFO: Found listing with ID: VX77382
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX77382%27 HTTP/1.1" 200 None
2026-03-27 10:41:34 [auto1.de] INFO: Scrape type for VX77382: 2
2026-03-27 10:41:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ac7bd0c-bbae-5215-970b-38dad016a6ba with identifier: VX77382
2026-03-27 10:41:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ac7bd0c-bbae-5215-970b-38dad016a6ba with scrape type 2
2026-03-27 10:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ac7bd0c-bbae-5215-970b-38dad016a6ba with scrape type 2
2026-03-27 10:41:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ac7bd0c-bbae-5215-970b-38dad016a6ba, identifier: VX77382
2026-03-27 10:41:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ac7bd0c-bbae-5215-970b-38dad016a6ba with identifier: VX77382
2026-03-27 10:41:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ac7bd0c-bbae-5215-970b-38dad016a6ba with identifier: VX77382
2026-03-27 10:41:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ac7bd0c-bbae-5215-970b-38dad016a6ba with identifier: VX77382 to the API
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:46:51Z',
'fuel_type': 'diesel',
'id': '1ac7bd0c-bbae-5215-970b-38dad016a6ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX77382',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 102399,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-04',
'seller_name': None,
'title': 'Hyundai i30 1.6 CRDi Trend blue',
'transmission': 'automatic',
'trim': 'Trend blue',
'year': 2016}
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX77382%27 HTTP/1.1" 200 None
2026-03-27 10:41:34 [auto1.de] INFO: Saving data for VX77382: {'auction_closing_time': 1774716411.0, 'created_time': 1774293078.609282, 'last_price_update_time': 1774608094.783316}
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX77382') HTTP/1.1" 204 0
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_03a6471a3b2061ce3efada2eac51e152.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_03a6471a3b2061ce3efada2eac51e152.jpg not downloaded yet
2026-03-27 10:41:34 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-27 10:41:34 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-27 10:41:34 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ88373%27 HTTP/1.1" 200 None
2026-03-27 10:41:34 [auto1.de] INFO: Scrape type for AJ88373: 2
2026-03-27 10:41:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cb2324e-3a11-5df2-afa9-a0db06eb3189 with identifier: AJ88373
2026-03-27 10:41:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cb2324e-3a11-5df2-afa9-a0db06eb3189 with scrape type 2
2026-03-27 10:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cb2324e-3a11-5df2-afa9-a0db06eb3189 with scrape type 2
2026-03-27 10:41:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cb2324e-3a11-5df2-afa9-a0db06eb3189, identifier: AJ88373
2026-03-27 10:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RR41525> (referer: https://www.auto1.com/v1/car-details-view/RR41525/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf44ccd0>
2026-03-27 10:41:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_f0403256e6c73b529a640334cecea818.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_f0403256e6c73b529a640334cecea818.jpg saved to cache
2026-03-27 10:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1982e3b9-ef4e-545d-a53b-6cc527e6af8c
2026-03-27 10:41:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be085410>
2026-03-27 10:41:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_97e22c11f17da9aecf7a8a74f9bdd68e.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_97e22c11f17da9aecf7a8a74f9bdd68e.jpg saved to cache
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1982e3b9-ef4e-545d-a53b-6cc527e6af8c
2026-03-27 10:41:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_2cf30a51a1a148f8fa06f2e14adb7744.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_9b2b04308dddecefc6101888fc27a4fa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cb2324e-3a11-5df2-afa9-a0db06eb3189 with identifier: AJ88373
2026-03-27 10:41:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cb2324e-3a11-5df2-afa9-a0db06eb3189 with identifier: AJ88373
2026-03-27 10:41:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cb2324e-3a11-5df2-afa9-a0db06eb3189 with identifier: AJ88373 to the API
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:57:15Z',
'fuel_type': 'petrol',
'id': '1cb2324e-3a11-5df2-afa9-a0db06eb3189',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ88373',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 217602,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-28',
'seller_name': None,
'title': 'BMW 1er 118i',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ88373%27 HTTP/1.1" 200 None
2026-03-27 10:41:35 [auto1.de] INFO: Saving data for AJ88373: {'auction_closing_time': 1774717035.0, 'created_time': 1773466636.811886, 'last_price_update_time': 1774608095.609714}
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ88373') HTTP/1.1" 204 0
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_f7e2864c8bc6812daf9ead41a40d83b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_f7e2864c8bc6812daf9ead41a40d83b6.jpg not downloaded yet
2026-03-27 10:41:35 [auto1.de] INFO: Found listing with ID: TG62557
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_800efbb626f0fb73e82f1edd82a53874.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_800efbb626f0fb73e82f1edd82a53874.jpg not downloaded yet
2026-03-27 10:41:35 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 10522 | hits on page: 40
2026-03-27 10:41:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65642d36-689c-5634-88d0-5a907136b411 with identifier: RR41525
2026-03-27 10:41:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65642d36-689c-5634-88d0-5a907136b411 with scrape type 1
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65642d36-689c-5634-88d0-5a907136b411
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F1c%252Fb51cdf21f3434bc524a62b04725be780%252Fpa%252FRR41525_910e82583470d0ec017a0812160363b7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_910e82583470d0ec017a0812160363b7.jpg already downloaded
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F1c%252Fb51cdf21f3434bc524a62b04725be780%252Fpa%252FRR41525_8c5f6cd72e2c394ad5d4bea085c55b70.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_8c5f6cd72e2c394ad5d4bea085c55b70.jpg already downloaded
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F1c%252Fb51cdf21f3434bc524a62b04725be780%252Fpa%252FRR41525_da4ee8bb526f84f7c5c29d53d6289099.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_da4ee8bb526f84f7c5c29d53d6289099.jpg already downloaded
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F1c%252Fb51cdf21f3434bc524a62b04725be780%252Fpa%252FRR41525_d0a8e8677058331bea6c134f04f7c24b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_d0a8e8677058331bea6c134f04f7c24b.jpg already downloaded
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F1c%252Fb51cdf21f3434bc524a62b04725be780%252Fpa%252FRR41525_92bac633f1ab1e7ffaee2d5e26d2a52d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_92bac633f1ab1e7ffaee2d5e26d2a52d.jpg already downloaded
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F1c%252Fb51cdf21f3434bc524a62b04725be780%252Fpa%252FRR41525_1dd69fa1b61f41fd88e010f7d3d10fff.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_1dd69fa1b61f41fd88e010f7d3d10fff.jpg already downloaded
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F1c%252Fb51cdf21f3434bc524a62b04725be780%252Fpa%252FRR41525_4e81172b340061d165a7fbfbdc7f11d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_4e81172b340061d165a7fbfbdc7f11d8.jpg already downloaded
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F1c%252Fb51cdf21f3434bc524a62b04725be780%252Fpa%252FRR41525_b387f037b59d9d23320880ce7e2d5d29.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_b387f037b59d9d23320880ce7e2d5d29.jpg already downloaded
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F1c%252Fb51cdf21f3434bc524a62b04725be780%252Fpa%252FRR41525_f56afe96465014032f0335ad03238602.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_f56afe96465014032f0335ad03238602.jpg already downloaded
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F1c%252Fb51cdf21f3434bc524a62b04725be780%252Fpa%252FRR41525_1810fae648bfbaa2198ef0be9b4520a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_1810fae648bfbaa2198ef0be9b4520a6.jpg already downloaded
2026-03-27 10:41:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65642d36-689c-5634-88d0-5a907136b411, identifier: RR41525
2026-03-27 10:41:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be00a350>
2026-03-27 10:41:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_2cf30a51a1a148f8fa06f2e14adb7744.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_2cf30a51a1a148f8fa06f2e14adb7744.jpg saved to cache
2026-03-27 10:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1982e3b9-ef4e-545d-a53b-6cc527e6af8c
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf368050>
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_9b2b04308dddecefc6101888fc27a4fa.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_9b2b04308dddecefc6101888fc27a4fa.jpg saved to cache
2026-03-27 10:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1982e3b9-ef4e-545d-a53b-6cc527e6af8c
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_20effde0523df6a33a1d0c01d9929061.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_20effde0523df6a33a1d0c01d9929061.jpg not downloaded yet
2026-03-27 10:41:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65642d36-689c-5634-88d0-5a907136b411 with identifier: RR41525
2026-03-27 10:41:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65642d36-689c-5634-88d0-5a907136b411 with identifier: RR41525
2026-03-27 10:41:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65642d36-689c-5634-88d0-5a907136b411 with identifier: RR41525 to the API
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RR41525>
{'auction_title': '',
'c_o_2_emission_value': 187,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:04:12Z',
'fuel_type': 'diesel',
'id': '65642d36-689c-5634-88d0-5a907136b411',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR41525',
'listing': 'auction',
'location': 'DE, Ketzin',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 112985,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 14,
'photo_urls': ['https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_910e82583470d0ec017a0812160363b7.jpg',
'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_8c5f6cd72e2c394ad5d4bea085c55b70.jpg',
'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_da4ee8bb526f84f7c5c29d53d6289099.jpg',
'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_d0a8e8677058331bea6c134f04f7c24b.jpg',
'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_92bac633f1ab1e7ffaee2d5e26d2a52d.jpg',
'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_1dd69fa1b61f41fd88e010f7d3d10fff.jpg',
'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_4e81172b340061d165a7fbfbdc7f11d8.jpg',
'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_b387f037b59d9d23320880ce7e2d5d29.jpg',
'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_f56afe96465014032f0335ad03238602.jpg',
'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_1810fae648bfbaa2198ef0be9b4520a6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65642d36-689c-5634-88d0-5a907136b411/65642d36-689c-5634-88d0-5a907136b411_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90590,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_910e82583470d0ec017a0812160363b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65642d36-689c-5634-88d0-5a907136b411/65642d36-689c-5634-88d0-5a907136b411_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90590,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_8c5f6cd72e2c394ad5d4bea085c55b70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65642d36-689c-5634-88d0-5a907136b411/65642d36-689c-5634-88d0-5a907136b411_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76695,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_da4ee8bb526f84f7c5c29d53d6289099.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65642d36-689c-5634-88d0-5a907136b411/65642d36-689c-5634-88d0-5a907136b411_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67655,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_d0a8e8677058331bea6c134f04f7c24b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65642d36-689c-5634-88d0-5a907136b411/65642d36-689c-5634-88d0-5a907136b411_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_92bac633f1ab1e7ffaee2d5e26d2a52d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65642d36-689c-5634-88d0-5a907136b411/65642d36-689c-5634-88d0-5a907136b411_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_1dd69fa1b61f41fd88e010f7d3d10fff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65642d36-689c-5634-88d0-5a907136b411/65642d36-689c-5634-88d0-5a907136b411_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86491,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_4e81172b340061d165a7fbfbdc7f11d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65642d36-689c-5634-88d0-5a907136b411/65642d36-689c-5634-88d0-5a907136b411_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103493,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_b387f037b59d9d23320880ce7e2d5d29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65642d36-689c-5634-88d0-5a907136b411/65642d36-689c-5634-88d0-5a907136b411_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_f56afe96465014032f0335ad03238602.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65642d36-689c-5634-88d0-5a907136b411/65642d36-689c-5634-88d0-5a907136b411_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/1c/b51cdf21f3434bc524a62b04725be780/pa/RR41525_1810fae648bfbaa2198ef0be9b4520a6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-24',
'seats_number': 3,
'seller_name': None,
'title': 'Mercedes-Benz Vito 114 CDI lang',
'transmission': 'manual',
'trim': 'lang',
'year': 2019}
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR41525%27 HTTP/1.1" 200 None
2026-03-27 10:41:36 [auto1.de] INFO: Saving data for RR41525: {'created_time': 1774608096.689139, 'last_price_update_time': 1774608096.689151, 'auction_closing_time': 1774713852.0}
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR41525') HTTP/1.1" 204 0
2026-03-27 10:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_173f7513d93a5dea9c574cd3ddbca271.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_03a6471a3b2061ce3efada2eac51e152.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:36 [auto1.de] INFO: Found listing with ID: VX77382
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX77382%27 HTTP/1.1" 200 None
2026-03-27 10:41:36 [auto1.de] INFO: Scrape type for VX77382: 0
2026-03-27 10:41:36 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-27 10:41:36 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-27 10:41:36 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ88373%27 HTTP/1.1" 200 None
2026-03-27 10:41:36 [auto1.de] INFO: Scrape type for AJ88373: 0
2026-03-27 10:41:36 [auto1.de] INFO: Found listing with ID: TG62557
2026-03-27 10:41:36 [auto1.de] INFO: Found listing with ID: DG23349
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23349%27 HTTP/1.1" 200 None
2026-03-27 10:41:36 [auto1.de] INFO: Scrape type for DG23349: 1
2026-03-27 10:41:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_f7e2864c8bc6812daf9ead41a40d83b6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_c55f8a0b2e2876e0c1fad3fa07cf63fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_c55f8a0b2e2876e0c1fad3fa07cf63fe.jpg not downloaded yet
2026-03-27 10:41:36 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-27 10:41:36 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX42000%27 HTTP/1.1" 200 None
2026-03-27 10:41:36 [auto1.de] INFO: Scrape type for KX42000: 2
2026-03-27 10:41:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90829174-e7d4-584c-a331-3ece749f95e0 with identifier: KX42000
2026-03-27 10:41:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90829174-e7d4-584c-a331-3ece749f95e0 with scrape type 2
2026-03-27 10:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90829174-e7d4-584c-a331-3ece749f95e0 with scrape type 2
2026-03-27 10:41:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90829174-e7d4-584c-a331-3ece749f95e0, identifier: KX42000
2026-03-27 10:41:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90829174-e7d4-584c-a331-3ece749f95e0 with identifier: KX42000
2026-03-27 10:41:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90829174-e7d4-584c-a331-3ece749f95e0 with identifier: KX42000
2026-03-27 10:41:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90829174-e7d4-584c-a331-3ece749f95e0 with identifier: KX42000 to the API
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 199,
'expiration_date': '2026-03-28T16:16:34Z',
'fuel_type': 'diesel',
'id': '90829174-e7d4-584c-a331-3ece749f95e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX42000',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 138277,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-06',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline lang',
'transmission': 'automatic',
'trim': 'Comfortline lang',
'year': 2019}
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX42000%27 HTTP/1.1" 200 None
2026-03-27 10:41:37 [auto1.de] INFO: Saving data for KX42000: {'auction_closing_time': 1774714594.0, 'created_time': 1773427299.012885, 'last_price_update_time': 1774608097.398588}
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX42000') HTTP/1.1" 204 0
2026-03-27 10:41:37 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-27 10:41:37 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-27 10:41:37 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD56030%27 HTTP/1.1" 200 None
2026-03-27 10:41:37 [auto1.de] INFO: Scrape type for XD56030: 2
2026-03-27 10:41:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 920fc047-d5f4-5b40-be89-e2eae8ec086d with identifier: XD56030
2026-03-27 10:41:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 920fc047-d5f4-5b40-be89-e2eae8ec086d with scrape type 2
2026-03-27 10:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 920fc047-d5f4-5b40-be89-e2eae8ec086d with scrape type 2
2026-03-27 10:41:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 920fc047-d5f4-5b40-be89-e2eae8ec086d, identifier: XD56030
2026-03-27 10:41:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_20effde0523df6a33a1d0c01d9929061.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_800efbb626f0fb73e82f1edd82a53874.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 920fc047-d5f4-5b40-be89-e2eae8ec086d with identifier: XD56030
2026-03-27 10:41:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 920fc047-d5f4-5b40-be89-e2eae8ec086d with identifier: XD56030
2026-03-27 10:41:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 920fc047-d5f4-5b40-be89-e2eae8ec086d with identifier: XD56030 to the API
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:21:42Z',
'fuel_type': 'petrol',
'id': '920fc047-d5f4-5b40-be89-e2eae8ec086d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD56030',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 115828,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-17',
'seller_name': None,
'title': 'Hyundai i30 1.4 FIFA World Cup Edition',
'transmission': 'manual',
'trim': 'FIFA World Cup Edition',
'year': 2014}
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD56030%27 HTTP/1.1" 200 None
2026-03-27 10:41:37 [auto1.de] INFO: Saving data for XD56030: {'auction_closing_time': 1774714902.0, 'created_time': 1773134834.795738, 'last_price_update_time': 1774608097.957533}
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD56030') HTTP/1.1" 204 0
2026-03-27 10:41:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0aed10>
2026-03-27 10:41:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_173f7513d93a5dea9c574cd3ddbca271.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_173f7513d93a5dea9c574cd3ddbca271.jpg saved to cache
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1982e3b9-ef4e-545d-a53b-6cc527e6af8c
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f5ad0>
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_03a6471a3b2061ce3efada2eac51e152.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_03a6471a3b2061ce3efada2eac51e152.jpg saved to cache
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1982e3b9-ef4e-545d-a53b-6cc527e6af8c
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0b1790>
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_f7e2864c8bc6812daf9ead41a40d83b6.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_f7e2864c8bc6812daf9ead41a40d83b6.jpg saved to cache
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1982e3b9-ef4e-545d-a53b-6cc527e6af8c
2026-03-27 10:41:38 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-27 10:41:38 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL78300%27 HTTP/1.1" 200 None
2026-03-27 10:41:38 [auto1.de] INFO: Scrape type for PL78300: 2
2026-03-27 10:41:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b682d33-830f-5f43-b6e8-30d2a9a0eaee with identifier: PL78300
2026-03-27 10:41:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b682d33-830f-5f43-b6e8-30d2a9a0eaee with scrape type 2
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b682d33-830f-5f43-b6e8-30d2a9a0eaee with scrape type 2
2026-03-27 10:41:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b682d33-830f-5f43-b6e8-30d2a9a0eaee, identifier: PL78300
2026-03-27 10:41:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b682d33-830f-5f43-b6e8-30d2a9a0eaee with identifier: PL78300
2026-03-27 10:41:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b682d33-830f-5f43-b6e8-30d2a9a0eaee with identifier: PL78300
2026-03-27 10:41:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b682d33-830f-5f43-b6e8-30d2a9a0eaee with identifier: PL78300 to the API
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:25:15Z',
'fuel_type': 'petrol',
'id': '5b682d33-830f-5f43-b6e8-30d2a9a0eaee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL78300',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 182576,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-19',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2010}
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL78300%27 HTTP/1.1" 200 None
2026-03-27 10:41:38 [auto1.de] INFO: Saving data for PL78300: {'auction_closing_time': 1774715115.0, 'created_time': 1774262332.314036, 'last_price_update_time': 1774608098.616458}
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL78300') HTTP/1.1" 204 0
2026-03-27 10:41:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_c55f8a0b2e2876e0c1fad3fa07cf63fe.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:38 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-27 10:41:38 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-27 10:41:38 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF92976%27 HTTP/1.1" 200 None
2026-03-27 10:41:38 [auto1.de] INFO: Scrape type for FF92976: 2
2026-03-27 10:41:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d049567-ddba-5da5-89b8-ff10d0657ab5 with identifier: FF92976
2026-03-27 10:41:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d049567-ddba-5da5-89b8-ff10d0657ab5 with scrape type 2
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d049567-ddba-5da5-89b8-ff10d0657ab5 with scrape type 2
2026-03-27 10:41:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d049567-ddba-5da5-89b8-ff10d0657ab5, identifier: FF92976
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5a4fd0>
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_20effde0523df6a33a1d0c01d9929061.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_20effde0523df6a33a1d0c01d9929061.jpg saved to cache
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1982e3b9-ef4e-545d-a53b-6cc527e6af8c
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f0c50>
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_800efbb626f0fb73e82f1edd82a53874.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_800efbb626f0fb73e82f1edd82a53874.jpg saved to cache
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1982e3b9-ef4e-545d-a53b-6cc527e6af8c
2026-03-27 10:41:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d049567-ddba-5da5-89b8-ff10d0657ab5 with identifier: FF92976
2026-03-27 10:41:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d049567-ddba-5da5-89b8-ff10d0657ab5 with identifier: FF92976
2026-03-27 10:41:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d049567-ddba-5da5-89b8-ff10d0657ab5 with identifier: FF92976 to the API
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-28T16:27:52Z',
'fuel_type': 'diesel',
'id': '2d049567-ddba-5da5-89b8-ff10d0657ab5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF92976',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'M-Klasse',
'odometer': 307091,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-30',
'seller_name': None,
'title': 'Mercedes-Benz M-Klasse ML 350 CDI BlueTEC',
'transmission': 'automatic',
'trim': 'BlueTEC',
'year': 2014}
2026-03-27 10:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF92976%27 HTTP/1.1" 200 None
2026-03-27 10:41:40 [auto1.de] INFO: Saving data for FF92976: {'auction_closing_time': 1774715272.0, 'created_time': 1774293527.894637, 'last_price_update_time': 1774608100.000031}
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF92976') HTTP/1.1" 204 0
2026-03-27 10:41:40 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-27 10:41:40 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-27 10:41:40 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-27 10:41:40 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-27 10:41:40 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-27 10:41:40 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN67479%27 HTTP/1.1" 200 None
2026-03-27 10:41:40 [auto1.de] INFO: Scrape type for CN67479: 2
2026-03-27 10:41:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f with identifier: CN67479
2026-03-27 10:41:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f with scrape type 2
2026-03-27 10:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f with scrape type 2
2026-03-27 10:41:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f, identifier: CN67479
2026-03-27 10:41:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f with identifier: CN67479
2026-03-27 10:41:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f with identifier: CN67479
2026-03-27 10:41:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6221f91d-1ff6-5448-a6b5-d62a28f0ca8f with identifier: CN67479 to the API
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:02:17Z',
'fuel_type': 'diesel',
'id': '6221f91d-1ff6-5448-a6b5-d62a28f0ca8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN67479',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 204532,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-08',
'seller_name': None,
'title': 'Peugeot Expert 2.0 HDi L1H1 Tendance',
'transmission': 'manual',
'trim': 'L1H1 Tendance',
'year': 2011}
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN67479%27 HTTP/1.1" 200 None
2026-03-27 10:41:40 [auto1.de] INFO: Saving data for CN67479: {'auction_closing_time': 1774713737.0, 'created_time': 1773662274.904959, 'last_price_update_time': 1774608100.656198}
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN67479') HTTP/1.1" 204 0
2026-03-27 10:41:40 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-27 10:41:40 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-27 10:41:40 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-27 10:41:40 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-27 10:41:40 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-27 10:41:40 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW00779%27 HTTP/1.1" 200 None
2026-03-27 10:41:40 [auto1.de] INFO: Scrape type for UW00779: 2
2026-03-27 10:41:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e42132ff-3dcd-50f7-9cf1-df0a057dde8c with identifier: UW00779
2026-03-27 10:41:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e42132ff-3dcd-50f7-9cf1-df0a057dde8c with scrape type 2
2026-03-27 10:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e42132ff-3dcd-50f7-9cf1-df0a057dde8c with scrape type 2
2026-03-27 10:41:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e42132ff-3dcd-50f7-9cf1-df0a057dde8c, identifier: UW00779
2026-03-27 10:41:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AH71943> (referer: https://www.auto1.com/v1/car-details-view/AH71943/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e42132ff-3dcd-50f7-9cf1-df0a057dde8c with identifier: UW00779
2026-03-27 10:41:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e42132ff-3dcd-50f7-9cf1-df0a057dde8c with identifier: UW00779
2026-03-27 10:41:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e42132ff-3dcd-50f7-9cf1-df0a057dde8c with identifier: UW00779 to the API
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:30:55Z',
'fuel_type': 'diesel',
'id': 'e42132ff-3dcd-50f7-9cf1-df0a057dde8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW00779',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 391015,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-24',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW00779%27 HTTP/1.1" 200 None
2026-03-27 10:41:41 [auto1.de] INFO: Saving data for UW00779: {'auction_closing_time': 1774715455.0, 'created_time': 1773811841.372994, 'last_price_update_time': 1774608101.245501}
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW00779') HTTP/1.1" 204 0
2026-03-27 10:41:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0b3f50>
2026-03-27 10:41:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F8e%252Fcc8ec1cebf6615bdda56768cf9d2cdb6%252Fpa%252FWP48150_c55f8a0b2e2876e0c1fad3fa07cf63fe.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_c55f8a0b2e2876e0c1fad3fa07cf63fe.jpg saved to cache
2026-03-27 10:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1982e3b9-ef4e-545d-a53b-6cc527e6af8c
2026-03-27 10:41:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1982e3b9-ef4e-545d-a53b-6cc527e6af8c, skipping ID generation
2026-03-27 10:41:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1982e3b9-ef4e-545d-a53b-6cc527e6af8c with scrape type 1
2026-03-27 10:41:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1982e3b9-ef4e-545d-a53b-6cc527e6af8c sending to next pipeline
2026-03-27 10:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1982e3b9-ef4e-545d-a53b-6cc527e6af8c, identifier: WP48150
2026-03-27 10:41:41 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-27 10:41:41 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-27 10:41:41 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB05749%27 HTTP/1.1" 200 None
2026-03-27 10:41:41 [auto1.de] INFO: Scrape type for BB05749: 2
2026-03-27 10:41:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24f0b89b-689c-5307-abde-bbf75fa81151 with identifier: BB05749
2026-03-27 10:41:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24f0b89b-689c-5307-abde-bbf75fa81151 with scrape type 2
2026-03-27 10:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24f0b89b-689c-5307-abde-bbf75fa81151 with scrape type 2
2026-03-27 10:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24f0b89b-689c-5307-abde-bbf75fa81151, identifier: BB05749
2026-03-27 10:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1982e3b9-ef4e-545d-a53b-6cc527e6af8c with identifier: WP48150
2026-03-27 10:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1982e3b9-ef4e-545d-a53b-6cc527e6af8c with identifier: WP48150
2026-03-27 10:41:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1982e3b9-ef4e-545d-a53b-6cc527e6af8c with identifier: WP48150 to the API
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_c55f8a0b2e2876e0c1fad3fa07cf63fe.jpg>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:37:35Z',
'fuel_type': 'petrol',
'id': '1982e3b9-ef4e-545d-a53b-6cc527e6af8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP48150',
'listing': 'auction',
'location': 'DE, Schweinfurt',
'make': 'Renault',
'model': 'Twingo',
'odometer': 37123,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66217,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_f0403256e6c73b529a640334cecea818.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_97e22c11f17da9aecf7a8a74f9bdd68e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61053,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_2cf30a51a1a148f8fa06f2e14adb7744.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54684,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_9b2b04308dddecefc6101888fc27a4fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59746,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_173f7513d93a5dea9c574cd3ddbca271.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64661,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_03a6471a3b2061ce3efada2eac51e152.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52398,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_f7e2864c8bc6812daf9ead41a40d83b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66850,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_800efbb626f0fb73e82f1edd82a53874.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63209,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_20effde0523df6a33a1d0c01d9929061.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1982e3b9-ef4e-545d-a53b-6cc527e6af8c/1982e3b9-ef4e-545d-a53b-6cc527e6af8c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71417,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcc/8e/cc8ec1cebf6615bdda56768cf9d2cdb6/pa/WP48150_c55f8a0b2e2876e0c1fad3fa07cf63fe.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-04',
'seats_number': 4,
'seller_name': None,
'title': 'Renault Twingo 1.0 SCe Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2018}
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48150%27 HTTP/1.1" 200 None
2026-03-27 10:41:41 [auto1.de] INFO: Saving data for WP48150: {'created_time': 1774608101.901565, 'last_price_update_time': 1774608101.901578, 'auction_closing_time': 1774715855.0}
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP48150') HTTP/1.1" 204 0
2026-03-27 10:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24f0b89b-689c-5307-abde-bbf75fa81151 with identifier: BB05749
2026-03-27 10:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24f0b89b-689c-5307-abde-bbf75fa81151 with identifier: BB05749
2026-03-27 10:41:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24f0b89b-689c-5307-abde-bbf75fa81151 with identifier: BB05749 to the API
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 281,
'expiration_date': '2026-03-28T16:16:24Z',
'fuel_type': 'petrol',
'id': '24f0b89b-689c-5307-abde-bbf75fa81151',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB05749',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLE-Klasse',
'odometer': 4900,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-29',
'seller_name': None,
'title': 'Mercedes-Benz CLE-Klasse CLE 300 Mild-Hybrid 4Matic AMG Line '
'Premium',
'transmission': 'automatic',
'trim': '4Matic AMG Line Premium',
'year': 2024}
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB05749%27 HTTP/1.1" 200 None
2026-03-27 10:41:42 [auto1.de] INFO: Saving data for BB05749: {'auction_closing_time': 1774714584.0, 'created_time': 1773301481.398373, 'last_price_update_time': 1774608102.251143}
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB05749') HTTP/1.1" 204 0
2026-03-27 10:41:42 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-27 10:41:42 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-27 10:41:42 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-27 10:41:42 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX08266%27 HTTP/1.1" 200 None
2026-03-27 10:41:42 [auto1.de] INFO: Scrape type for ZX08266: 2
2026-03-27 10:41:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b042b90d-6e3c-573b-8a81-75093e4b3add with identifier: ZX08266
2026-03-27 10:41:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b042b90d-6e3c-573b-8a81-75093e4b3add with scrape type 2
2026-03-27 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b042b90d-6e3c-573b-8a81-75093e4b3add with scrape type 2
2026-03-27 10:41:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b042b90d-6e3c-573b-8a81-75093e4b3add, identifier: ZX08266
2026-03-27 10:41:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG23349/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b042b90d-6e3c-573b-8a81-75093e4b3add with identifier: ZX08266
2026-03-27 10:41:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b042b90d-6e3c-573b-8a81-75093e4b3add with identifier: ZX08266
2026-03-27 10:41:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b042b90d-6e3c-573b-8a81-75093e4b3add with identifier: ZX08266 to the API
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:23:07Z',
'fuel_type': 'petrol',
'id': 'b042b90d-6e3c-573b-8a81-75093e4b3add',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX08266',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC40',
'odometer': 141355,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-03',
'seller_name': None,
'title': 'Volvo XC40 2.0 T4 Momentum Pro AWD',
'transmission': 'automatic',
'trim': 'Momentum Pro AWD',
'year': 2019}
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX08266%27 HTTP/1.1" 200 None
2026-03-27 10:41:42 [auto1.de] INFO: Saving data for ZX08266: {'auction_closing_time': 1774714987.0, 'created_time': 1773303507.725137, 'last_price_update_time': 1774608102.751307}
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX08266') HTTP/1.1" 204 0
2026-03-27 10:41:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc3dc508-45ad-56f8-a95d-dd1d888a6fb0 with identifier: AH71943
2026-03-27 10:41:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc3dc508-45ad-56f8-a95d-dd1d888a6fb0 with scrape type 1
2026-03-27 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc3dc508-45ad-56f8-a95d-dd1d888a6fb0
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fde%252F44de58b49a9df6a244a2ad96110e491a%252Fpa%252FAH71943_33622cfe4ffdc47585872f8fdcd3b6e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_33622cfe4ffdc47585872f8fdcd3b6e6.jpg already downloaded
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fde%252F44de58b49a9df6a244a2ad96110e491a%252Fpa%252FAH71943_9f060f8cbab6496f65eb3fd08d764a4b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_9f060f8cbab6496f65eb3fd08d764a4b.jpg already downloaded
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fde%252F44de58b49a9df6a244a2ad96110e491a%252Fpa%252FAH71943_906bb1a0b6447a8e5dbeec7ca6b771b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_906bb1a0b6447a8e5dbeec7ca6b771b6.jpg already downloaded
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fde%252F44de58b49a9df6a244a2ad96110e491a%252Fpa%252FAH71943_bfef95f08ef0244bc005306aeea8cd05.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_bfef95f08ef0244bc005306aeea8cd05.jpg already downloaded
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fde%252F44de58b49a9df6a244a2ad96110e491a%252Fpa%252FAH71943_0602c2865891a497af4ab43d9e67d801.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_0602c2865891a497af4ab43d9e67d801.jpg already downloaded
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fde%252F44de58b49a9df6a244a2ad96110e491a%252Fpa%252FAH71943_6143a33abdcd88be33a413aff1c7ae8e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_6143a33abdcd88be33a413aff1c7ae8e.jpg already downloaded
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fde%252F44de58b49a9df6a244a2ad96110e491a%252Fpa%252FAH71943_b38b4ba01b46f9681d2ac522d8e68694.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_b38b4ba01b46f9681d2ac522d8e68694.jpg already downloaded
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fde%252F44de58b49a9df6a244a2ad96110e491a%252Fpa%252FAH71943_0f1ef07ee8c7d21ed4e9398aefcc754c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_0f1ef07ee8c7d21ed4e9398aefcc754c.jpg already downloaded
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fde%252F44de58b49a9df6a244a2ad96110e491a%252Fpa%252FAH71943_72af9faa0eb882cefb97065f0b9bdd5c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_72af9faa0eb882cefb97065f0b9bdd5c.jpg already downloaded
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fde%252F44de58b49a9df6a244a2ad96110e491a%252Fpa%252FAH71943_75fbbcaf10277d0939c1428221085e91.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_75fbbcaf10277d0939c1428221085e91.jpg already downloaded
2026-03-27 10:41:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc3dc508-45ad-56f8-a95d-dd1d888a6fb0, identifier: AH71943
2026-03-27 10:41:43 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 10522 | hits on page: 40
2026-03-27 10:41:43 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-27 10:41:43 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL51386%27 HTTP/1.1" 200 None
2026-03-27 10:41:43 [auto1.de] INFO: Scrape type for AL51386: 2
2026-03-27 10:41:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 693c97e2-ba08-537b-9fac-d5f53d4e4fca with identifier: AL51386
2026-03-27 10:41:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 693c97e2-ba08-537b-9fac-d5f53d4e4fca with scrape type 2
2026-03-27 10:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 693c97e2-ba08-537b-9fac-d5f53d4e4fca with scrape type 2
2026-03-27 10:41:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 693c97e2-ba08-537b-9fac-d5f53d4e4fca, identifier: AL51386
2026-03-27 10:41:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc3dc508-45ad-56f8-a95d-dd1d888a6fb0 with identifier: AH71943
2026-03-27 10:41:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc3dc508-45ad-56f8-a95d-dd1d888a6fb0 with identifier: AH71943
2026-03-27 10:41:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc3dc508-45ad-56f8-a95d-dd1d888a6fb0 with identifier: AH71943 to the API
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AH71943>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:28:36Z',
'fuel_type': 'diesel',
'id': 'cc3dc508-45ad-56f8-a95d-dd1d888a6fb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH71943',
'listing': 'auction',
'location': 'DE, Ketzin',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 172178,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_33622cfe4ffdc47585872f8fdcd3b6e6.jpg',
'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_9f060f8cbab6496f65eb3fd08d764a4b.jpg',
'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_906bb1a0b6447a8e5dbeec7ca6b771b6.jpg',
'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_bfef95f08ef0244bc005306aeea8cd05.jpg',
'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_0602c2865891a497af4ab43d9e67d801.jpg',
'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_6143a33abdcd88be33a413aff1c7ae8e.jpg',
'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_b38b4ba01b46f9681d2ac522d8e68694.jpg',
'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_0f1ef07ee8c7d21ed4e9398aefcc754c.jpg',
'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_72af9faa0eb882cefb97065f0b9bdd5c.jpg',
'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_75fbbcaf10277d0939c1428221085e91.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3dc508-45ad-56f8-a95d-dd1d888a6fb0/cc3dc508-45ad-56f8-a95d-dd1d888a6fb0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110635,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_33622cfe4ffdc47585872f8fdcd3b6e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3dc508-45ad-56f8-a95d-dd1d888a6fb0/cc3dc508-45ad-56f8-a95d-dd1d888a6fb0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3641442,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_9f060f8cbab6496f65eb3fd08d764a4b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3dc508-45ad-56f8-a95d-dd1d888a6fb0/cc3dc508-45ad-56f8-a95d-dd1d888a6fb0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_906bb1a0b6447a8e5dbeec7ca6b771b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3dc508-45ad-56f8-a95d-dd1d888a6fb0/cc3dc508-45ad-56f8-a95d-dd1d888a6fb0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2818256,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_bfef95f08ef0244bc005306aeea8cd05.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3dc508-45ad-56f8-a95d-dd1d888a6fb0/cc3dc508-45ad-56f8-a95d-dd1d888a6fb0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96558,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_0602c2865891a497af4ab43d9e67d801.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3dc508-45ad-56f8-a95d-dd1d888a6fb0/cc3dc508-45ad-56f8-a95d-dd1d888a6fb0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_6143a33abdcd88be33a413aff1c7ae8e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3dc508-45ad-56f8-a95d-dd1d888a6fb0/cc3dc508-45ad-56f8-a95d-dd1d888a6fb0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2883252,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_b38b4ba01b46f9681d2ac522d8e68694.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3dc508-45ad-56f8-a95d-dd1d888a6fb0/cc3dc508-45ad-56f8-a95d-dd1d888a6fb0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3039497,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_0f1ef07ee8c7d21ed4e9398aefcc754c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3dc508-45ad-56f8-a95d-dd1d888a6fb0/cc3dc508-45ad-56f8-a95d-dd1d888a6fb0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3208898,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_72af9faa0eb882cefb97065f0b9bdd5c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc3dc508-45ad-56f8-a95d-dd1d888a6fb0/cc3dc508-45ad-56f8-a95d-dd1d888a6fb0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3294193,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/de/44de58b49a9df6a244a2ad96110e491a/pa/AH71943_75fbbcaf10277d0939c1428221085e91.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-10-25',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI RS',
'transmission': 'automatic',
'trim': 'RS',
'year': 2015}
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH71943%27 HTTP/1.1" 200 None
2026-03-27 10:41:43 [auto1.de] INFO: Saving data for AH71943: {'created_time': 1774608103.724049, 'last_price_update_time': 1774608103.724061, 'auction_closing_time': 1774715316.0}
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH71943') HTTP/1.1" 204 0
2026-03-27 10:41:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 693c97e2-ba08-537b-9fac-d5f53d4e4fca with identifier: AL51386
2026-03-27 10:41:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 693c97e2-ba08-537b-9fac-d5f53d4e4fca with identifier: AL51386
2026-03-27 10:41:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 693c97e2-ba08-537b-9fac-d5f53d4e4fca with identifier: AL51386 to the API
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-28T16:27:27Z',
'fuel_type': 'diesel',
'id': '693c97e2-ba08-537b-9fac-d5f53d4e4fca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL51386',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 109660,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-31',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2019}
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL51386%27 HTTP/1.1" 200 None
2026-03-27 10:41:44 [auto1.de] INFO: Saving data for AL51386: {'auction_closing_time': 1774715247.0, 'created_time': 1773688491.508294, 'last_price_update_time': 1774608104.132996}
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL51386') HTTP/1.1" 204 0
2026-03-27 10:41:44 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-27 10:41:44 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV26342%27 HTTP/1.1" 200 None
2026-03-27 10:41:44 [auto1.de] INFO: Scrape type for FV26342: 2
2026-03-27 10:41:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1be89d9f-5d60-5d7a-8895-4cb06c51f066 with identifier: FV26342
2026-03-27 10:41:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1be89d9f-5d60-5d7a-8895-4cb06c51f066 with scrape type 2
2026-03-27 10:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1be89d9f-5d60-5d7a-8895-4cb06c51f066 with scrape type 2
2026-03-27 10:41:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1be89d9f-5d60-5d7a-8895-4cb06c51f066, identifier: FV26342
2026-03-27 10:41:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:44 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW77657%27 HTTP/1.1" 200 None
2026-03-27 10:41:44 [auto1.de] INFO: Scrape type for BW77657: 2
2026-03-27 10:41:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43174215-e98c-5c0d-8275-4abbaf9d486a with identifier: BW77657
2026-03-27 10:41:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43174215-e98c-5c0d-8275-4abbaf9d486a with scrape type 2
2026-03-27 10:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43174215-e98c-5c0d-8275-4abbaf9d486a with scrape type 2
2026-03-27 10:41:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43174215-e98c-5c0d-8275-4abbaf9d486a, identifier: BW77657
2026-03-27 10:41:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1be89d9f-5d60-5d7a-8895-4cb06c51f066 with identifier: FV26342
2026-03-27 10:41:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1be89d9f-5d60-5d7a-8895-4cb06c51f066 with identifier: FV26342
2026-03-27 10:41:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1be89d9f-5d60-5d7a-8895-4cb06c51f066 with identifier: FV26342 to the API
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 77,
'expiration_date': '2026-03-28T16:32:37Z',
'fuel_type': 'diesel',
'id': '1be89d9f-5d60-5d7a-8895-4cb06c51f066',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV26342',
'listing': 'auction',
'make': 'Ford',
'model': 'Ranger',
'odometer': 190760,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-06-12',
'seller_name': None,
'title': 'Ford Ranger 2.5 Diesel Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2003}
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV26342%27 HTTP/1.1" 200 None
2026-03-27 10:41:44 [auto1.de] INFO: Saving data for FV26342: {'auction_closing_time': 1774715557.0, 'created_time': 1773830756.372274, 'last_price_update_time': 1774608104.733253}
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV26342') HTTP/1.1" 204 0
2026-03-27 10:41:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43174215-e98c-5c0d-8275-4abbaf9d486a with identifier: BW77657
2026-03-27 10:41:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43174215-e98c-5c0d-8275-4abbaf9d486a with identifier: BW77657
2026-03-27 10:41:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43174215-e98c-5c0d-8275-4abbaf9d486a with identifier: BW77657 to the API
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:43:27Z',
'fuel_type': 'diesel',
'id': '43174215-e98c-5c0d-8275-4abbaf9d486a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW77657',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 109924,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-24',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion',
'transmission': 'automatic',
'trim': 'GTD BlueMotion',
'year': 2019}
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW77657%27 HTTP/1.1" 200 None
2026-03-27 10:41:45 [auto1.de] INFO: Saving data for BW77657: {'auction_closing_time': 1774716207.0, 'created_time': 1773830855.84561, 'last_price_update_time': 1774608105.086326}
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW77657') HTTP/1.1" 204 0
2026-03-27 10:41:45 [auto1.de] INFO: Found listing with ID: PK01210
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK01210%27 HTTP/1.1" 200 None
2026-03-27 10:41:45 [auto1.de] INFO: Scrape type for PK01210: 1
2026-03-27 10:41:45 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-27 10:41:45 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12001%27 HTTP/1.1" 200 None
2026-03-27 10:41:45 [auto1.de] INFO: Scrape type for LK12001: 2
2026-03-27 10:41:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aa64b42-65e4-5664-abfa-80a51e1d7c72 with identifier: LK12001
2026-03-27 10:41:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aa64b42-65e4-5664-abfa-80a51e1d7c72 with scrape type 2
2026-03-27 10:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4aa64b42-65e4-5664-abfa-80a51e1d7c72 with scrape type 2
2026-03-27 10:41:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4aa64b42-65e4-5664-abfa-80a51e1d7c72, identifier: LK12001
2026-03-27 10:41:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4aa64b42-65e4-5664-abfa-80a51e1d7c72 with identifier: LK12001
2026-03-27 10:41:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4aa64b42-65e4-5664-abfa-80a51e1d7c72 with identifier: LK12001
2026-03-27 10:41:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4aa64b42-65e4-5664-abfa-80a51e1d7c72 with identifier: LK12001 to the API
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-28T16:49:56Z',
'fuel_type': 'petrol',
'id': '4aa64b42-65e4-5664-abfa-80a51e1d7c72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK12001',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 127275,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-22',
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2016}
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12001%27 HTTP/1.1" 200 None
2026-03-27 10:41:45 [auto1.de] INFO: Saving data for LK12001: {'auction_closing_time': 1774716596.0, 'created_time': 1773775653.956429, 'last_price_update_time': 1774608105.615242}
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK12001') HTTP/1.1" 204 0
2026-03-27 10:41:45 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL84965%27 HTTP/1.1" 200 None
2026-03-27 10:41:45 [auto1.de] INFO: Scrape type for BL84965: 2
2026-03-27 10:41:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4841b8a7-b30d-5dcf-bb3d-7925f921ee97 with identifier: BL84965
2026-03-27 10:41:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4841b8a7-b30d-5dcf-bb3d-7925f921ee97 with scrape type 2
2026-03-27 10:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4841b8a7-b30d-5dcf-bb3d-7925f921ee97 with scrape type 2
2026-03-27 10:41:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4841b8a7-b30d-5dcf-bb3d-7925f921ee97, identifier: BL84965
2026-03-27 10:41:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4841b8a7-b30d-5dcf-bb3d-7925f921ee97 with identifier: BL84965
2026-03-27 10:41:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4841b8a7-b30d-5dcf-bb3d-7925f921ee97 with identifier: BL84965
2026-03-27 10:41:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4841b8a7-b30d-5dcf-bb3d-7925f921ee97 with identifier: BL84965 to the API
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:30:18Z',
'fuel_type': 'petrol',
'id': '4841b8a7-b30d-5dcf-bb3d-7925f921ee97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL84965',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 90495,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-20',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2019}
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL84965%27 HTTP/1.1" 200 None
2026-03-27 10:41:46 [auto1.de] INFO: Saving data for BL84965: {'auction_closing_time': 1774715418.0, 'created_time': 1774291200.135366, 'last_price_update_time': 1774608106.113558}
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL84965') HTTP/1.1" 204 0
2026-03-27 10:41:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:46 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-27 10:41:46 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-27 10:41:46 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR72053%27 HTTP/1.1" 200 None
2026-03-27 10:41:46 [auto1.de] INFO: Scrape type for NR72053: 2
2026-03-27 10:41:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dad828b9-221a-5747-9151-5f00fb147548 with identifier: NR72053
2026-03-27 10:41:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dad828b9-221a-5747-9151-5f00fb147548 with scrape type 2
2026-03-27 10:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dad828b9-221a-5747-9151-5f00fb147548 with scrape type 2
2026-03-27 10:41:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dad828b9-221a-5747-9151-5f00fb147548, identifier: NR72053
2026-03-27 10:41:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dad828b9-221a-5747-9151-5f00fb147548 with identifier: NR72053
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=other HTTP/1.1" 200 None
2026-03-27 10:41:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:41:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dad828b9-221a-5747-9151-5f00fb147548 with identifier: NR72053
2026-03-27 10:41:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dad828b9-221a-5747-9151-5f00fb147548 with identifier: NR72053 to the API
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'other',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:27:13Z',
'fuel_type': 'diesel',
'id': 'dad828b9-221a-5747-9151-5f00fb147548',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR72053',
'listing': 'auction',
'make': 'Ford',
'model': 'Galaxy',
'odometer': 102775,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-24',
'seller_name': None,
'title': 'Ford Galaxy 2.0 TDCi EcoBlue Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2021}
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR72053%27 HTTP/1.1" 200 None
2026-03-27 10:41:46 [auto1.de] INFO: Saving data for NR72053: {'auction_closing_time': 1774715233.0, 'created_time': 1773304608.75297, 'last_price_update_time': 1774608106.824929}
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR72053') HTTP/1.1" 204 0
2026-03-27 10:41:46 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-27 10:41:46 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML06015%27 HTTP/1.1" 200 None
2026-03-27 10:41:46 [auto1.de] INFO: Scrape type for ML06015: 2
2026-03-27 10:41:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de114ebc-818a-502f-a40f-d6997410382e with identifier: ML06015
2026-03-27 10:41:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de114ebc-818a-502f-a40f-d6997410382e with scrape type 2
2026-03-27 10:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de114ebc-818a-502f-a40f-d6997410382e with scrape type 2
2026-03-27 10:41:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de114ebc-818a-502f-a40f-d6997410382e, identifier: ML06015
2026-03-27 10:41:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de114ebc-818a-502f-a40f-d6997410382e with identifier: ML06015
2026-03-27 10:41:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de114ebc-818a-502f-a40f-d6997410382e with identifier: ML06015
2026-03-27 10:41:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de114ebc-818a-502f-a40f-d6997410382e with identifier: ML06015 to the API
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:51:26Z',
'fuel_type': 'petrol',
'id': 'de114ebc-818a-502f-a40f-d6997410382e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML06015',
'listing': 'auction',
'make': 'Toyota',
'model': 'Verso-S',
'odometer': 64641,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-17',
'seller_name': None,
'title': 'Toyota Verso-S 1.33 Dual VVT-i Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2011}
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML06015%27 HTTP/1.1" 200 None
2026-03-27 10:41:47 [auto1.de] INFO: Saving data for ML06015: {'auction_closing_time': 1774716686.0, 'created_time': 1773859275.036936, 'last_price_update_time': 1774608107.434079}
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML06015') HTTP/1.1" 204 0
2026-03-27 10:41:47 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-27 10:41:47 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-27 10:41:47 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD98070%27 HTTP/1.1" 200 None
2026-03-27 10:41:47 [auto1.de] INFO: Scrape type for BD98070: 2
2026-03-27 10:41:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da481d76-a4db-5111-b8f6-98b933fae6b2 with identifier: BD98070
2026-03-27 10:41:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da481d76-a4db-5111-b8f6-98b933fae6b2 with scrape type 2
2026-03-27 10:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da481d76-a4db-5111-b8f6-98b933fae6b2 with scrape type 2
2026-03-27 10:41:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da481d76-a4db-5111-b8f6-98b933fae6b2, identifier: BD98070
2026-03-27 10:41:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da481d76-a4db-5111-b8f6-98b933fae6b2 with identifier: BD98070
2026-03-27 10:41:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da481d76-a4db-5111-b8f6-98b933fae6b2 with identifier: BD98070
2026-03-27 10:41:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da481d76-a4db-5111-b8f6-98b933fae6b2 with identifier: BD98070 to the API
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-28T16:20:09Z',
'fuel_type': 'petrol',
'id': 'da481d76-a4db-5111-b8f6-98b933fae6b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD98070',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 22905,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-27',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid T AMG Line',
'transmission': 'automatic',
'trim': 'T AMG Line',
'year': 2022}
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD98070%27 HTTP/1.1" 200 None
2026-03-27 10:41:47 [auto1.de] INFO: Saving data for BD98070: {'auction_closing_time': 1774714809.0, 'created_time': 1773428943.479344, 'last_price_update_time': 1774608107.936548}
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD98070') HTTP/1.1" 204 0
2026-03-27 10:41:47 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-27 10:41:47 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-27 10:41:47 [auto1.de] INFO: Found listing with ID: NN07588
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN07588%27 HTTP/1.1" 200 None
2026-03-27 10:41:47 [auto1.de] INFO: Scrape type for NN07588: 2
2026-03-27 10:41:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0208e04e-5c56-57ee-a5b5-476f9a4413b7 with identifier: NN07588
2026-03-27 10:41:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0208e04e-5c56-57ee-a5b5-476f9a4413b7 with scrape type 2
2026-03-27 10:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0208e04e-5c56-57ee-a5b5-476f9a4413b7 with scrape type 2
2026-03-27 10:41:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0208e04e-5c56-57ee-a5b5-476f9a4413b7, identifier: NN07588
2026-03-27 10:41:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0208e04e-5c56-57ee-a5b5-476f9a4413b7 with identifier: NN07588
2026-03-27 10:41:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0208e04e-5c56-57ee-a5b5-476f9a4413b7 with identifier: NN07588
2026-03-27 10:41:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0208e04e-5c56-57ee-a5b5-476f9a4413b7 with identifier: NN07588 to the API
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:13:49Z',
'fuel_type': 'diesel',
'id': '0208e04e-5c56-57ee-a5b5-476f9a4413b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN07588',
'listing': 'auction',
'make': 'Toyota',
'model': 'ProAce',
'odometer': 48503,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-16',
'seller_name': None,
'title': 'Toyota ProAce 2.0 D-4D L1 Kasten Meister',
'transmission': 'manual',
'trim': 'L1 Kasten Meister',
'year': 2019}
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN07588%27 HTTP/1.1" 200 None
2026-03-27 10:41:48 [auto1.de] INFO: Saving data for NN07588: {'auction_closing_time': 1774714429.0, 'created_time': 1774294685.764945, 'last_price_update_time': 1774608108.427208}
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN07588') HTTP/1.1" 204 0
2026-03-27 10:41:48 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-27 10:41:48 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-27 10:41:48 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-27 10:41:48 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL73218%27 HTTP/1.1" 200 None
2026-03-27 10:41:48 [auto1.de] INFO: Scrape type for EL73218: 2
2026-03-27 10:41:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6b366a2-ee0e-5512-87f3-35fa687c2911 with identifier: EL73218
2026-03-27 10:41:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6b366a2-ee0e-5512-87f3-35fa687c2911 with scrape type 2
2026-03-27 10:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6b366a2-ee0e-5512-87f3-35fa687c2911 with scrape type 2
2026-03-27 10:41:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6b366a2-ee0e-5512-87f3-35fa687c2911, identifier: EL73218
2026-03-27 10:41:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6b366a2-ee0e-5512-87f3-35fa687c2911 with identifier: EL73218
2026-03-27 10:41:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6b366a2-ee0e-5512-87f3-35fa687c2911 with identifier: EL73218
2026-03-27 10:41:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6b366a2-ee0e-5512-87f3-35fa687c2911 with identifier: EL73218 to the API
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-28T16:54:42Z',
'fuel_type': 'diesel',
'id': 'e6b366a2-ee0e-5512-87f3-35fa687c2911',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL73218',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 203512,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-18',
'seller_name': None,
'title': 'BMW X3 xDrive 35d',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL73218%27 HTTP/1.1" 200 None
2026-03-27 10:41:48 [auto1.de] INFO: Saving data for EL73218: {'auction_closing_time': 1774716882.0, 'created_time': 1773308230.640036, 'last_price_update_time': 1774608108.892622}
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL73218') HTTP/1.1" 204 0
2026-03-27 10:41:49 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX40120%27 HTTP/1.1" 200 None
2026-03-27 10:41:49 [auto1.de] INFO: Scrape type for JX40120: 2
2026-03-27 10:41:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c244ee9-8569-5fc0-b83f-1d9de43a67dc with identifier: JX40120
2026-03-27 10:41:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c244ee9-8569-5fc0-b83f-1d9de43a67dc with scrape type 2
2026-03-27 10:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c244ee9-8569-5fc0-b83f-1d9de43a67dc with scrape type 2
2026-03-27 10:41:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c244ee9-8569-5fc0-b83f-1d9de43a67dc, identifier: JX40120
2026-03-27 10:41:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c244ee9-8569-5fc0-b83f-1d9de43a67dc with identifier: JX40120
2026-03-27 10:41:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c244ee9-8569-5fc0-b83f-1d9de43a67dc with identifier: JX40120
2026-03-27 10:41:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c244ee9-8569-5fc0-b83f-1d9de43a67dc with identifier: JX40120 to the API
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:25:17Z',
'fuel_type': 'petrol',
'id': '0c244ee9-8569-5fc0-b83f-1d9de43a67dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX40120',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 164263,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-15',
'seller_name': None,
'title': 'Renault Twingo 1.2 Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2012}
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX40120%27 HTTP/1.1" 200 None
2026-03-27 10:41:49 [auto1.de] INFO: Saving data for JX40120: {'auction_closing_time': 1774715117.0, 'created_time': 1773776028.889085, 'last_price_update_time': 1774608109.59144}
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX40120') HTTP/1.1" 204 0
2026-03-27 10:41:49 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR95231%27 HTTP/1.1" 200 None
2026-03-27 10:41:49 [auto1.de] INFO: Scrape type for BR95231: 2
2026-03-27 10:41:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03bebd53-3ec3-5991-b70a-5d5cae425a75 with identifier: BR95231
2026-03-27 10:41:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03bebd53-3ec3-5991-b70a-5d5cae425a75 with scrape type 2
2026-03-27 10:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03bebd53-3ec3-5991-b70a-5d5cae425a75 with scrape type 2
2026-03-27 10:41:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03bebd53-3ec3-5991-b70a-5d5cae425a75, identifier: BR95231
2026-03-27 10:41:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK01210/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03bebd53-3ec3-5991-b70a-5d5cae425a75 with identifier: BR95231
2026-03-27 10:41:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03bebd53-3ec3-5991-b70a-5d5cae425a75 with identifier: BR95231
2026-03-27 10:41:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03bebd53-3ec3-5991-b70a-5d5cae425a75 with identifier: BR95231 to the API
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 271,
'expiration_date': '2026-03-28T16:45:15Z',
'fuel_type': 'petrol',
'id': '03bebd53-3ec3-5991-b70a-5d5cae425a75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR95231',
'listing': 'auction',
'make': 'Jeep',
'model': 'Wrangler Unlimited',
'odometer': 69320,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-15',
'seller_name': None,
'title': 'Jeep Wrangler Unlimited 2.0 TGDi Sahara',
'transmission': 'automatic',
'trim': 'Sahara',
'year': 2020}
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR95231%27 HTTP/1.1" 200 None
2026-03-27 10:41:50 [auto1.de] INFO: Saving data for BR95231: {'auction_closing_time': 1774716315.0, 'created_time': 1774292812.641651, 'last_price_update_time': 1774608110.134962}
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR95231') HTTP/1.1" 204 0
2026-03-27 10:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:50 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-27 10:41:50 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-27 10:41:50 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-27 10:41:50 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT56964%27 HTTP/1.1" 200 None
2026-03-27 10:41:50 [auto1.de] INFO: Scrape type for AT56964: 2
2026-03-27 10:41:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c175e3b6-6fce-521b-92b1-c5b5392ae91e with identifier: AT56964
2026-03-27 10:41:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c175e3b6-6fce-521b-92b1-c5b5392ae91e with scrape type 2
2026-03-27 10:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c175e3b6-6fce-521b-92b1-c5b5392ae91e with scrape type 2
2026-03-27 10:41:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c175e3b6-6fce-521b-92b1-c5b5392ae91e, identifier: AT56964
2026-03-27 10:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG23349> (referer: https://www.auto1.com/v1/car-details-view/DG23349/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c175e3b6-6fce-521b-92b1-c5b5392ae91e with identifier: AT56964
2026-03-27 10:41:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c175e3b6-6fce-521b-92b1-c5b5392ae91e with identifier: AT56964
2026-03-27 10:41:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c175e3b6-6fce-521b-92b1-c5b5392ae91e with identifier: AT56964 to the API
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-28T16:02:21Z',
'fuel_type': 'diesel',
'id': 'c175e3b6-6fce-521b-92b1-c5b5392ae91e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT56964',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 185497,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-22',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2017}
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT56964%27 HTTP/1.1" 200 None
2026-03-27 10:41:50 [auto1.de] INFO: Saving data for AT56964: {'auction_closing_time': 1774713741.0, 'created_time': 1774031622.858241, 'last_price_update_time': 1774608110.654582}
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT56964') HTTP/1.1" 204 0
2026-03-27 10:41:50 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC03067%27 HTTP/1.1" 200 None
2026-03-27 10:41:50 [auto1.de] INFO: Scrape type for GC03067: 2
2026-03-27 10:41:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dde58bb-a540-5568-9bfc-591bcadb7d5f with identifier: GC03067
2026-03-27 10:41:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dde58bb-a540-5568-9bfc-591bcadb7d5f with scrape type 2
2026-03-27 10:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dde58bb-a540-5568-9bfc-591bcadb7d5f with scrape type 2
2026-03-27 10:41:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2dde58bb-a540-5568-9bfc-591bcadb7d5f, identifier: GC03067
2026-03-27 10:41:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2dde58bb-a540-5568-9bfc-591bcadb7d5f with identifier: GC03067
2026-03-27 10:41:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2dde58bb-a540-5568-9bfc-591bcadb7d5f with identifier: GC03067
2026-03-27 10:41:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2dde58bb-a540-5568-9bfc-591bcadb7d5f with identifier: GC03067 to the API
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:39:48Z',
'fuel_type': 'diesel',
'id': '2dde58bb-a540-5568-9bfc-591bcadb7d5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC03067',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 196755,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-10',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Laurin & Klement',
'transmission': 'automatic',
'trim': 'Laurin & Klement',
'year': 2021}
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC03067%27 HTTP/1.1" 200 None
2026-03-27 10:41:51 [auto1.de] INFO: Saving data for GC03067: {'auction_closing_time': 1774715988.0, 'created_time': 1773859347.042169, 'last_price_update_time': 1774608111.106721}
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC03067') HTTP/1.1" 204 0
2026-03-27 10:41:51 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 10523 | hits on page: 40
2026-03-27 10:41:51 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-27 10:41:51 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW85438%27 HTTP/1.1" 200 None
2026-03-27 10:41:51 [auto1.de] INFO: Scrape type for XW85438: 2
2026-03-27 10:41:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed233fae-2093-5187-848c-918828d3cf8d with identifier: XW85438
2026-03-27 10:41:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed233fae-2093-5187-848c-918828d3cf8d with scrape type 2
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed233fae-2093-5187-848c-918828d3cf8d with scrape type 2
2026-03-27 10:41:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed233fae-2093-5187-848c-918828d3cf8d, identifier: XW85438
2026-03-27 10:41:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed233fae-2093-5187-848c-918828d3cf8d with identifier: XW85438
2026-03-27 10:41:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed233fae-2093-5187-848c-918828d3cf8d with identifier: XW85438
2026-03-27 10:41:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed233fae-2093-5187-848c-918828d3cf8d with identifier: XW85438 to the API
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:57:20Z',
'fuel_type': 'diesel',
'id': 'ed233fae-2093-5187-848c-918828d3cf8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW85438',
'listing': 'auction',
'make': 'Toyota',
'model': 'Avensis',
'odometer': 210445,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-04-30',
'seller_name': None,
'title': 'Toyota Avensis 2.2 D-4D D-Cat Executive Liftback',
'transmission': 'manual',
'trim': 'D-Cat Executive Liftback',
'year': 2007}
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW85438%27 HTTP/1.1" 200 None
2026-03-27 10:41:51 [auto1.de] INFO: Saving data for XW85438: {'auction_closing_time': 1774717040.0, 'created_time': 1774294153.149817, 'last_price_update_time': 1774608111.691432}
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW85438') HTTP/1.1" 204 0
2026-03-27 10:41:51 [auto1.de] INFO: Found listing with ID: RY40991
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY40991%27 HTTP/1.1" 200 None
2026-03-27 10:41:51 [auto1.de] INFO: Scrape type for RY40991: 2
2026-03-27 10:41:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9768452-3008-58e6-8114-16116dd00589 with identifier: RY40991
2026-03-27 10:41:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9768452-3008-58e6-8114-16116dd00589 with scrape type 2
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9768452-3008-58e6-8114-16116dd00589 with scrape type 2
2026-03-27 10:41:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9768452-3008-58e6-8114-16116dd00589, identifier: RY40991
2026-03-27 10:41:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b13032e9-8a0b-5300-95cc-42c4ff0eec6d with identifier: DG23349
2026-03-27 10:41:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b13032e9-8a0b-5300-95cc-42c4ff0eec6d with scrape type 1
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b13032e9-8a0b-5300-95cc-42c4ff0eec6d
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F54%252Fec54c1d12d85da4ba505911a2806ecd3%252Fpa%252FDG23349_f0e68d318054658eb07d6e0017cf8e87.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_f0e68d318054658eb07d6e0017cf8e87.jpg already downloaded
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F54%252Fec54c1d12d85da4ba505911a2806ecd3%252Fpa%252FDG23349_a6277be1beb6dc3dc4135386e1058084.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_a6277be1beb6dc3dc4135386e1058084.jpg already downloaded
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F54%252Fec54c1d12d85da4ba505911a2806ecd3%252Fpa%252FDG23349_0faa7c507fc7178e4ee771be5ccff85e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_0faa7c507fc7178e4ee771be5ccff85e.jpg already downloaded
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F54%252Fec54c1d12d85da4ba505911a2806ecd3%252Fpa%252FDG23349_07ffa73e72ffcb921ef9ea39f699b45c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_07ffa73e72ffcb921ef9ea39f699b45c.jpg already downloaded
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F54%252Fec54c1d12d85da4ba505911a2806ecd3%252Fpa%252FDG23349_e81f67493b9d4e1c7cf847b4571865cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_e81f67493b9d4e1c7cf847b4571865cf.jpg already downloaded
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F54%252Fec54c1d12d85da4ba505911a2806ecd3%252Fpa%252FDG23349_cce012f8274c590b7ce0ed3307aa3d9c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_cce012f8274c590b7ce0ed3307aa3d9c.jpg already downloaded
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F54%252Fec54c1d12d85da4ba505911a2806ecd3%252Fpa%252FDG23349_77d09ac56c201f59f0d689aad65206bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_77d09ac56c201f59f0d689aad65206bd.jpg already downloaded
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F54%252Fec54c1d12d85da4ba505911a2806ecd3%252Fpa%252FDG23349_73b0bd0e9ba9dee655b3c2cdfa584955.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_73b0bd0e9ba9dee655b3c2cdfa584955.jpg already downloaded
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F54%252Fec54c1d12d85da4ba505911a2806ecd3%252Fpa%252FDG23349_150174bf848a53b5e74be4c1b2072a2a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_150174bf848a53b5e74be4c1b2072a2a.jpg already downloaded
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F54%252Fec54c1d12d85da4ba505911a2806ecd3%252Fpa%252FDG23349_8509f267e81fa58a8bc9c47434edc718.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_8509f267e81fa58a8bc9c47434edc718.jpg already downloaded
2026-03-27 10:41:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b13032e9-8a0b-5300-95cc-42c4ff0eec6d, identifier: DG23349
2026-03-27 10:41:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:52 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-27 10:41:52 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-27 10:41:52 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-27 10:41:52 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-27 10:41:52 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV07676%27 HTTP/1.1" 200 None
2026-03-27 10:41:52 [auto1.de] INFO: Scrape type for EV07676: 2
2026-03-27 10:41:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f214e540-ee7b-5b55-b8b9-18af76159a0e with identifier: EV07676
2026-03-27 10:41:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f214e540-ee7b-5b55-b8b9-18af76159a0e with scrape type 2
2026-03-27 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f214e540-ee7b-5b55-b8b9-18af76159a0e with scrape type 2
2026-03-27 10:41:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f214e540-ee7b-5b55-b8b9-18af76159a0e, identifier: EV07676
2026-03-27 10:41:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9768452-3008-58e6-8114-16116dd00589 with identifier: RY40991
2026-03-27 10:41:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9768452-3008-58e6-8114-16116dd00589 with identifier: RY40991
2026-03-27 10:41:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9768452-3008-58e6-8114-16116dd00589 with identifier: RY40991 to the API
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:56:41Z',
'fuel_type': 'petrol',
'id': 'f9768452-3008-58e6-8114-16116dd00589',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY40991',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 234023,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-02-01',
'seller_name': None,
'title': 'Volkswagen Golf V 1.6 Trendline',
'transmission': 'automatic',
'trim': 'Trendline',
'year': 2006}
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY40991%27 HTTP/1.1" 200 None
2026-03-27 10:41:52 [auto1.de] INFO: Saving data for RY40991: {'auction_closing_time': 1774717001.0, 'created_time': 1774330269.300995, 'last_price_update_time': 1774608112.555302}
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY40991') HTTP/1.1" 204 0
2026-03-27 10:41:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b13032e9-8a0b-5300-95cc-42c4ff0eec6d with identifier: DG23349
2026-03-27 10:41:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b13032e9-8a0b-5300-95cc-42c4ff0eec6d with identifier: DG23349
2026-03-27 10:41:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b13032e9-8a0b-5300-95cc-42c4ff0eec6d with identifier: DG23349 to the API
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DG23349>
{'auction_title': '',
'c_o_2_emission_value': 168,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 128,
'expiration_date': '2026-03-28T16:30:48Z',
'fuel_type': 'diesel',
'id': 'b13032e9-8a0b-5300-95cc-42c4ff0eec6d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG23349',
'listing': 'auction',
'location': 'DE, Schkopau (OT Rassnitz)',
'make': 'Toyota',
'model': 'ProAce',
'odometer': 84027,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_f0e68d318054658eb07d6e0017cf8e87.jpg',
'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_a6277be1beb6dc3dc4135386e1058084.jpg',
'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_0faa7c507fc7178e4ee771be5ccff85e.jpg',
'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_07ffa73e72ffcb921ef9ea39f699b45c.jpg',
'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_e81f67493b9d4e1c7cf847b4571865cf.jpg',
'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_cce012f8274c590b7ce0ed3307aa3d9c.jpg',
'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_77d09ac56c201f59f0d689aad65206bd.jpg',
'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_73b0bd0e9ba9dee655b3c2cdfa584955.jpg',
'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_150174bf848a53b5e74be4c1b2072a2a.jpg',
'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_8509f267e81fa58a8bc9c47434edc718.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b13032e9-8a0b-5300-95cc-42c4ff0eec6d/b13032e9-8a0b-5300-95cc-42c4ff0eec6d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83314,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_f0e68d318054658eb07d6e0017cf8e87.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b13032e9-8a0b-5300-95cc-42c4ff0eec6d/b13032e9-8a0b-5300-95cc-42c4ff0eec6d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76784,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_a6277be1beb6dc3dc4135386e1058084.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b13032e9-8a0b-5300-95cc-42c4ff0eec6d/b13032e9-8a0b-5300-95cc-42c4ff0eec6d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71684,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_0faa7c507fc7178e4ee771be5ccff85e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b13032e9-8a0b-5300-95cc-42c4ff0eec6d/b13032e9-8a0b-5300-95cc-42c4ff0eec6d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_07ffa73e72ffcb921ef9ea39f699b45c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b13032e9-8a0b-5300-95cc-42c4ff0eec6d/b13032e9-8a0b-5300-95cc-42c4ff0eec6d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62573,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_e81f67493b9d4e1c7cf847b4571865cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b13032e9-8a0b-5300-95cc-42c4ff0eec6d/b13032e9-8a0b-5300-95cc-42c4ff0eec6d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75342,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_cce012f8274c590b7ce0ed3307aa3d9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b13032e9-8a0b-5300-95cc-42c4ff0eec6d/b13032e9-8a0b-5300-95cc-42c4ff0eec6d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_77d09ac56c201f59f0d689aad65206bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b13032e9-8a0b-5300-95cc-42c4ff0eec6d/b13032e9-8a0b-5300-95cc-42c4ff0eec6d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_73b0bd0e9ba9dee655b3c2cdfa584955.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b13032e9-8a0b-5300-95cc-42c4ff0eec6d/b13032e9-8a0b-5300-95cc-42c4ff0eec6d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_150174bf848a53b5e74be4c1b2072a2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b13032e9-8a0b-5300-95cc-42c4ff0eec6d/b13032e9-8a0b-5300-95cc-42c4ff0eec6d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71066,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgec/54/ec54c1d12d85da4ba505911a2806ecd3/pa/DG23349_8509f267e81fa58a8bc9c47434edc718.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-10-30',
'seats_number': 3,
'seller_name': None,
'title': 'Toyota ProAce 2.0 D-4D L2H1 Kasten verglast Life',
'transmission': 'manual',
'trim': 'L2H1 Kasten verglast Life',
'year': 2014}
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23349%27 HTTP/1.1" 200 None
2026-03-27 10:41:53 [auto1.de] INFO: Saving data for DG23349: {'created_time': 1774608113.046911, 'last_price_update_time': 1774608113.046927, 'auction_closing_time': 1774715448.0}
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG23349') HTTP/1.1" 204 0
2026-03-27 10:41:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f214e540-ee7b-5b55-b8b9-18af76159a0e with identifier: EV07676
2026-03-27 10:41:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f214e540-ee7b-5b55-b8b9-18af76159a0e with identifier: EV07676
2026-03-27 10:41:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f214e540-ee7b-5b55-b8b9-18af76159a0e with identifier: EV07676 to the API
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 330,
'expiration_date': '2026-03-28T16:36:54Z',
'fuel_type': 'diesel',
'id': 'f214e540-ee7b-5b55-b8b9-18af76159a0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV07676',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 146263,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-24',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 400 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2021}
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV07676%27 HTTP/1.1" 200 None
2026-03-27 10:41:53 [auto1.de] INFO: Saving data for EV07676: {'auction_closing_time': 1774715814.0, 'created_time': 1773859666.558048, 'last_price_update_time': 1774608113.592609}
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV07676') HTTP/1.1" 204 0
2026-03-27 10:41:53 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH81029%27 HTTP/1.1" 200 None
2026-03-27 10:41:53 [auto1.de] INFO: Scrape type for YH81029: 2
2026-03-27 10:41:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcf3a7a7-47d6-538c-aa4a-bbc0b712916d with identifier: YH81029
2026-03-27 10:41:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcf3a7a7-47d6-538c-aa4a-bbc0b712916d with scrape type 2
2026-03-27 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcf3a7a7-47d6-538c-aa4a-bbc0b712916d with scrape type 2
2026-03-27 10:41:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcf3a7a7-47d6-538c-aa4a-bbc0b712916d, identifier: YH81029
2026-03-27 10:41:53 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97689%27 HTTP/1.1" 200 None
2026-03-27 10:41:53 [auto1.de] INFO: Scrape type for SD97689: 2
2026-03-27 10:41:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44843c13-7251-5281-b3f8-96ec5eb8a6fa with identifier: SD97689
2026-03-27 10:41:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44843c13-7251-5281-b3f8-96ec5eb8a6fa with scrape type 2
2026-03-27 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44843c13-7251-5281-b3f8-96ec5eb8a6fa with scrape type 2
2026-03-27 10:41:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44843c13-7251-5281-b3f8-96ec5eb8a6fa, identifier: SD97689
2026-03-27 10:41:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcf3a7a7-47d6-538c-aa4a-bbc0b712916d with identifier: YH81029
2026-03-27 10:41:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcf3a7a7-47d6-538c-aa4a-bbc0b712916d with identifier: YH81029
2026-03-27 10:41:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcf3a7a7-47d6-538c-aa4a-bbc0b712916d with identifier: YH81029 to the API
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:53:35Z',
'fuel_type': 'diesel',
'id': 'fcf3a7a7-47d6-538c-aa4a-bbc0b712916d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH81029',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLS-Klasse',
'odometer': 343530,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-10',
'seller_name': None,
'title': 'Mercedes-Benz CLS-Klasse CLS 250 d Shooting Brake 4Matic BlueTEC',
'transmission': 'automatic',
'trim': '4Matic BlueTEC',
'year': 2015}
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH81029%27 HTTP/1.1" 200 None
2026-03-27 10:41:54 [auto1.de] INFO: Saving data for YH81029: {'auction_closing_time': 1774716815.0, 'created_time': 1774330253.387537, 'last_price_update_time': 1774608114.177556}
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH81029') HTTP/1.1" 204 0
2026-03-27 10:41:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44843c13-7251-5281-b3f8-96ec5eb8a6fa with identifier: SD97689
2026-03-27 10:41:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44843c13-7251-5281-b3f8-96ec5eb8a6fa with identifier: SD97689
2026-03-27 10:41:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44843c13-7251-5281-b3f8-96ec5eb8a6fa with identifier: SD97689 to the API
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:53:08Z',
'fuel_type': 'petrol',
'id': '44843c13-7251-5281-b3f8-96ec5eb8a6fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD97689',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 62906,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-22',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2015}
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97689%27 HTTP/1.1" 200 None
2026-03-27 10:41:54 [auto1.de] INFO: Saving data for SD97689: {'auction_closing_time': 1774716788.0, 'created_time': 1773400448.859228, 'last_price_update_time': 1774608114.553179}
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD97689') HTTP/1.1" 204 0
2026-03-27 10:41:54 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03124%27 HTTP/1.1" 200 None
2026-03-27 10:41:54 [auto1.de] INFO: Scrape type for TB03124: 2
2026-03-27 10:41:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 027adde0-4e65-5bb3-bc37-49fecac89140 with identifier: TB03124
2026-03-27 10:41:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 027adde0-4e65-5bb3-bc37-49fecac89140 with scrape type 2
2026-03-27 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 027adde0-4e65-5bb3-bc37-49fecac89140 with scrape type 2
2026-03-27 10:41:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 027adde0-4e65-5bb3-bc37-49fecac89140, identifier: TB03124
2026-03-27 10:41:54 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-27 10:41:54 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-27 10:41:54 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN78353%27 HTTP/1.1" 200 None
2026-03-27 10:41:54 [auto1.de] INFO: Scrape type for PN78353: 2
2026-03-27 10:41:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2882ead9-6548-5a70-b55a-27c3ca669719 with identifier: PN78353
2026-03-27 10:41:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2882ead9-6548-5a70-b55a-27c3ca669719 with scrape type 2
2026-03-27 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2882ead9-6548-5a70-b55a-27c3ca669719 with scrape type 2
2026-03-27 10:41:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2882ead9-6548-5a70-b55a-27c3ca669719, identifier: PN78353
2026-03-27 10:41:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 027adde0-4e65-5bb3-bc37-49fecac89140 with identifier: TB03124
2026-03-27 10:41:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 027adde0-4e65-5bb3-bc37-49fecac89140 with identifier: TB03124
2026-03-27 10:41:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 027adde0-4e65-5bb3-bc37-49fecac89140 with identifier: TB03124 to the API
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:15:39Z',
'fuel_type': 'petrol',
'id': '027adde0-4e65-5bb3-bc37-49fecac89140',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB03124',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 37123,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-29',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2021}
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03124%27 HTTP/1.1" 200 None
2026-03-27 10:41:55 [auto1.de] INFO: Saving data for TB03124: {'auction_closing_time': 1774714539.0, 'created_time': 1773400890.847966, 'last_price_update_time': 1774608115.372159}
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB03124') HTTP/1.1" 204 0
2026-03-27 10:41:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2882ead9-6548-5a70-b55a-27c3ca669719 with identifier: PN78353
2026-03-27 10:41:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2882ead9-6548-5a70-b55a-27c3ca669719 with identifier: PN78353
2026-03-27 10:41:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2882ead9-6548-5a70-b55a-27c3ca669719 with identifier: PN78353 to the API
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-28T16:22:28Z',
'fuel_type': 'diesel',
'id': '2882ead9-6548-5a70-b55a-27c3ca669719',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN78353',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 240723,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-24',
'seller_name': None,
'title': 'BMW 5er 525d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2013}
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN78353%27 HTTP/1.1" 200 None
2026-03-27 10:41:55 [auto1.de] INFO: Saving data for PN78353: {'auction_closing_time': 1774714948.0, 'created_time': 1772542908.176571, 'last_price_update_time': 1774608115.863922}
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN78353') HTTP/1.1" 204 0
2026-03-27 10:41:55 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-27 10:41:55 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-27 10:41:55 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG82377%27 HTTP/1.1" 200 None
2026-03-27 10:41:55 [auto1.de] INFO: Scrape type for JG82377: 2
2026-03-27 10:41:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8782c6e8-24fc-5985-b70a-74fd2779b13b with identifier: JG82377
2026-03-27 10:41:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8782c6e8-24fc-5985-b70a-74fd2779b13b with scrape type 2
2026-03-27 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8782c6e8-24fc-5985-b70a-74fd2779b13b with scrape type 2
2026-03-27 10:41:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8782c6e8-24fc-5985-b70a-74fd2779b13b, identifier: JG82377
2026-03-27 10:41:56 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-27 10:41:56 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG37948%27 HTTP/1.1" 200 None
2026-03-27 10:41:56 [auto1.de] INFO: Scrape type for NG37948: 2
2026-03-27 10:41:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f9add73-e214-5282-9ef7-3caf8e81af99 with identifier: NG37948
2026-03-27 10:41:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f9add73-e214-5282-9ef7-3caf8e81af99 with scrape type 2
2026-03-27 10:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f9add73-e214-5282-9ef7-3caf8e81af99 with scrape type 2
2026-03-27 10:41:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f9add73-e214-5282-9ef7-3caf8e81af99, identifier: NG37948
2026-03-27 10:41:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8782c6e8-24fc-5985-b70a-74fd2779b13b with identifier: JG82377
2026-03-27 10:41:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8782c6e8-24fc-5985-b70a-74fd2779b13b with identifier: JG82377
2026-03-27 10:41:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8782c6e8-24fc-5985-b70a-74fd2779b13b with identifier: JG82377 to the API
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-28T16:11:47Z',
'fuel_type': 'petrol',
'id': '8782c6e8-24fc-5985-b70a-74fd2779b13b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG82377',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 252141,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-06-10',
'seller_name': None,
'title': 'Volkswagen Golf V 1.4 Tour',
'transmission': 'manual',
'trim': 'Tour',
'year': 2007}
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG82377%27 HTTP/1.1" 200 None
2026-03-27 10:41:56 [auto1.de] INFO: Saving data for JG82377: {'auction_closing_time': 1774714307.0, 'created_time': 1773340715.593671, 'last_price_update_time': 1774608116.458426}
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG82377') HTTP/1.1" 204 0
2026-03-27 10:41:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f9add73-e214-5282-9ef7-3caf8e81af99 with identifier: NG37948
2026-03-27 10:41:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f9add73-e214-5282-9ef7-3caf8e81af99 with identifier: NG37948
2026-03-27 10:41:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f9add73-e214-5282-9ef7-3caf8e81af99 with identifier: NG37948 to the API
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:01:03Z',
'fuel_type': 'petrol',
'id': '5f9add73-e214-5282-9ef7-3caf8e81af99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG37948',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 33603,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-17',
'seller_name': None,
'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
'transmission': 'automatic',
'trim': 'Micro Hybrid Drive passion',
'year': 2014}
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG37948%27 HTTP/1.1" 200 None
2026-03-27 10:41:56 [auto1.de] INFO: Saving data for NG37948: {'auction_closing_time': 1774713663.0, 'created_time': 1773686200.167837, 'last_price_update_time': 1774608116.977826}
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG37948') HTTP/1.1" 204 0
2026-03-27 10:41:57 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF15442%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [auto1.de] INFO: Scrape type for LF15442: 2
2026-03-27 10:41:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d8a1e38-17c9-54b9-8f4c-3c3262128163 with identifier: LF15442
2026-03-27 10:41:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d8a1e38-17c9-54b9-8f4c-3c3262128163 with scrape type 2
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d8a1e38-17c9-54b9-8f4c-3c3262128163 with scrape type 2
2026-03-27 10:41:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d8a1e38-17c9-54b9-8f4c-3c3262128163, identifier: LF15442
2026-03-27 10:41:57 [auto1.de] INFO: Found listing with ID: RY40991
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY40991%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [auto1.de] INFO: Scrape type for RY40991: 0
2026-03-27 10:41:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d8a1e38-17c9-54b9-8f4c-3c3262128163 with identifier: LF15442
2026-03-27 10:41:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d8a1e38-17c9-54b9-8f4c-3c3262128163 with identifier: LF15442
2026-03-27 10:41:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d8a1e38-17c9-54b9-8f4c-3c3262128163 with identifier: LF15442 to the API
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:56:25Z',
'fuel_type': 'diesel',
'id': '9d8a1e38-17c9-54b9-8f4c-3c3262128163',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF15442',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 201291,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-02',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Highline BlueMotion Tech',
'year': 2016}
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF15442%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [auto1.de] INFO: Saving data for LF15442: {'auction_closing_time': 1774716985.0, 'created_time': 1773426875.995379, 'last_price_update_time': 1774608117.515609}
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF15442') HTTP/1.1" 204 0
2026-03-27 10:41:57 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG70910%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [auto1.de] INFO: Scrape type for WG70910: 2
2026-03-27 10:41:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5487ad7d-755c-502f-a860-25a0c4077329 with identifier: WG70910
2026-03-27 10:41:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5487ad7d-755c-502f-a860-25a0c4077329 with scrape type 2
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5487ad7d-755c-502f-a860-25a0c4077329 with scrape type 2
2026-03-27 10:41:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5487ad7d-755c-502f-a860-25a0c4077329, identifier: WG70910
2026-03-27 10:41:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5487ad7d-755c-502f-a860-25a0c4077329 with identifier: WG70910
2026-03-27 10:41:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5487ad7d-755c-502f-a860-25a0c4077329 with identifier: WG70910
2026-03-27 10:41:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5487ad7d-755c-502f-a860-25a0c4077329 with identifier: WG70910 to the API
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:56:50Z',
'fuel_type': 'diesel',
'id': '5487ad7d-755c-502f-a860-25a0c4077329',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG70910',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 155652,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-25',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TDI United',
'transmission': 'automatic',
'trim': 'United',
'year': 2021}
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG70910%27 HTTP/1.1" 200 None
2026-03-27 10:41:58 [auto1.de] INFO: Saving data for WG70910: {'auction_closing_time': 1774717010.0, 'created_time': 1773304018.839119, 'last_price_update_time': 1774608118.010221}
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG70910') HTTP/1.1" 204 0
2026-03-27 10:41:58 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-27 10:41:58 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH54779%27 HTTP/1.1" 200 None
2026-03-27 10:41:58 [auto1.de] INFO: Scrape type for ZH54779: 2
2026-03-27 10:41:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dd22ef7-37f7-5119-87f4-68fd0aac645b with identifier: ZH54779
2026-03-27 10:41:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dd22ef7-37f7-5119-87f4-68fd0aac645b with scrape type 2
2026-03-27 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dd22ef7-37f7-5119-87f4-68fd0aac645b with scrape type 2
2026-03-27 10:41:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5dd22ef7-37f7-5119-87f4-68fd0aac645b, identifier: ZH54779
2026-03-27 10:41:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5dd22ef7-37f7-5119-87f4-68fd0aac645b with identifier: ZH54779
2026-03-27 10:41:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5dd22ef7-37f7-5119-87f4-68fd0aac645b with identifier: ZH54779
2026-03-27 10:41:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5dd22ef7-37f7-5119-87f4-68fd0aac645b with identifier: ZH54779 to the API
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:14:13Z',
'fuel_type': 'diesel',
'id': '5dd22ef7-37f7-5119-87f4-68fd0aac645b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH54779',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 172250,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-25',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2011}
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH54779%27 HTTP/1.1" 200 None
2026-03-27 10:41:58 [auto1.de] INFO: Saving data for ZH54779: {'auction_closing_time': 1774714453.0, 'created_time': 1774262583.119828, 'last_price_update_time': 1774608118.479621}
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH54779') HTTP/1.1" 204 0
2026-03-27 10:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:58 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE03555%27 HTTP/1.1" 200 None
2026-03-27 10:41:58 [auto1.de] INFO: Scrape type for GE03555: 2
2026-03-27 10:41:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46f65665-6969-5f21-832f-dc573bc57bd0 with identifier: GE03555
2026-03-27 10:41:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46f65665-6969-5f21-832f-dc573bc57bd0 with scrape type 2
2026-03-27 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46f65665-6969-5f21-832f-dc573bc57bd0 with scrape type 2
2026-03-27 10:41:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46f65665-6969-5f21-832f-dc573bc57bd0, identifier: GE03555
2026-03-27 10:41:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46f65665-6969-5f21-832f-dc573bc57bd0 with identifier: GE03555
2026-03-27 10:41:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46f65665-6969-5f21-832f-dc573bc57bd0 with identifier: GE03555
2026-03-27 10:41:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46f65665-6969-5f21-832f-dc573bc57bd0 with identifier: GE03555 to the API
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:41:09Z',
'fuel_type': 'petrol',
'id': '46f65665-6969-5f21-832f-dc573bc57bd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE03555',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 115531,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-21',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2019}
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE03555%27 HTTP/1.1" 200 None
2026-03-27 10:41:59 [auto1.de] INFO: Saving data for GE03555: {'auction_closing_time': 1774716069.0, 'created_time': 1773133819.095419, 'last_price_update_time': 1774608119.565958}
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE03555') HTTP/1.1" 204 0
2026-03-27 10:41:59 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-27 10:41:59 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY49162%27 HTTP/1.1" 200 None
2026-03-27 10:41:59 [auto1.de] INFO: Scrape type for YY49162: 2
2026-03-27 10:41:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9 with identifier: YY49162
2026-03-27 10:41:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9 with scrape type 2
2026-03-27 10:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9 with scrape type 2
2026-03-27 10:41:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9, identifier: YY49162
2026-03-27 10:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK01210> (referer: https://www.auto1.com/v1/car-details-view/PK01210/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9 with identifier: YY49162
2026-03-27 10:41:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9 with identifier: YY49162
2026-03-27 10:41:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9 with identifier: YY49162 to the API
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:33:42Z',
'fuel_type': 'diesel',
'id': 'a71f7b8f-9c7c-5c26-9ee3-b7fe5cbc5dc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY49162',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 149561,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-12',
'seller_name': None,
'title': 'BMW 3er 320d xDrive Advantage',
'transmission': 'automatic',
'trim': 'xDrive Advantage',
'year': 2018}
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY49162%27 HTTP/1.1" 200 None
2026-03-27 10:42:00 [auto1.de] INFO: Saving data for YY49162: {'auction_closing_time': 1774715622.0, 'created_time': 1773686500.708663, 'last_price_update_time': 1774608120.100111}
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY49162') HTTP/1.1" 204 0
2026-03-27 10:42:00 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 10525 | hits on page: 40
2026-03-27 10:42:00 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-27 10:42:00 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT64251%27 HTTP/1.1" 200 None
2026-03-27 10:42:00 [auto1.de] INFO: Scrape type for HT64251: 2
2026-03-27 10:42:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfedd978-7f38-5581-b144-809649f3d32a with identifier: HT64251
2026-03-27 10:42:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfedd978-7f38-5581-b144-809649f3d32a with scrape type 2
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfedd978-7f38-5581-b144-809649f3d32a with scrape type 2
2026-03-27 10:42:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dfedd978-7f38-5581-b144-809649f3d32a, identifier: HT64251
2026-03-27 10:42:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dfedd978-7f38-5581-b144-809649f3d32a with identifier: HT64251
2026-03-27 10:42:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dfedd978-7f38-5581-b144-809649f3d32a with identifier: HT64251
2026-03-27 10:42:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dfedd978-7f38-5581-b144-809649f3d32a with identifier: HT64251 to the API
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:16:11Z',
'fuel_type': 'diesel',
'id': 'dfedd978-7f38-5581-b144-809649f3d32a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT64251',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 224712,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-19',
'seller_name': None,
'title': 'BMW X1 xDrive 23d',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT64251%27 HTTP/1.1" 200 None
2026-03-27 10:42:00 [auto1.de] INFO: Saving data for HT64251: {'auction_closing_time': 1774714571.0, 'created_time': 1773400607.006065, 'last_price_update_time': 1774608120.5594}
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT64251') HTTP/1.1" 204 0
2026-03-27 10:42:00 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-27 10:42:00 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX72393%27 HTTP/1.1" 200 None
2026-03-27 10:42:00 [auto1.de] INFO: Scrape type for NX72393: 2
2026-03-27 10:42:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a with identifier: NX72393
2026-03-27 10:42:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a with scrape type 2
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a with scrape type 2
2026-03-27 10:42:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a, identifier: NX72393
2026-03-27 10:42:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:00 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC56914%27 HTTP/1.1" 200 None
2026-03-27 10:42:00 [auto1.de] INFO: Scrape type for JC56914: 2
2026-03-27 10:42:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9f453b0-4262-5a01-94f8-04a0d80dbf06 with identifier: JC56914
2026-03-27 10:42:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9f453b0-4262-5a01-94f8-04a0d80dbf06 with scrape type 2
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9f453b0-4262-5a01-94f8-04a0d80dbf06 with scrape type 2
2026-03-27 10:42:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9f453b0-4262-5a01-94f8-04a0d80dbf06, identifier: JC56914
2026-03-27 10:42:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a with identifier: NX72393
2026-03-27 10:42:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a with identifier: NX72393
2026-03-27 10:42:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9dd84191-b856-5b15-9ba4-bf04d1a0ca9a with identifier: NX72393 to the API
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 184,
'expiration_date': '2026-03-28T16:32:15Z',
'fuel_type': 'diesel',
'id': '9dd84191-b856-5b15-9ba4-bf04d1a0ca9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX72393',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 119166,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-04',
'seller_name': None,
'title': 'Audi A3 Sportback 40 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX72393%27 HTTP/1.1" 200 None
2026-03-27 10:42:01 [auto1.de] INFO: Saving data for NX72393: {'auction_closing_time': 1774715535.0, 'created_time': 1773400932.846374, 'last_price_update_time': 1774608121.493476}
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX72393') HTTP/1.1" 204 0
2026-03-27 10:42:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9f453b0-4262-5a01-94f8-04a0d80dbf06 with identifier: JC56914
2026-03-27 10:42:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9f453b0-4262-5a01-94f8-04a0d80dbf06 with identifier: JC56914
2026-03-27 10:42:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9f453b0-4262-5a01-94f8-04a0d80dbf06 with identifier: JC56914 to the API
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-28T16:46:54Z',
'fuel_type': 'diesel',
'id': 'c9f453b0-4262-5a01-94f8-04a0d80dbf06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC56914',
'listing': 'auction',
'make': 'Audi',
'model': 'A6 Allroad',
'odometer': 223190,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-17',
'seller_name': None,
'title': 'Audi A6 Allroad 3.0 V6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC56914%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [auto1.de] INFO: Saving data for JC56914: {'auction_closing_time': 1774716414.0, 'created_time': 1774262880.570923, 'last_price_update_time': 1774608122.100457}
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC56914') HTTP/1.1" 204 0
2026-03-27 10:42:02 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV37503%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [auto1.de] INFO: Scrape type for SV37503: 2
2026-03-27 10:42:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76a6c93f-6dcb-5cde-b2e2-506bb6118118 with identifier: SV37503
2026-03-27 10:42:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a6c93f-6dcb-5cde-b2e2-506bb6118118 with scrape type 2
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76a6c93f-6dcb-5cde-b2e2-506bb6118118 with scrape type 2
2026-03-27 10:42:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76a6c93f-6dcb-5cde-b2e2-506bb6118118, identifier: SV37503
2026-03-27 10:42:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11889c9e-9b94-5e2e-bc2e-ba12fe925cda with identifier: PK01210
2026-03-27 10:42:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11889c9e-9b94-5e2e-bc2e-ba12fe925cda with scrape type 1
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11889c9e-9b94-5e2e-bc2e-ba12fe925cda
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F33%252F0e33bd44c92344dd3955d24b8571184b%252Fpa%252FPK01210_781369e6c7a0acc34b0ad68cfaa3d090.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_781369e6c7a0acc34b0ad68cfaa3d090.jpg already downloaded
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F33%252F0e33bd44c92344dd3955d24b8571184b%252Fpa%252FPK01210_01eec9591f1d00f3310214bd1b9888f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_01eec9591f1d00f3310214bd1b9888f3.jpg already downloaded
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F33%252F0e33bd44c92344dd3955d24b8571184b%252Fpa%252FPK01210_064968131f770eb168dccaa3f7ce983d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_064968131f770eb168dccaa3f7ce983d.jpg already downloaded
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F33%252F0e33bd44c92344dd3955d24b8571184b%252Fpa%252FPK01210_318d71c98e03e3c779801935f33fd4f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_318d71c98e03e3c779801935f33fd4f1.jpg already downloaded
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F33%252F0e33bd44c92344dd3955d24b8571184b%252Fpa%252FPK01210_6cc270fe3f5b5aa7848ede5a8398d084.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_6cc270fe3f5b5aa7848ede5a8398d084.jpg already downloaded
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F33%252F0e33bd44c92344dd3955d24b8571184b%252Fpa%252FPK01210_aa8f4b36d859e171e0e07c003b32f7f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_aa8f4b36d859e171e0e07c003b32f7f7.jpg already downloaded
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F33%252F0e33bd44c92344dd3955d24b8571184b%252Fpa%252FPK01210_8cc85341b5d44f3347ee64552fc89172.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_8cc85341b5d44f3347ee64552fc89172.jpg already downloaded
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F33%252F0e33bd44c92344dd3955d24b8571184b%252Fpa%252FPK01210_bb883147c588a83e8d53d0de17178474.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_bb883147c588a83e8d53d0de17178474.jpg already downloaded
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F33%252F0e33bd44c92344dd3955d24b8571184b%252Fpa%252FPK01210_8d64e45a68aad0ff819cf1cd51b5622e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_8d64e45a68aad0ff819cf1cd51b5622e.jpg already downloaded
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F33%252F0e33bd44c92344dd3955d24b8571184b%252Fpa%252FPK01210_a7d90a6d79d9dcfe2d5939ee22c2cf3c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_a7d90a6d79d9dcfe2d5939ee22c2cf3c.jpg already downloaded
2026-03-27 10:42:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11889c9e-9b94-5e2e-bc2e-ba12fe925cda, identifier: PK01210
2026-03-27 10:42:02 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36203%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [auto1.de] INFO: Scrape type for EC36203: 2
2026-03-27 10:42:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 631a612a-b7d8-5e0d-ae7c-af169ef29462 with identifier: EC36203
2026-03-27 10:42:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 631a612a-b7d8-5e0d-ae7c-af169ef29462 with scrape type 2
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 631a612a-b7d8-5e0d-ae7c-af169ef29462 with scrape type 2
2026-03-27 10:42:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 631a612a-b7d8-5e0d-ae7c-af169ef29462, identifier: EC36203
2026-03-27 10:42:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76a6c93f-6dcb-5cde-b2e2-506bb6118118 with identifier: SV37503
2026-03-27 10:42:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76a6c93f-6dcb-5cde-b2e2-506bb6118118 with identifier: SV37503
2026-03-27 10:42:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76a6c93f-6dcb-5cde-b2e2-506bb6118118 with identifier: SV37503 to the API
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:17:21Z',
'fuel_type': 'diesel',
'id': '76a6c93f-6dcb-5cde-b2e2-506bb6118118',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV37503',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 217870,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-06',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2011}
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV37503%27 HTTP/1.1" 200 None
2026-03-27 10:42:03 [auto1.de] INFO: Saving data for SV37503: {'auction_closing_time': 1774714641.0, 'created_time': 1773305142.114816, 'last_price_update_time': 1774608123.057098}
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV37503') HTTP/1.1" 204 0
2026-03-27 10:42:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11889c9e-9b94-5e2e-bc2e-ba12fe925cda with identifier: PK01210
2026-03-27 10:42:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11889c9e-9b94-5e2e-bc2e-ba12fe925cda with identifier: PK01210
2026-03-27 10:42:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11889c9e-9b94-5e2e-bc2e-ba12fe925cda with identifier: PK01210 to the API
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PK01210>
{'auction_title': '',
'c_o_2_emission_value': 154,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 290,
'expiration_date': '2026-03-28T16:52:11Z',
'fuel_type': 'petrol',
'id': '11889c9e-9b94-5e2e-bc2e-ba12fe925cda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK01210',
'listing': 'auction',
'location': 'DE, Rostock',
'make': 'Seat',
'model': 'Leon',
'odometer': 127479,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_781369e6c7a0acc34b0ad68cfaa3d090.jpg',
'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_01eec9591f1d00f3310214bd1b9888f3.jpg',
'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_064968131f770eb168dccaa3f7ce983d.jpg',
'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_318d71c98e03e3c779801935f33fd4f1.jpg',
'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_6cc270fe3f5b5aa7848ede5a8398d084.jpg',
'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_aa8f4b36d859e171e0e07c003b32f7f7.jpg',
'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_8cc85341b5d44f3347ee64552fc89172.jpg',
'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_bb883147c588a83e8d53d0de17178474.jpg',
'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_8d64e45a68aad0ff819cf1cd51b5622e.jpg',
'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_a7d90a6d79d9dcfe2d5939ee22c2cf3c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11889c9e-9b94-5e2e-bc2e-ba12fe925cda/11889c9e-9b94-5e2e-bc2e-ba12fe925cda_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77645,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_781369e6c7a0acc34b0ad68cfaa3d090.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11889c9e-9b94-5e2e-bc2e-ba12fe925cda/11889c9e-9b94-5e2e-bc2e-ba12fe925cda_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68910,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_01eec9591f1d00f3310214bd1b9888f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11889c9e-9b94-5e2e-bc2e-ba12fe925cda/11889c9e-9b94-5e2e-bc2e-ba12fe925cda_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_064968131f770eb168dccaa3f7ce983d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11889c9e-9b94-5e2e-bc2e-ba12fe925cda/11889c9e-9b94-5e2e-bc2e-ba12fe925cda_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_318d71c98e03e3c779801935f33fd4f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11889c9e-9b94-5e2e-bc2e-ba12fe925cda/11889c9e-9b94-5e2e-bc2e-ba12fe925cda_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109922,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_6cc270fe3f5b5aa7848ede5a8398d084.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11889c9e-9b94-5e2e-bc2e-ba12fe925cda/11889c9e-9b94-5e2e-bc2e-ba12fe925cda_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91635,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_aa8f4b36d859e171e0e07c003b32f7f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11889c9e-9b94-5e2e-bc2e-ba12fe925cda/11889c9e-9b94-5e2e-bc2e-ba12fe925cda_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_8cc85341b5d44f3347ee64552fc89172.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11889c9e-9b94-5e2e-bc2e-ba12fe925cda/11889c9e-9b94-5e2e-bc2e-ba12fe925cda_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84561,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_bb883147c588a83e8d53d0de17178474.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11889c9e-9b94-5e2e-bc2e-ba12fe925cda/11889c9e-9b94-5e2e-bc2e-ba12fe925cda_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77036,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_8d64e45a68aad0ff819cf1cd51b5622e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11889c9e-9b94-5e2e-bc2e-ba12fe925cda/11889c9e-9b94-5e2e-bc2e-ba12fe925cda_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111606,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/33/0e33bd44c92344dd3955d24b8571184b/pa/PK01210_a7d90a6d79d9dcfe2d5939ee22c2cf3c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-11',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Leon 2.0 TSI Cupra 290',
'transmission': 'automatic',
'trim': 'Cupra 290',
'year': 2016}
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK01210%27 HTTP/1.1" 200 None
2026-03-27 10:42:03 [auto1.de] INFO: Saving data for PK01210: {'created_time': 1774608123.424497, 'last_price_update_time': 1774608123.424511, 'auction_closing_time': 1774716731.0}
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK01210') HTTP/1.1" 204 0
2026-03-27 10:42:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 631a612a-b7d8-5e0d-ae7c-af169ef29462 with identifier: EC36203
2026-03-27 10:42:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 631a612a-b7d8-5e0d-ae7c-af169ef29462 with identifier: EC36203
2026-03-27 10:42:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 631a612a-b7d8-5e0d-ae7c-af169ef29462 with identifier: EC36203 to the API
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:00:34Z',
'fuel_type': 'diesel',
'id': '631a612a-b7d8-5e0d-ae7c-af169ef29462',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC36203',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Kombi',
'odometer': 139364,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-11',
'seller_name': None,
'title': 'Volkswagen T5 Kombi 2.0 TDI 4Motion',
'transmission': 'manual',
'trim': '4Motion',
'year': 2014}
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36203%27 HTTP/1.1" 200 None
2026-03-27 10:42:03 [auto1.de] INFO: Saving data for EC36203: {'auction_closing_time': 1774713634.0, 'created_time': 1773429006.578121, 'last_price_update_time': 1774608123.856169}
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC36203') HTTP/1.1" 204 0
2026-03-27 10:42:03 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU55937%27 HTTP/1.1" 200 None
2026-03-27 10:42:03 [auto1.de] INFO: Scrape type for EU55937: 2
2026-03-27 10:42:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79d1bd06-228a-5b68-952d-698deb89dc78 with identifier: EU55937
2026-03-27 10:42:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79d1bd06-228a-5b68-952d-698deb89dc78 with scrape type 2
2026-03-27 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79d1bd06-228a-5b68-952d-698deb89dc78 with scrape type 2
2026-03-27 10:42:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79d1bd06-228a-5b68-952d-698deb89dc78, identifier: EU55937
2026-03-27 10:42:03 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL85877%27 HTTP/1.1" 200 None
2026-03-27 10:42:04 [auto1.de] INFO: Scrape type for JL85877: 2
2026-03-27 10:42:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43ad86a0-6ed1-530a-b59e-086a73c4447a with identifier: JL85877
2026-03-27 10:42:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43ad86a0-6ed1-530a-b59e-086a73c4447a with scrape type 2
2026-03-27 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43ad86a0-6ed1-530a-b59e-086a73c4447a with scrape type 2
2026-03-27 10:42:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43ad86a0-6ed1-530a-b59e-086a73c4447a, identifier: JL85877
2026-03-27 10:42:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79d1bd06-228a-5b68-952d-698deb89dc78 with identifier: EU55937
2026-03-27 10:42:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79d1bd06-228a-5b68-952d-698deb89dc78 with identifier: EU55937
2026-03-27 10:42:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79d1bd06-228a-5b68-952d-698deb89dc78 with identifier: EU55937 to the API
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:14:22Z',
'fuel_type': 'diesel',
'id': '79d1bd06-228a-5b68-952d-698deb89dc78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU55937',
'listing': 'auction',
'make': 'Volvo',
'model': 'V70',
'odometer': 157214,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-10',
'seller_name': None,
'title': 'Volvo V70 2.0 D2 Linje Classic',
'transmission': 'manual',
'trim': 'Linje Classic',
'year': 2015}
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU55937%27 HTTP/1.1" 200 None
2026-03-27 10:42:04 [auto1.de] INFO: Saving data for EU55937: {'auction_closing_time': 1774714462.0, 'created_time': 1774290700.149568, 'last_price_update_time': 1774608124.50714}
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU55937') HTTP/1.1" 204 0
2026-03-27 10:42:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43ad86a0-6ed1-530a-b59e-086a73c4447a with identifier: JL85877
2026-03-27 10:42:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43ad86a0-6ed1-530a-b59e-086a73c4447a with identifier: JL85877
2026-03-27 10:42:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43ad86a0-6ed1-530a-b59e-086a73c4447a with identifier: JL85877 to the API
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 340,
'expiration_date': '2026-03-28T16:22:38Z',
'fuel_type': 'petrol',
'id': '43ad86a0-6ed1-530a-b59e-086a73c4447a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL85877',
'listing': 'auction',
'make': 'BMW',
'model': 'Z4',
'odometer': 12895,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-23',
'seller_name': None,
'title': 'BMW Z4 M40i',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL85877%27 HTTP/1.1" 200 None
2026-03-27 10:42:05 [auto1.de] INFO: Saving data for JL85877: {'auction_closing_time': 1774714958.0, 'created_time': 1774292599.413499, 'last_price_update_time': 1774608125.249096}
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL85877') HTTP/1.1" 204 0
2026-03-27 10:42:05 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-27 10:42:05 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV75239%27 HTTP/1.1" 200 None
2026-03-27 10:42:05 [auto1.de] INFO: Scrape type for KV75239: 2
2026-03-27 10:42:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea with identifier: KV75239
2026-03-27 10:42:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea with scrape type 2
2026-03-27 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea with scrape type 2
2026-03-27 10:42:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea, identifier: KV75239
2026-03-27 10:42:05 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-27 10:42:05 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-27 10:42:05 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-27 10:42:05 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-27 10:42:05 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-27 10:42:05 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW95662%27 HTTP/1.1" 200 None
2026-03-27 10:42:05 [auto1.de] INFO: Scrape type for PW95662: 2
2026-03-27 10:42:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bf2417c-0cff-5bb8-a916-0e6349fdea4d with identifier: PW95662
2026-03-27 10:42:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bf2417c-0cff-5bb8-a916-0e6349fdea4d with scrape type 2
2026-03-27 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bf2417c-0cff-5bb8-a916-0e6349fdea4d with scrape type 2
2026-03-27 10:42:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5bf2417c-0cff-5bb8-a916-0e6349fdea4d, identifier: PW95662
2026-03-27 10:42:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea with identifier: KV75239
2026-03-27 10:42:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea with identifier: KV75239
2026-03-27 10:42:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82444e8b-ca76-5e97-8ad8-4ee35d3e8cea with identifier: KV75239 to the API
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:14:15Z',
'fuel_type': 'petrol',
'id': '82444e8b-ca76-5e97-8ad8-4ee35d3e8cea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV75239',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 213705,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-25',
'seller_name': None,
'title': 'Ford Focus 1.6 Concept',
'transmission': 'manual',
'trim': 'Concept',
'year': 2009}
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV75239%27 HTTP/1.1" 200 None
2026-03-27 10:42:06 [auto1.de] INFO: Saving data for KV75239: {'auction_closing_time': 1774714455.0, 'created_time': 1773306810.208658, 'last_price_update_time': 1774608126.154815}
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV75239') HTTP/1.1" 204 0
2026-03-27 10:42:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5bf2417c-0cff-5bb8-a916-0e6349fdea4d with identifier: PW95662
2026-03-27 10:42:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5bf2417c-0cff-5bb8-a916-0e6349fdea4d with identifier: PW95662
2026-03-27 10:42:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5bf2417c-0cff-5bb8-a916-0e6349fdea4d with identifier: PW95662 to the API
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-28T16:06:37Z',
'fuel_type': 'petrol',
'id': '5bf2417c-0cff-5bb8-a916-0e6349fdea4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW95662',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 103250,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-20',
'seller_name': None,
'title': 'Renault Megane 1.2 TCe Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2016}
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW95662%27 HTTP/1.1" 200 None
2026-03-27 10:42:06 [auto1.de] INFO: Saving data for PW95662: {'auction_closing_time': 1774713997.0, 'created_time': 1773138237.223613, 'last_price_update_time': 1774608126.842944}
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW95662') HTTP/1.1" 204 0
2026-03-27 10:42:06 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF85943%27 HTTP/1.1" 200 None
2026-03-27 10:42:06 [auto1.de] INFO: Scrape type for BF85943: 2
2026-03-27 10:42:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba42525d-36c6-5ad9-9430-e809d1e47c8a with identifier: BF85943
2026-03-27 10:42:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba42525d-36c6-5ad9-9430-e809d1e47c8a with scrape type 2
2026-03-27 10:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba42525d-36c6-5ad9-9430-e809d1e47c8a with scrape type 2
2026-03-27 10:42:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba42525d-36c6-5ad9-9430-e809d1e47c8a, identifier: BF85943
2026-03-27 10:42:06 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW62166%27 HTTP/1.1" 200 None
2026-03-27 10:42:06 [auto1.de] INFO: Scrape type for MW62166: 2
2026-03-27 10:42:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 321b1cf2-2975-555c-b977-9137d4923e9f with identifier: MW62166
2026-03-27 10:42:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 321b1cf2-2975-555c-b977-9137d4923e9f with scrape type 2
2026-03-27 10:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 321b1cf2-2975-555c-b977-9137d4923e9f with scrape type 2
2026-03-27 10:42:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 321b1cf2-2975-555c-b977-9137d4923e9f, identifier: MW62166
2026-03-27 10:42:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba42525d-36c6-5ad9-9430-e809d1e47c8a with identifier: BF85943
2026-03-27 10:42:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba42525d-36c6-5ad9-9430-e809d1e47c8a with identifier: BF85943
2026-03-27 10:42:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba42525d-36c6-5ad9-9430-e809d1e47c8a with identifier: BF85943 to the API
2026-03-27 10:42:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:22:58Z',
'fuel_type': 'diesel',
'id': 'ba42525d-36c6-5ad9-9430-e809d1e47c8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF85943',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 150257,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-26',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2019}
2026-03-27 10:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF85943%27 HTTP/1.1" 200 None
2026-03-27 10:42:07 [auto1.de] INFO: Saving data for BF85943: {'auction_closing_time': 1774714978.0, 'created_time': 1773303743.454613, 'last_price_update_time': 1774608127.778189}
2026-03-27 10:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF85943') HTTP/1.1" 204 0
2026-03-27 10:42:07 [scrapy.extensions.logstats] INFO: Crawled 348 pages (at 16 pages/min), scraped 687 items (at 104 items/min)
2026-03-27 10:42:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-27 10:42:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 321b1cf2-2975-555c-b977-9137d4923e9f with identifier: MW62166
2026-03-27 10:42:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 321b1cf2-2975-555c-b977-9137d4923e9f with identifier: MW62166
2026-03-27 10:42:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 321b1cf2-2975-555c-b977-9137d4923e9f with identifier: MW62166 to the API
2026-03-27 10:42:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:35:50Z',
'fuel_type': 'petrol',
'id': '321b1cf2-2975-555c-b977-9137d4923e9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW62166',
'listing': 'auction',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 85435,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-19',
'seller_name': None,
'title': 'Seat Tarraco 1.5 TSI ACT Xcellence',
'transmission': 'manual',
'trim': 'Xcellence',
'year': 2020}
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW62166%27 HTTP/1.1" 200 None
2026-03-27 10:42:08 [auto1.de] INFO: Saving data for MW62166: {'auction_closing_time': 1774715750.0, 'created_time': 1773859537.83337, 'last_price_update_time': 1774608128.531065}
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW62166') HTTP/1.1" 204 0
2026-03-27 10:42:08 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG51341%27 HTTP/1.1" 200 None
2026-03-27 10:42:08 [auto1.de] INFO: Scrape type for XG51341: 2
2026-03-27 10:42:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1a76675-8238-50c3-8d59-2182802745f4 with identifier: XG51341
2026-03-27 10:42:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1a76675-8238-50c3-8d59-2182802745f4 with scrape type 2
2026-03-27 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1a76675-8238-50c3-8d59-2182802745f4 with scrape type 2
2026-03-27 10:42:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1a76675-8238-50c3-8d59-2182802745f4, identifier: XG51341
2026-03-27 10:42:08 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU78971%27 HTTP/1.1" 200 None
2026-03-27 10:42:08 [auto1.de] INFO: Scrape type for LU78971: 2
2026-03-27 10:42:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d82731f0-4143-5c3b-bca4-73e350b68a34 with identifier: LU78971
2026-03-27 10:42:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d82731f0-4143-5c3b-bca4-73e350b68a34 with scrape type 2
2026-03-27 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d82731f0-4143-5c3b-bca4-73e350b68a34 with scrape type 2
2026-03-27 10:42:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d82731f0-4143-5c3b-bca4-73e350b68a34, identifier: LU78971
2026-03-27 10:42:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1a76675-8238-50c3-8d59-2182802745f4 with identifier: XG51341
2026-03-27 10:42:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1a76675-8238-50c3-8d59-2182802745f4 with identifier: XG51341
2026-03-27 10:42:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1a76675-8238-50c3-8d59-2182802745f4 with identifier: XG51341 to the API
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:07:48Z',
'fuel_type': 'diesel',
'id': 'e1a76675-8238-50c3-8d59-2182802745f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG51341',
'listing': 'auction',
'make': 'Nissan',
'model': 'Pulsar',
'odometer': 132343,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-25',
'seller_name': None,
'title': 'Nissan Pulsar 1.5 Turbodiesel N-Connecta',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2017}
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG51341%27 HTTP/1.1" 200 None
2026-03-27 10:42:09 [auto1.de] INFO: Saving data for XG51341: {'auction_closing_time': 1774714068.0, 'created_time': 1773305529.269679, 'last_price_update_time': 1774608129.103691}
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG51341') HTTP/1.1" 204 0
2026-03-27 10:42:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d82731f0-4143-5c3b-bca4-73e350b68a34 with identifier: LU78971
2026-03-27 10:42:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d82731f0-4143-5c3b-bca4-73e350b68a34 with identifier: LU78971
2026-03-27 10:42:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d82731f0-4143-5c3b-bca4-73e350b68a34 with identifier: LU78971 to the API
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:15:23Z',
'fuel_type': 'diesel',
'id': 'd82731f0-4143-5c3b-bca4-73e350b68a34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU78971',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 288720,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-08-08',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 280 CDI Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2005}
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU78971%27 HTTP/1.1" 200 None
2026-03-27 10:42:09 [auto1.de] INFO: Saving data for LU78971: {'auction_closing_time': 1774714523.0, 'created_time': 1773469111.327448, 'last_price_update_time': 1774608129.437272}
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU78971') HTTP/1.1" 204 0
2026-03-27 10:42:09 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-27 10:42:09 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-27 10:42:09 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-27 10:42:09 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-27 10:42:09 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS04983%27 HTTP/1.1" 200 None
2026-03-27 10:42:09 [auto1.de] INFO: Scrape type for NS04983: 2
2026-03-27 10:42:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5107a15a-289f-5118-821d-0e47c7fd0497 with identifier: NS04983
2026-03-27 10:42:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5107a15a-289f-5118-821d-0e47c7fd0497 with scrape type 2
2026-03-27 10:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5107a15a-289f-5118-821d-0e47c7fd0497 with scrape type 2
2026-03-27 10:42:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5107a15a-289f-5118-821d-0e47c7fd0497, identifier: NS04983
2026-03-27 10:42:09 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA11296%27 HTTP/1.1" 200 None
2026-03-27 10:42:09 [auto1.de] INFO: Scrape type for CA11296: 2
2026-03-27 10:42:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82afe9ad-83dc-5500-9c19-691a6d0092e6 with identifier: CA11296
2026-03-27 10:42:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82afe9ad-83dc-5500-9c19-691a6d0092e6 with scrape type 2
2026-03-27 10:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82afe9ad-83dc-5500-9c19-691a6d0092e6 with scrape type 2
2026-03-27 10:42:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82afe9ad-83dc-5500-9c19-691a6d0092e6, identifier: CA11296
2026-03-27 10:42:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5107a15a-289f-5118-821d-0e47c7fd0497 with identifier: NS04983
2026-03-27 10:42:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5107a15a-289f-5118-821d-0e47c7fd0497 with identifier: NS04983
2026-03-27 10:42:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5107a15a-289f-5118-821d-0e47c7fd0497 with identifier: NS04983 to the API
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-28T16:15:21Z',
'fuel_type': 'petrol',
'id': '5107a15a-289f-5118-821d-0e47c7fd0497',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS04983',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 67979,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-12-16',
'seller_name': None,
'title': 'BMW X1 xDrive 28i',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS04983%27 HTTP/1.1" 200 None
2026-03-27 10:42:10 [auto1.de] INFO: Saving data for NS04983: {'auction_closing_time': 1774714521.0, 'created_time': 1773400577.900967, 'last_price_update_time': 1774608130.000188}
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS04983') HTTP/1.1" 204 0
2026-03-27 10:42:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82afe9ad-83dc-5500-9c19-691a6d0092e6 with identifier: CA11296
2026-03-27 10:42:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82afe9ad-83dc-5500-9c19-691a6d0092e6 with identifier: CA11296
2026-03-27 10:42:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82afe9ad-83dc-5500-9c19-691a6d0092e6 with identifier: CA11296 to the API
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:16:12Z',
'fuel_type': 'diesel',
'id': '82afe9ad-83dc-5500-9c19-691a6d0092e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA11296',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 191595,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-22',
'seller_name': None,
'title': 'Skoda Fabia 1.6 TDI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2011}
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA11296%27 HTTP/1.1" 200 None
2026-03-27 10:42:10 [auto1.de] INFO: Saving data for CA11296: {'auction_closing_time': 1774714572.0, 'created_time': 1774263166.514422, 'last_price_update_time': 1774608130.356534}
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA11296') HTTP/1.1" 204 0
2026-03-27 10:42:10 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH47357%27 HTTP/1.1" 200 None
2026-03-27 10:42:10 [auto1.de] INFO: Scrape type for GH47357: 2
2026-03-27 10:42:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f140020-f7fe-5db7-9562-be06624fa3c6 with identifier: GH47357
2026-03-27 10:42:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f140020-f7fe-5db7-9562-be06624fa3c6 with scrape type 2
2026-03-27 10:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f140020-f7fe-5db7-9562-be06624fa3c6 with scrape type 2
2026-03-27 10:42:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f140020-f7fe-5db7-9562-be06624fa3c6, identifier: GH47357
2026-03-27 10:42:10 [auto1.de] INFO: Found listing with ID: WA42896
2026-03-27 10:42:10 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV37620%27 HTTP/1.1" 200 None
2026-03-27 10:42:10 [auto1.de] INFO: Scrape type for JV37620: 2
2026-03-27 10:42:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48682df9-ad7a-598c-bbfe-9eca263cfed2 with identifier: JV37620
2026-03-27 10:42:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48682df9-ad7a-598c-bbfe-9eca263cfed2 with scrape type 2
2026-03-27 10:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48682df9-ad7a-598c-bbfe-9eca263cfed2 with scrape type 2
2026-03-27 10:42:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48682df9-ad7a-598c-bbfe-9eca263cfed2, identifier: JV37620
2026-03-27 10:42:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f140020-f7fe-5db7-9562-be06624fa3c6 with identifier: GH47357
2026-03-27 10:42:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f140020-f7fe-5db7-9562-be06624fa3c6 with identifier: GH47357
2026-03-27 10:42:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f140020-f7fe-5db7-9562-be06624fa3c6 with identifier: GH47357 to the API
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:49:51Z',
'fuel_type': 'petrol',
'id': '9f140020-f7fe-5db7-9562-be06624fa3c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH47357',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 63401,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-01',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2021}
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH47357%27 HTTP/1.1" 200 None
2026-03-27 10:42:10 [auto1.de] INFO: Saving data for GH47357: {'auction_closing_time': 1774716591.0, 'created_time': 1774294279.005732, 'last_price_update_time': 1774608130.908384}
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH47357') HTTP/1.1" 204 0
2026-03-27 10:42:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48682df9-ad7a-598c-bbfe-9eca263cfed2 with identifier: JV37620
2026-03-27 10:42:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48682df9-ad7a-598c-bbfe-9eca263cfed2 with identifier: JV37620
2026-03-27 10:42:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48682df9-ad7a-598c-bbfe-9eca263cfed2 with identifier: JV37620 to the API
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:10:15Z',
'fuel_type': 'diesel',
'id': '48682df9-ad7a-598c-bbfe-9eca263cfed2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV37620',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 246377,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-23',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 220 Shooting Brake AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2017}
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV37620%27 HTTP/1.1" 200 None
2026-03-27 10:42:11 [auto1.de] INFO: Saving data for JV37620: {'auction_closing_time': 1774714215.0, 'created_time': 1773305735.521012, 'last_price_update_time': 1774608131.370969}
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV37620') HTTP/1.1" 204 0
2026-03-27 10:42:11 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-27 10:42:11 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-27 10:42:11 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-27 10:42:11 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-27 10:42:11 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65369%27 HTTP/1.1" 200 None
2026-03-27 10:42:11 [auto1.de] INFO: Scrape type for CA65369: 2
2026-03-27 10:42:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1 with identifier: CA65369
2026-03-27 10:42:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1 with scrape type 2
2026-03-27 10:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1 with scrape type 2
2026-03-27 10:42:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1, identifier: CA65369
2026-03-27 10:42:11 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV99140%27 HTTP/1.1" 200 None
2026-03-27 10:42:11 [auto1.de] INFO: Scrape type for EV99140: 2
2026-03-27 10:42:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb54719f-86a4-5e42-a83e-6bab6439cc75 with identifier: EV99140
2026-03-27 10:42:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb54719f-86a4-5e42-a83e-6bab6439cc75 with scrape type 2
2026-03-27 10:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb54719f-86a4-5e42-a83e-6bab6439cc75 with scrape type 2
2026-03-27 10:42:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb54719f-86a4-5e42-a83e-6bab6439cc75, identifier: EV99140
2026-03-27 10:42:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1 with identifier: CA65369
2026-03-27 10:42:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1 with identifier: CA65369
2026-03-27 10:42:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f2a883d-36f1-5cb8-9b78-ac7715eef8a1 with identifier: CA65369 to the API
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:11:07Z',
'fuel_type': 'petrol',
'id': '6f2a883d-36f1-5cb8-9b78-ac7715eef8a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA65369',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 102905,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-20',
'seller_name': None,
'title': 'Nissan Qashqai 1.2 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2015}
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65369%27 HTTP/1.1" 200 None
2026-03-27 10:42:11 [auto1.de] INFO: Saving data for CA65369: {'auction_closing_time': 1774714267.0, 'created_time': 1773399912.007961, 'last_price_update_time': 1774608131.985379}
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA65369') HTTP/1.1" 204 0
2026-03-27 10:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb54719f-86a4-5e42-a83e-6bab6439cc75 with identifier: EV99140
2026-03-27 10:42:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb54719f-86a4-5e42-a83e-6bab6439cc75 with identifier: EV99140
2026-03-27 10:42:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb54719f-86a4-5e42-a83e-6bab6439cc75 with identifier: EV99140 to the API
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:31:43Z',
'fuel_type': 'petrol',
'id': 'cb54719f-86a4-5e42-a83e-6bab6439cc75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV99140',
'listing': 'auction',
'make': 'Skoda',
'model': 'Rapid Spaceback',
'odometer': 102162,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-07',
'seller_name': None,
'title': 'Skoda Rapid Spaceback 1.0 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2018}
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV99140%27 HTTP/1.1" 200 None
2026-03-27 10:42:12 [auto1.de] INFO: Saving data for EV99140: {'auction_closing_time': 1774715503.0, 'created_time': 1773774569.567171, 'last_price_update_time': 1774608132.368246}
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV99140') HTTP/1.1" 204 0
2026-03-27 10:42:12 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD43064%27 HTTP/1.1" 200 None
2026-03-27 10:42:12 [auto1.de] INFO: Scrape type for BD43064: 2
2026-03-27 10:42:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9b4c7af-39c1-50a8-830b-407d7c60fdf5 with identifier: BD43064
2026-03-27 10:42:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9b4c7af-39c1-50a8-830b-407d7c60fdf5 with scrape type 2
2026-03-27 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9b4c7af-39c1-50a8-830b-407d7c60fdf5 with scrape type 2
2026-03-27 10:42:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9b4c7af-39c1-50a8-830b-407d7c60fdf5, identifier: BD43064
2026-03-27 10:42:12 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-27 10:42:12 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT72401%27 HTTP/1.1" 200 None
2026-03-27 10:42:12 [auto1.de] INFO: Scrape type for LT72401: 2
2026-03-27 10:42:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10f9c18c-fc62-57c5-940b-b10fe2d77b38 with identifier: LT72401
2026-03-27 10:42:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10f9c18c-fc62-57c5-940b-b10fe2d77b38 with scrape type 2
2026-03-27 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10f9c18c-fc62-57c5-940b-b10fe2d77b38 with scrape type 2
2026-03-27 10:42:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10f9c18c-fc62-57c5-940b-b10fe2d77b38, identifier: LT72401
2026-03-27 10:42:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9b4c7af-39c1-50a8-830b-407d7c60fdf5 with identifier: BD43064
2026-03-27 10:42:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9b4c7af-39c1-50a8-830b-407d7c60fdf5 with identifier: BD43064
2026-03-27 10:42:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9b4c7af-39c1-50a8-830b-407d7c60fdf5 with identifier: BD43064 to the API
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:07:08Z',
'fuel_type': 'petrol',
'id': 'e9b4c7af-39c1-50a8-830b-407d7c60fdf5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD43064',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 101599,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-21',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 FSI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2011}
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD43064%27 HTTP/1.1" 200 None
2026-03-27 10:42:12 [auto1.de] INFO: Saving data for BD43064: {'auction_closing_time': 1774714028.0, 'created_time': 1773305440.876803, 'last_price_update_time': 1774608132.945615}
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD43064') HTTP/1.1" 204 0
2026-03-27 10:42:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10f9c18c-fc62-57c5-940b-b10fe2d77b38 with identifier: LT72401
2026-03-27 10:42:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10f9c18c-fc62-57c5-940b-b10fe2d77b38 with identifier: LT72401
2026-03-27 10:42:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10f9c18c-fc62-57c5-940b-b10fe2d77b38 with identifier: LT72401 to the API
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:57:49Z',
'fuel_type': 'petrol',
'id': '10f9c18c-fc62-57c5-940b-b10fe2d77b38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT72401',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 121290,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-13',
'seller_name': None,
'title': 'Opel Astra 1.4 SIDI Turbo Active Start/Stop',
'transmission': 'manual',
'trim': 'Active Start/Stop',
'year': 2017}
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT72401%27 HTTP/1.1" 200 None
2026-03-27 10:42:13 [auto1.de] INFO: Saving data for LT72401: {'auction_closing_time': 1774717069.0, 'created_time': 1773305828.571073, 'last_price_update_time': 1774608133.304998}
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT72401') HTTP/1.1" 204 0
2026-03-27 10:42:13 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-27 10:42:13 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-27 10:42:13 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF29194%27 HTTP/1.1" 200 None
2026-03-27 10:42:13 [auto1.de] INFO: Scrape type for UF29194: 2
2026-03-27 10:42:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07eda542-d003-50c0-acf9-c56bfae8e648 with identifier: UF29194
2026-03-27 10:42:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07eda542-d003-50c0-acf9-c56bfae8e648 with scrape type 2
2026-03-27 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07eda542-d003-50c0-acf9-c56bfae8e648 with scrape type 2
2026-03-27 10:42:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07eda542-d003-50c0-acf9-c56bfae8e648, identifier: UF29194
2026-03-27 10:42:13 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP82527%27 HTTP/1.1" 200 None
2026-03-27 10:42:13 [auto1.de] INFO: Scrape type for BP82527: 2
2026-03-27 10:42:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2971d5f5-254c-5ec8-88df-8f77b49a5bb6 with identifier: BP82527
2026-03-27 10:42:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2971d5f5-254c-5ec8-88df-8f77b49a5bb6 with scrape type 2
2026-03-27 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2971d5f5-254c-5ec8-88df-8f77b49a5bb6 with scrape type 2
2026-03-27 10:42:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2971d5f5-254c-5ec8-88df-8f77b49a5bb6, identifier: BP82527
2026-03-27 10:42:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07eda542-d003-50c0-acf9-c56bfae8e648 with identifier: UF29194
2026-03-27 10:42:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07eda542-d003-50c0-acf9-c56bfae8e648 with identifier: UF29194
2026-03-27 10:42:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07eda542-d003-50c0-acf9-c56bfae8e648 with identifier: UF29194 to the API
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:40:18Z',
'fuel_type': 'diesel',
'id': '07eda542-d003-50c0-acf9-c56bfae8e648',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF29194',
'listing': 'auction',
'make': 'Seat',
'model': 'Altea',
'odometer': 59601,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-16',
'seller_name': None,
'title': 'Seat Altea 1.6 TDI I-Tech Ecomotive',
'transmission': 'manual',
'trim': 'I-Tech Ecomotive',
'year': 2015}
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF29194%27 HTTP/1.1" 200 None
2026-03-27 10:42:13 [auto1.de] INFO: Saving data for UF29194: {'auction_closing_time': 1774716018.0, 'created_time': 1773305086.134765, 'last_price_update_time': 1774608133.914579}
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF29194') HTTP/1.1" 204 0
2026-03-27 10:42:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2971d5f5-254c-5ec8-88df-8f77b49a5bb6 with identifier: BP82527
2026-03-27 10:42:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2971d5f5-254c-5ec8-88df-8f77b49a5bb6 with identifier: BP82527
2026-03-27 10:42:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2971d5f5-254c-5ec8-88df-8f77b49a5bb6 with identifier: BP82527 to the API
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:04:29Z',
'fuel_type': 'petrol',
'id': '2971d5f5-254c-5ec8-88df-8f77b49a5bb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP82527',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 127416,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-08-31',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 CrossPolo',
'transmission': 'manual',
'trim': 'Cross',
'year': 2006}
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP82527%27 HTTP/1.1" 200 None
2026-03-27 10:42:14 [auto1.de] INFO: Saving data for BP82527: {'auction_closing_time': 1774713869.0, 'created_time': 1773860369.694964, 'last_price_update_time': 1774608134.415064}
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP82527') HTTP/1.1" 204 0
2026-03-27 10:42:14 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-27 10:42:14 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91786%27 HTTP/1.1" 200 None
2026-03-27 10:42:14 [auto1.de] INFO: Scrape type for GV91786: 2
2026-03-27 10:42:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf668407-154f-5b4a-a50e-a5a0cf8951ce with identifier: GV91786
2026-03-27 10:42:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf668407-154f-5b4a-a50e-a5a0cf8951ce with scrape type 2
2026-03-27 10:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf668407-154f-5b4a-a50e-a5a0cf8951ce with scrape type 2
2026-03-27 10:42:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf668407-154f-5b4a-a50e-a5a0cf8951ce, identifier: GV91786
2026-03-27 10:42:14 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 10527 | hits on page: 40
2026-03-27 10:42:14 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP67164%27 HTTP/1.1" 200 None
2026-03-27 10:42:14 [auto1.de] INFO: Scrape type for LP67164: 2
2026-03-27 10:42:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b22a011-37d1-58d3-830f-3caee704e09f with identifier: LP67164
2026-03-27 10:42:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b22a011-37d1-58d3-830f-3caee704e09f with scrape type 2
2026-03-27 10:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b22a011-37d1-58d3-830f-3caee704e09f with scrape type 2
2026-03-27 10:42:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b22a011-37d1-58d3-830f-3caee704e09f, identifier: LP67164
2026-03-27 10:42:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf668407-154f-5b4a-a50e-a5a0cf8951ce with identifier: GV91786
2026-03-27 10:42:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf668407-154f-5b4a-a50e-a5a0cf8951ce with identifier: GV91786
2026-03-27 10:42:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf668407-154f-5b4a-a50e-a5a0cf8951ce with identifier: GV91786 to the API
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 249,
'expiration_date': '2026-03-28T16:50:36Z',
'fuel_type': 'diesel',
'id': 'bf668407-154f-5b4a-a50e-a5a0cf8951ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV91786',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 192561,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-07',
'seller_name': None,
'title': 'Volvo XC90 2.0 B5 Diesel Mild-Hybrid Inscription AWD',
'transmission': 'automatic',
'trim': 'Inscription AWD',
'year': 2019}
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91786%27 HTTP/1.1" 200 None
2026-03-27 10:42:15 [auto1.de] INFO: Saving data for GV91786: {'auction_closing_time': 1774716636.0, 'created_time': 1774251087.062071, 'last_price_update_time': 1774608135.005746}
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV91786') HTTP/1.1" 204 0
2026-03-27 10:42:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b22a011-37d1-58d3-830f-3caee704e09f with identifier: LP67164
2026-03-27 10:42:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b22a011-37d1-58d3-830f-3caee704e09f with identifier: LP67164
2026-03-27 10:42:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b22a011-37d1-58d3-830f-3caee704e09f with identifier: LP67164 to the API
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 121,
'expiration_date': '2026-03-28T16:09:22Z',
'fuel_type': 'petrol',
'id': '9b22a011-37d1-58d3-830f-3caee704e09f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP67164',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-3',
'odometer': 69589,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-15',
'seller_name': None,
'title': 'Mazda CX-3 2.0 Skyactiv-G Sports-Line',
'transmission': 'manual',
'trim': 'Sports-Line',
'year': 2019}
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP67164%27 HTTP/1.1" 200 None
2026-03-27 10:42:15 [auto1.de] INFO: Saving data for LP67164: {'auction_closing_time': 1774714162.0, 'created_time': 1774294549.272413, 'last_price_update_time': 1774608135.36641}
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LP67164') HTTP/1.1" 204 0
2026-03-27 10:42:15 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN59671%27 HTTP/1.1" 200 None
2026-03-27 10:42:15 [auto1.de] INFO: Scrape type for TN59671: 2
2026-03-27 10:42:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b77b7246-133a-54c3-a584-c26e7a6c0d04 with identifier: TN59671
2026-03-27 10:42:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b77b7246-133a-54c3-a584-c26e7a6c0d04 with scrape type 2
2026-03-27 10:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b77b7246-133a-54c3-a584-c26e7a6c0d04 with scrape type 2
2026-03-27 10:42:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b77b7246-133a-54c3-a584-c26e7a6c0d04, identifier: TN59671
2026-03-27 10:42:15 [auto1.de] INFO: Found listing with ID: LB73186
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB73186%27 HTTP/1.1" 200 None
2026-03-27 10:42:15 [auto1.de] INFO: Scrape type for LB73186: 0
2026-03-27 10:42:15 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB73740%27 HTTP/1.1" 200 None
2026-03-27 10:42:15 [auto1.de] INFO: Scrape type for WB73740: 2
2026-03-27 10:42:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27ca45c5-ea7d-5329-b358-03aea19176a3 with identifier: WB73740
2026-03-27 10:42:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27ca45c5-ea7d-5329-b358-03aea19176a3 with scrape type 2
2026-03-27 10:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27ca45c5-ea7d-5329-b358-03aea19176a3 with scrape type 2
2026-03-27 10:42:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27ca45c5-ea7d-5329-b358-03aea19176a3, identifier: WB73740
2026-03-27 10:42:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:15 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-27 10:42:15 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA05422%27 HTTP/1.1" 200 None
2026-03-27 10:42:15 [auto1.de] INFO: Scrape type for LA05422: 2
2026-03-27 10:42:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40789099-ae02-54ba-adc5-b5b6a8b6bb4b with identifier: LA05422
2026-03-27 10:42:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40789099-ae02-54ba-adc5-b5b6a8b6bb4b with scrape type 2
2026-03-27 10:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40789099-ae02-54ba-adc5-b5b6a8b6bb4b with scrape type 2
2026-03-27 10:42:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40789099-ae02-54ba-adc5-b5b6a8b6bb4b, identifier: LA05422
2026-03-27 10:42:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b77b7246-133a-54c3-a584-c26e7a6c0d04 with identifier: TN59671
2026-03-27 10:42:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b77b7246-133a-54c3-a584-c26e7a6c0d04 with identifier: TN59671
2026-03-27 10:42:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b77b7246-133a-54c3-a584-c26e7a6c0d04 with identifier: TN59671 to the API
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'other',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 179,
'expiration_date': '2026-03-28T16:59:00Z',
'fuel_type': 'diesel',
'id': 'b77b7246-133a-54c3-a584-c26e7a6c0d04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN59671',
'listing': 'auction',
'make': 'Iveco',
'model': 'Daily',
'odometer': 76670,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-31',
'seller_name': None,
'title': 'Iveco Daily 3.0 Diesel Einzelkabine 70 C Radstand 4350',
'transmission': 'manual',
'trim': 'Einzelkabine 70 C Radstand 4350',
'year': 2021}
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN59671%27 HTTP/1.1" 200 None
2026-03-27 10:42:16 [auto1.de] INFO: Saving data for TN59671: {'auction_closing_time': 1774717140.0, 'created_time': 1773917538.259573, 'last_price_update_time': 1774608136.125569}
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN59671') HTTP/1.1" 204 0
2026-03-27 10:42:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27ca45c5-ea7d-5329-b358-03aea19176a3 with identifier: WB73740
2026-03-27 10:42:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27ca45c5-ea7d-5329-b358-03aea19176a3 with identifier: WB73740
2026-03-27 10:42:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27ca45c5-ea7d-5329-b358-03aea19176a3 with identifier: WB73740 to the API
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:27:02Z',
'fuel_type': 'petrol',
'id': '27ca45c5-ea7d-5329-b358-03aea19176a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB73740',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 79326,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-08',
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
'transmission': 'automatic',
'trim': 'Sport 4Motion',
'year': 2018}
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB73740%27 HTTP/1.1" 200 None
2026-03-27 10:42:16 [auto1.de] INFO: Saving data for WB73740: {'auction_closing_time': 1774715222.0, 'created_time': 1773775263.523724, 'last_price_update_time': 1774608136.55591}
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB73740') HTTP/1.1" 204 0
2026-03-27 10:42:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40789099-ae02-54ba-adc5-b5b6a8b6bb4b with identifier: LA05422
2026-03-27 10:42:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40789099-ae02-54ba-adc5-b5b6a8b6bb4b with identifier: LA05422
2026-03-27 10:42:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40789099-ae02-54ba-adc5-b5b6a8b6bb4b with identifier: LA05422 to the API
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 265,
'expiration_date': '2026-03-28T16:50:03Z',
'fuel_type': 'diesel',
'id': '40789099-ae02-54ba-adc5-b5b6a8b6bb4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA05422',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 210612,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-10',
'seller_name': None,
'title': 'BMW 5er 530d Luxury Line',
'transmission': 'automatic',
'trim': 'Luxury Line',
'year': 2018}
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA05422%27 HTTP/1.1" 200 None
2026-03-27 10:42:16 [auto1.de] INFO: Saving data for LA05422: {'auction_closing_time': 1774716603.0, 'created_time': 1773307435.14539, 'last_price_update_time': 1774608136.987836}
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA05422') HTTP/1.1" 204 0
2026-03-27 10:42:17 [auto1.de] INFO: Found listing with ID: EJ47665
2026-03-27 10:42:17 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-27 10:42:17 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-27 10:42:17 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-27 10:42:17 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK53222%27 HTTP/1.1" 200 None
2026-03-27 10:42:17 [auto1.de] INFO: Scrape type for GK53222: 2
2026-03-27 10:42:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f6b90a9-f227-5897-8d1f-0d66eacebe13 with identifier: GK53222
2026-03-27 10:42:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f6b90a9-f227-5897-8d1f-0d66eacebe13 with scrape type 2
2026-03-27 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f6b90a9-f227-5897-8d1f-0d66eacebe13 with scrape type 2
2026-03-27 10:42:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f6b90a9-f227-5897-8d1f-0d66eacebe13, identifier: GK53222
2026-03-27 10:42:17 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN87800%27 HTTP/1.1" 200 None
2026-03-27 10:42:17 [auto1.de] INFO: Scrape type for CN87800: 2
2026-03-27 10:42:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ba28a4f-6003-5c2d-9a1d-801c29d22cda with identifier: CN87800
2026-03-27 10:42:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ba28a4f-6003-5c2d-9a1d-801c29d22cda with scrape type 2
2026-03-27 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ba28a4f-6003-5c2d-9a1d-801c29d22cda with scrape type 2
2026-03-27 10:42:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ba28a4f-6003-5c2d-9a1d-801c29d22cda, identifier: CN87800
2026-03-27 10:42:17 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26192%27 HTTP/1.1" 200 None
2026-03-27 10:42:17 [auto1.de] INFO: Scrape type for XN26192: 2
2026-03-27 10:42:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3 with identifier: XN26192
2026-03-27 10:42:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3 with scrape type 2
2026-03-27 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3 with scrape type 2
2026-03-27 10:42:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3, identifier: XN26192
2026-03-27 10:42:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f6b90a9-f227-5897-8d1f-0d66eacebe13 with identifier: GK53222
2026-03-27 10:42:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f6b90a9-f227-5897-8d1f-0d66eacebe13 with identifier: GK53222
2026-03-27 10:42:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f6b90a9-f227-5897-8d1f-0d66eacebe13 with identifier: GK53222 to the API
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:18:27Z',
'fuel_type': 'petrol',
'id': '4f6b90a9-f227-5897-8d1f-0d66eacebe13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK53222',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 61292,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-18',
'seller_name': None,
'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2019}
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK53222%27 HTTP/1.1" 200 None
2026-03-27 10:42:17 [auto1.de] INFO: Saving data for GK53222: {'auction_closing_time': 1774714707.0, 'created_time': 1773776049.702604, 'last_price_update_time': 1774608137.715512}
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK53222') HTTP/1.1" 204 0
2026-03-27 10:42:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ba28a4f-6003-5c2d-9a1d-801c29d22cda with identifier: CN87800
2026-03-27 10:42:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ba28a4f-6003-5c2d-9a1d-801c29d22cda with identifier: CN87800
2026-03-27 10:42:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ba28a4f-6003-5c2d-9a1d-801c29d22cda with identifier: CN87800 to the API
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-28T16:44:16Z',
'fuel_type': 'diesel',
'id': '3ba28a4f-6003-5c2d-9a1d-801c29d22cda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN87800',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 125367,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-21',
'seller_name': None,
'title': 'BMW X5 sDrive 25d',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN87800%27 HTTP/1.1" 200 None
2026-03-27 10:42:18 [auto1.de] INFO: Saving data for CN87800: {'auction_closing_time': 1774716256.0, 'created_time': 1773399939.317202, 'last_price_update_time': 1774608138.183238}
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN87800') HTTP/1.1" 204 0
2026-03-27 10:42:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3 with identifier: XN26192
2026-03-27 10:42:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3 with identifier: XN26192
2026-03-27 10:42:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3 with identifier: XN26192 to the API
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:21:56Z',
'fuel_type': 'diesel',
'id': 'a5fedd6b-fc4e-5a7d-8ac7-e3230b6484e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN26192',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 228004,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-27',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
'transmission': 'manual',
'trim': 'Highline BlueMotion',
'year': 2012}
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26192%27 HTTP/1.1" 200 None
2026-03-27 10:42:18 [auto1.de] INFO: Saving data for XN26192: {'auction_closing_time': 1774714916.0, 'created_time': 1773830829.297293, 'last_price_update_time': 1774608138.586411}
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN26192') HTTP/1.1" 204 0
2026-03-27 10:42:18 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK41748%27 HTTP/1.1" 200 None
2026-03-27 10:42:18 [auto1.de] INFO: Scrape type for GK41748: 2
2026-03-27 10:42:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d14ed150-6733-590a-9ba9-8133d7a03997 with identifier: GK41748
2026-03-27 10:42:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d14ed150-6733-590a-9ba9-8133d7a03997 with scrape type 2
2026-03-27 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d14ed150-6733-590a-9ba9-8133d7a03997 with scrape type 2
2026-03-27 10:42:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d14ed150-6733-590a-9ba9-8133d7a03997, identifier: GK41748
2026-03-27 10:42:18 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-27 10:42:18 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-27 10:42:18 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF34057%27 HTTP/1.1" 200 None
2026-03-27 10:42:18 [auto1.de] INFO: Scrape type for NF34057: 2
2026-03-27 10:42:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2428d9c9-6af0-539c-9ca4-87e6c0e8a139 with identifier: NF34057
2026-03-27 10:42:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2428d9c9-6af0-539c-9ca4-87e6c0e8a139 with scrape type 2
2026-03-27 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2428d9c9-6af0-539c-9ca4-87e6c0e8a139 with scrape type 2
2026-03-27 10:42:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2428d9c9-6af0-539c-9ca4-87e6c0e8a139, identifier: NF34057
2026-03-27 10:42:18 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ09014%27 HTTP/1.1" 200 None
2026-03-27 10:42:18 [auto1.de] INFO: Scrape type for TJ09014: 2
2026-03-27 10:42:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc1c64b5-5d1d-515f-935e-e862c2967eb0 with identifier: TJ09014
2026-03-27 10:42:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc1c64b5-5d1d-515f-935e-e862c2967eb0 with scrape type 2
2026-03-27 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc1c64b5-5d1d-515f-935e-e862c2967eb0 with scrape type 2
2026-03-27 10:42:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc1c64b5-5d1d-515f-935e-e862c2967eb0, identifier: TJ09014
2026-03-27 10:42:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d14ed150-6733-590a-9ba9-8133d7a03997 with identifier: GK41748
2026-03-27 10:42:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d14ed150-6733-590a-9ba9-8133d7a03997 with identifier: GK41748
2026-03-27 10:42:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d14ed150-6733-590a-9ba9-8133d7a03997 with identifier: GK41748 to the API
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 192,
'expiration_date': '2026-03-28T16:30:44Z',
'fuel_type': 'petrol',
'id': 'd14ed150-6733-590a-9ba9-8133d7a03997',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK41748',
'listing': 'auction',
'make': 'Toyota',
'model': 'Corolla',
'odometer': 217622,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-09-09',
'seller_name': None,
'title': 'Toyota Corolla 1.8 Compact TS',
'transmission': 'manual',
'trim': 'Compact TS',
'year': 2002}
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK41748%27 HTTP/1.1" 200 None
2026-03-27 10:42:19 [auto1.de] INFO: Saving data for GK41748: {'auction_closing_time': 1774715444.0, 'created_time': 1773302964.758846, 'last_price_update_time': 1774608139.295768}
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK41748') HTTP/1.1" 204 0
2026-03-27 10:42:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2428d9c9-6af0-539c-9ca4-87e6c0e8a139 with identifier: NF34057
2026-03-27 10:42:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2428d9c9-6af0-539c-9ca4-87e6c0e8a139 with identifier: NF34057
2026-03-27 10:42:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2428d9c9-6af0-539c-9ca4-87e6c0e8a139 with identifier: NF34057 to the API
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:25:43Z',
'fuel_type': 'diesel',
'id': '2428d9c9-6af0-539c-9ca4-87e6c0e8a139',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF34057',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 98049,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-23',
'seller_name': None,
'title': 'Mercedes-Benz Vito 110 CDI lang',
'transmission': 'automatic',
'trim': 'lang',
'year': 2013}
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF34057%27 HTTP/1.1" 200 None
2026-03-27 10:42:19 [auto1.de] INFO: Saving data for NF34057: {'auction_closing_time': 1774715143.0, 'created_time': 1773427875.674524, 'last_price_update_time': 1774608139.67054}
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF34057') HTTP/1.1" 204 0
2026-03-27 10:42:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc1c64b5-5d1d-515f-935e-e862c2967eb0 with identifier: TJ09014
2026-03-27 10:42:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc1c64b5-5d1d-515f-935e-e862c2967eb0 with identifier: TJ09014
2026-03-27 10:42:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc1c64b5-5d1d-515f-935e-e862c2967eb0 with identifier: TJ09014 to the API
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-28T16:22:33Z',
'fuel_type': 'gas',
'id': 'bc1c64b5-5d1d-515f-935e-e862c2967eb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ09014',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 18617,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-16',
'seller_name': None,
'title': 'Dacia Duster 1.0 TCe LPG Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2020}
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ09014%27 HTTP/1.1" 200 None
2026-03-27 10:42:20 [auto1.de] INFO: Saving data for TJ09014: {'auction_closing_time': 1774714953.0, 'created_time': 1774293516.267784, 'last_price_update_time': 1774608140.128713}
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ09014') HTTP/1.1" 204 0
2026-03-27 10:42:20 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-27 10:42:20 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-27 10:42:20 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-27 10:42:20 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-27 10:42:20 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-27 10:42:20 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC65519%27 HTTP/1.1" 200 None
2026-03-27 10:42:20 [auto1.de] INFO: Scrape type for NC65519: 2
2026-03-27 10:42:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1457ace6-b797-5441-a90c-31a7ea8eaed2 with identifier: NC65519
2026-03-27 10:42:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1457ace6-b797-5441-a90c-31a7ea8eaed2 with scrape type 2
2026-03-27 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1457ace6-b797-5441-a90c-31a7ea8eaed2 with scrape type 2
2026-03-27 10:42:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1457ace6-b797-5441-a90c-31a7ea8eaed2, identifier: NC65519
2026-03-27 10:42:20 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-27 10:42:20 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW17852%27 HTTP/1.1" 200 None
2026-03-27 10:42:20 [auto1.de] INFO: Scrape type for AW17852: 2
2026-03-27 10:42:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50c8e0ef-26cb-54d3-8803-0458b7249a7d with identifier: AW17852
2026-03-27 10:42:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50c8e0ef-26cb-54d3-8803-0458b7249a7d with scrape type 2
2026-03-27 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50c8e0ef-26cb-54d3-8803-0458b7249a7d with scrape type 2
2026-03-27 10:42:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50c8e0ef-26cb-54d3-8803-0458b7249a7d, identifier: AW17852
2026-03-27 10:42:20 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-27 10:42:20 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX72393%27 HTTP/1.1" 200 None
2026-03-27 10:42:20 [auto1.de] INFO: Scrape type for NX72393: 0
2026-03-27 10:42:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1457ace6-b797-5441-a90c-31a7ea8eaed2 with identifier: NC65519
2026-03-27 10:42:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1457ace6-b797-5441-a90c-31a7ea8eaed2 with identifier: NC65519
2026-03-27 10:42:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1457ace6-b797-5441-a90c-31a7ea8eaed2 with identifier: NC65519 to the API
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:45:09Z',
'fuel_type': 'petrol',
'id': '1457ace6-b797-5441-a90c-31a7ea8eaed2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC65519',
'listing': 'auction',
'make': 'Nissan',
'model': 'Pulsar',
'odometer': 117681,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-26',
'seller_name': None,
'title': 'Nissan Pulsar 1.6 Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2016}
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC65519%27 HTTP/1.1" 200 None
2026-03-27 10:42:20 [auto1.de] INFO: Saving data for NC65519: {'auction_closing_time': 1774716309.0, 'created_time': 1773308158.323328, 'last_price_update_time': 1774608140.901356}
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC65519') HTTP/1.1" 204 0
2026-03-27 10:42:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50c8e0ef-26cb-54d3-8803-0458b7249a7d with identifier: AW17852
2026-03-27 10:42:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50c8e0ef-26cb-54d3-8803-0458b7249a7d with identifier: AW17852
2026-03-27 10:42:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50c8e0ef-26cb-54d3-8803-0458b7249a7d with identifier: AW17852 to the API
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:42:23Z',
'fuel_type': 'diesel',
'id': '50c8e0ef-26cb-54d3-8803-0458b7249a7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW17852',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 169832,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-29',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2022}
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW17852%27 HTTP/1.1" 200 None
2026-03-27 10:42:21 [auto1.de] INFO: Saving data for AW17852: {'auction_closing_time': 1774716143.0, 'created_time': 1774292936.926799, 'last_price_update_time': 1774608141.533558}
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW17852') HTTP/1.1" 204 0
2026-03-27 10:42:21 [auto1.de] INFO: Found listing with ID: LB73186
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB73186%27 HTTP/1.1" 200 None
2026-03-27 10:42:21 [auto1.de] INFO: Scrape type for LB73186: 0
2026-03-27 10:42:21 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB73740%27 HTTP/1.1" 200 None
2026-03-27 10:42:21 [auto1.de] INFO: Scrape type for WB73740: 0
2026-03-27 10:42:21 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-27 10:42:21 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-27 10:42:21 [auto1.de] INFO: Found listing with ID: ZN72039
2026-03-27 10:42:21 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS21206%27 HTTP/1.1" 200 None
2026-03-27 10:42:21 [auto1.de] INFO: Scrape type for YS21206: 2
2026-03-27 10:42:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4009654-c333-5c68-9d3a-c1b1b92c5cfa with identifier: YS21206
2026-03-27 10:42:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4009654-c333-5c68-9d3a-c1b1b92c5cfa with scrape type 2
2026-03-27 10:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4009654-c333-5c68-9d3a-c1b1b92c5cfa with scrape type 2
2026-03-27 10:42:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4009654-c333-5c68-9d3a-c1b1b92c5cfa, identifier: YS21206
2026-03-27 10:42:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4009654-c333-5c68-9d3a-c1b1b92c5cfa with identifier: YS21206
2026-03-27 10:42:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4009654-c333-5c68-9d3a-c1b1b92c5cfa with identifier: YS21206
2026-03-27 10:42:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4009654-c333-5c68-9d3a-c1b1b92c5cfa with identifier: YS21206 to the API
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:01:38Z',
'fuel_type': 'diesel',
'id': 'f4009654-c333-5c68-9d3a-c1b1b92c5cfa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS21206',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand Tourneo Connect',
'odometer': 251704,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-06',
'seller_name': None,
'title': 'Ford Grand Tourneo Connect 1.5 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2016}
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS21206%27 HTTP/1.1" 200 None
2026-03-27 10:42:22 [auto1.de] INFO: Saving data for YS21206: {'auction_closing_time': 1774713698.0, 'created_time': 1774292686.376603, 'last_price_update_time': 1774608142.268724}
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS21206') HTTP/1.1" 204 0
2026-03-27 10:42:22 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-27 10:42:22 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-27 10:42:22 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-27 10:42:22 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK30866%27 HTTP/1.1" 200 None
2026-03-27 10:42:22 [auto1.de] INFO: Scrape type for ZK30866: 2
2026-03-27 10:42:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08 with identifier: ZK30866
2026-03-27 10:42:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08 with scrape type 2
2026-03-27 10:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08 with scrape type 2
2026-03-27 10:42:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08, identifier: ZK30866
2026-03-27 10:42:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08 with identifier: ZK30866
2026-03-27 10:42:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08 with identifier: ZK30866
2026-03-27 10:42:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b023f2a-c1e8-51e6-8a83-aa8e03e50f08 with identifier: ZK30866 to the API
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 305,
'expiration_date': '2026-03-28T16:37:10Z',
'fuel_type': 'petrol',
'id': '0b023f2a-c1e8-51e6-8a83-aa8e03e50f08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK30866',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 97552,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-09-12',
'seller_name': None,
'title': 'BMW 3er 335i',
'transmission': 'automatic',
'trim': '',
'year': 2007}
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK30866%27 HTTP/1.1" 200 None
2026-03-27 10:42:22 [auto1.de] INFO: Saving data for ZK30866: {'auction_closing_time': 1774715830.0, 'created_time': 1773686588.289577, 'last_price_update_time': 1774608142.976037}
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK30866') HTTP/1.1" 204 0
2026-03-27 10:42:22 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC63070%27 HTTP/1.1" 200 None
2026-03-27 10:42:23 [auto1.de] INFO: Scrape type for VC63070: 2
2026-03-27 10:42:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2d28c24-e7ec-502e-bf8a-e3cad0aded94 with identifier: VC63070
2026-03-27 10:42:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2d28c24-e7ec-502e-bf8a-e3cad0aded94 with scrape type 2
2026-03-27 10:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2d28c24-e7ec-502e-bf8a-e3cad0aded94 with scrape type 2
2026-03-27 10:42:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2d28c24-e7ec-502e-bf8a-e3cad0aded94, identifier: VC63070
2026-03-27 10:42:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2d28c24-e7ec-502e-bf8a-e3cad0aded94 with identifier: VC63070
2026-03-27 10:42:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2d28c24-e7ec-502e-bf8a-e3cad0aded94 with identifier: VC63070
2026-03-27 10:42:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2d28c24-e7ec-502e-bf8a-e3cad0aded94 with identifier: VC63070 to the API
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:42:49Z',
'fuel_type': 'diesel',
'id': 'a2d28c24-e7ec-502e-bf8a-e3cad0aded94',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC63070',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 121427,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-17',
'seller_name': None,
'title': 'Hyundai Tucson 1.7 CRDi Trend blue 2WD',
'transmission': 'manual',
'trim': 'Trend blue 2WD',
'year': 2018}
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC63070%27 HTTP/1.1" 200 None
2026-03-27 10:42:23 [auto1.de] INFO: Saving data for VC63070: {'auction_closing_time': 1774716169.0, 'created_time': 1773775438.495913, 'last_price_update_time': 1774608143.608469}
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC63070') HTTP/1.1" 204 0
2026-03-27 10:42:23 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52465%27 HTTP/1.1" 200 None
2026-03-27 10:42:23 [auto1.de] INFO: Scrape type for RS52465: 2
2026-03-27 10:42:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 872c3017-0b3c-54e7-983e-91275867c156 with identifier: RS52465
2026-03-27 10:42:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 872c3017-0b3c-54e7-983e-91275867c156 with scrape type 2
2026-03-27 10:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 872c3017-0b3c-54e7-983e-91275867c156 with scrape type 2
2026-03-27 10:42:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 872c3017-0b3c-54e7-983e-91275867c156, identifier: RS52465
2026-03-27 10:42:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 872c3017-0b3c-54e7-983e-91275867c156 with identifier: RS52465
2026-03-27 10:42:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 872c3017-0b3c-54e7-983e-91275867c156 with identifier: RS52465
2026-03-27 10:42:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 872c3017-0b3c-54e7-983e-91275867c156 with identifier: RS52465 to the API
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 367,
'expiration_date': '2026-03-28T16:57:22Z',
'fuel_type': 'petrol',
'id': '872c3017-0b3c-54e7-983e-91275867c156',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS52465',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 109869,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-02',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 43 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2017}
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52465%27 HTTP/1.1" 200 None
2026-03-27 10:42:24 [auto1.de] INFO: Saving data for RS52465: {'auction_closing_time': 1774717042.0, 'created_time': 1773427714.732821, 'last_price_update_time': 1774608144.360927}
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS52465') HTTP/1.1" 204 0
2026-03-27 10:42:24 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93583%27 HTTP/1.1" 200 None
2026-03-27 10:42:24 [auto1.de] INFO: Scrape type for FK93583: 2
2026-03-27 10:42:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88388082-6f36-5a88-82b9-af9197ffe1f9 with identifier: FK93583
2026-03-27 10:42:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88388082-6f36-5a88-82b9-af9197ffe1f9 with scrape type 2
2026-03-27 10:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88388082-6f36-5a88-82b9-af9197ffe1f9 with scrape type 2
2026-03-27 10:42:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88388082-6f36-5a88-82b9-af9197ffe1f9, identifier: FK93583
2026-03-27 10:42:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88388082-6f36-5a88-82b9-af9197ffe1f9 with identifier: FK93583
2026-03-27 10:42:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88388082-6f36-5a88-82b9-af9197ffe1f9 with identifier: FK93583
2026-03-27 10:42:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88388082-6f36-5a88-82b9-af9197ffe1f9 with identifier: FK93583 to the API
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:16:14Z',
'fuel_type': 'petrol',
'id': '88388082-6f36-5a88-82b9-af9197ffe1f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK93583',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 165875,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-27',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2017}
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93583%27 HTTP/1.1" 200 None
2026-03-27 10:42:24 [auto1.de] INFO: Saving data for FK93583: {'auction_closing_time': 1774714574.0, 'created_time': 1773776244.391065, 'last_price_update_time': 1774608144.925736}
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK93583') HTTP/1.1" 204 0
2026-03-27 10:42:24 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-27 10:42:24 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF25460%27 HTTP/1.1" 200 None
2026-03-27 10:42:24 [auto1.de] INFO: Scrape type for YF25460: 2
2026-03-27 10:42:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db0a03e-3685-57f7-b0de-67562b6f97a2 with identifier: YF25460
2026-03-27 10:42:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db0a03e-3685-57f7-b0de-67562b6f97a2 with scrape type 2
2026-03-27 10:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3db0a03e-3685-57f7-b0de-67562b6f97a2 with scrape type 2
2026-03-27 10:42:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3db0a03e-3685-57f7-b0de-67562b6f97a2, identifier: YF25460
2026-03-27 10:42:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3db0a03e-3685-57f7-b0de-67562b6f97a2 with identifier: YF25460
2026-03-27 10:42:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3db0a03e-3685-57f7-b0de-67562b6f97a2 with identifier: YF25460
2026-03-27 10:42:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3db0a03e-3685-57f7-b0de-67562b6f97a2 with identifier: YF25460 to the API
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:45:33Z',
'fuel_type': 'petrol',
'id': '3db0a03e-3685-57f7-b0de-67562b6f97a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF25460',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira',
'odometer': 122225,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-15',
'seller_name': None,
'title': 'Opel Zafira 1.8 Family Plus',
'transmission': 'manual',
'trim': 'Family Plus',
'year': 2012}
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF25460%27 HTTP/1.1" 200 None
2026-03-27 10:42:25 [auto1.de] INFO: Saving data for YF25460: {'auction_closing_time': 1774716333.0, 'created_time': 1773773704.188081, 'last_price_update_time': 1774608145.527369}
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF25460') HTTP/1.1" 204 0
2026-03-27 10:42:25 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48598%27 HTTP/1.1" 200 None
2026-03-27 10:42:25 [auto1.de] INFO: Scrape type for YT48598: 2
2026-03-27 10:42:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc852cd7-f6d5-5406-addd-ead2b27c816b with identifier: YT48598
2026-03-27 10:42:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc852cd7-f6d5-5406-addd-ead2b27c816b with scrape type 2
2026-03-27 10:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc852cd7-f6d5-5406-addd-ead2b27c816b with scrape type 2
2026-03-27 10:42:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc852cd7-f6d5-5406-addd-ead2b27c816b, identifier: YT48598
2026-03-27 10:42:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc852cd7-f6d5-5406-addd-ead2b27c816b with identifier: YT48598
2026-03-27 10:42:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc852cd7-f6d5-5406-addd-ead2b27c816b with identifier: YT48598
2026-03-27 10:42:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc852cd7-f6d5-5406-addd-ead2b27c816b with identifier: YT48598 to the API
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 455,
'expiration_date': '2026-03-28T16:30:31Z',
'fuel_type': 'petrol',
'id': 'cc852cd7-f6d5-5406-addd-ead2b27c816b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT48598',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 228128,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-11',
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 500 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2013}
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48598%27 HTTP/1.1" 200 None
2026-03-27 10:42:26 [auto1.de] INFO: Saving data for YT48598: {'auction_closing_time': 1774715431.0, 'created_time': 1773688627.535516, 'last_price_update_time': 1774608146.141117}
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT48598') HTTP/1.1" 204 0
2026-03-27 10:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:26 [auto1.de] INFO: Found listing with ID: ME69590
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME69590%27 HTTP/1.1" 200 None
2026-03-27 10:42:26 [auto1.de] INFO: Scrape type for ME69590: 1
2026-03-27 10:42:26 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY70185%27 HTTP/1.1" 200 None
2026-03-27 10:42:26 [auto1.de] INFO: Scrape type for XY70185: 2
2026-03-27 10:42:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4f42c70-f1cd-555e-931f-ce1c7966d398 with identifier: XY70185
2026-03-27 10:42:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4f42c70-f1cd-555e-931f-ce1c7966d398 with scrape type 2
2026-03-27 10:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4f42c70-f1cd-555e-931f-ce1c7966d398 with scrape type 2
2026-03-27 10:42:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4f42c70-f1cd-555e-931f-ce1c7966d398, identifier: XY70185
2026-03-27 10:42:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4f42c70-f1cd-555e-931f-ce1c7966d398 with identifier: XY70185
2026-03-27 10:42:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4f42c70-f1cd-555e-931f-ce1c7966d398 with identifier: XY70185
2026-03-27 10:42:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4f42c70-f1cd-555e-931f-ce1c7966d398 with identifier: XY70185 to the API
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:09:24Z',
'fuel_type': 'diesel',
'id': 'b4f42c70-f1cd-555e-931f-ce1c7966d398',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY70185',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 153718,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-01',
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI Style Plus',
'transmission': 'automatic',
'trim': 'Style Plus',
'year': 2016}
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY70185%27 HTTP/1.1" 200 None
2026-03-27 10:42:26 [auto1.de] INFO: Saving data for XY70185: {'auction_closing_time': 1774714164.0, 'created_time': 1773830936.852536, 'last_price_update_time': 1774608146.774678}
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY70185') HTTP/1.1" 204 0
2026-03-27 10:42:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:26 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-27 10:42:26 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM28513%27 HTTP/1.1" 200 None
2026-03-27 10:42:26 [auto1.de] INFO: Scrape type for NM28513: 2
2026-03-27 10:42:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e480f60-9e0a-54e9-9f8c-1187b63333da with identifier: NM28513
2026-03-27 10:42:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e480f60-9e0a-54e9-9f8c-1187b63333da with scrape type 2
2026-03-27 10:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e480f60-9e0a-54e9-9f8c-1187b63333da with scrape type 2
2026-03-27 10:42:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e480f60-9e0a-54e9-9f8c-1187b63333da, identifier: NM28513
2026-03-27 10:42:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e480f60-9e0a-54e9-9f8c-1187b63333da with identifier: NM28513
2026-03-27 10:42:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e480f60-9e0a-54e9-9f8c-1187b63333da with identifier: NM28513
2026-03-27 10:42:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e480f60-9e0a-54e9-9f8c-1187b63333da with identifier: NM28513 to the API
2026-03-27 10:42:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:01:51Z',
'fuel_type': 'petrol',
'id': '1e480f60-9e0a-54e9-9f8c-1187b63333da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM28513',
'listing': 'auction',
'make': 'Ford',
'model': 'B-Max',
'odometer': 70700,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-05',
'seller_name': None,
'title': 'Ford B-Max 1.6 Ti-VCT Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2015}
2026-03-27 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM28513%27 HTTP/1.1" 200 None
2026-03-27 10:42:27 [auto1.de] INFO: Saving data for NM28513: {'auction_closing_time': 1774713711.0, 'created_time': 1773830816.714578, 'last_price_update_time': 1774608147.405649}
2026-03-27 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM28513') HTTP/1.1" 204 0
2026-03-27 10:42:27 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 10529 | hits on page: 40
2026-03-27 10:42:27 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-27 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW59624%27 HTTP/1.1" 200 None
2026-03-27 10:42:27 [auto1.de] INFO: Scrape type for YW59624: 2
2026-03-27 10:42:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5 with identifier: YW59624
2026-03-27 10:42:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5 with scrape type 2
2026-03-27 10:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5 with scrape type 2
2026-03-27 10:42:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5, identifier: YW59624
2026-03-27 10:42:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5 with identifier: YW59624
2026-03-27 10:42:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5 with identifier: YW59624
2026-03-27 10:42:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b0691bd-ee90-5b91-b7ad-c61d5361e0a5 with identifier: YW59624 to the API
2026-03-27 10:42:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:59:57Z',
'fuel_type': 'diesel',
'id': '3b0691bd-ee90-5b91-b7ad-c61d5361e0a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW59624',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 127313,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-23',
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2017}
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW59624%27 HTTP/1.1" 200 None
2026-03-27 10:42:29 [auto1.de] INFO: Saving data for YW59624: {'auction_closing_time': 1774717197.0, 'created_time': 1773305608.460951, 'last_price_update_time': 1774608149.0322}
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW59624') HTTP/1.1" 204 0
2026-03-27 10:42:29 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK50983%27 HTTP/1.1" 200 None
2026-03-27 10:42:29 [auto1.de] INFO: Scrape type for LK50983: 2
2026-03-27 10:42:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dcdbe8d-42d1-5742-855a-630cd76717f4 with identifier: LK50983
2026-03-27 10:42:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dcdbe8d-42d1-5742-855a-630cd76717f4 with scrape type 2
2026-03-27 10:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8dcdbe8d-42d1-5742-855a-630cd76717f4 with scrape type 2
2026-03-27 10:42:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8dcdbe8d-42d1-5742-855a-630cd76717f4, identifier: LK50983
2026-03-27 10:42:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:29 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-27 10:42:29 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG82987%27 HTTP/1.1" 200 None
2026-03-27 10:42:29 [auto1.de] INFO: Scrape type for RG82987: 2
2026-03-27 10:42:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bedadf5a-19d1-5b22-86f1-abf3d074c0b4 with identifier: RG82987
2026-03-27 10:42:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bedadf5a-19d1-5b22-86f1-abf3d074c0b4 with scrape type 2
2026-03-27 10:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bedadf5a-19d1-5b22-86f1-abf3d074c0b4 with scrape type 2
2026-03-27 10:42:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bedadf5a-19d1-5b22-86f1-abf3d074c0b4, identifier: RG82987
2026-03-27 10:42:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8dcdbe8d-42d1-5742-855a-630cd76717f4 with identifier: LK50983
2026-03-27 10:42:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8dcdbe8d-42d1-5742-855a-630cd76717f4 with identifier: LK50983
2026-03-27 10:42:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8dcdbe8d-42d1-5742-855a-630cd76717f4 with identifier: LK50983 to the API
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-28T16:26:45Z',
'fuel_type': 'diesel',
'id': '8dcdbe8d-42d1-5742-855a-630cd76717f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK50983',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 296859,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-05-02',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.5 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2004}
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK50983%27 HTTP/1.1" 200 None
2026-03-27 10:42:29 [auto1.de] INFO: Saving data for LK50983: {'auction_closing_time': 1774715205.0, 'created_time': 1774291163.056043, 'last_price_update_time': 1774608149.793542}
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK50983') HTTP/1.1" 204 0
2026-03-27 10:42:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bedadf5a-19d1-5b22-86f1-abf3d074c0b4 with identifier: RG82987
2026-03-27 10:42:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bedadf5a-19d1-5b22-86f1-abf3d074c0b4 with identifier: RG82987
2026-03-27 10:42:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bedadf5a-19d1-5b22-86f1-abf3d074c0b4 with identifier: RG82987 to the API
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:17:03Z',
'fuel_type': 'diesel',
'id': 'bedadf5a-19d1-5b22-86f1-abf3d074c0b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG82987',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 309702,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-05',
'seller_name': None,
'title': 'Audi A4 2.0 TDIe Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2011}
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG82987%27 HTTP/1.1" 200 None
2026-03-27 10:42:30 [auto1.de] INFO: Saving data for RG82987: {'auction_closing_time': 1774714623.0, 'created_time': 1773400574.297106, 'last_price_update_time': 1774608150.342611}
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG82987') HTTP/1.1" 204 0
2026-03-27 10:42:30 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL89727%27 HTTP/1.1" 200 None
2026-03-27 10:42:30 [auto1.de] INFO: Scrape type for PL89727: 2
2026-03-27 10:42:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7bb5e19-d667-5aa4-b5b4-efe0be29c07b with identifier: PL89727
2026-03-27 10:42:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7bb5e19-d667-5aa4-b5b4-efe0be29c07b with scrape type 2
2026-03-27 10:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7bb5e19-d667-5aa4-b5b4-efe0be29c07b with scrape type 2
2026-03-27 10:42:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7bb5e19-d667-5aa4-b5b4-efe0be29c07b, identifier: PL89727
2026-03-27 10:42:30 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG28857%27 HTTP/1.1" 200 None
2026-03-27 10:42:30 [auto1.de] INFO: Scrape type for MG28857: 2
2026-03-27 10:42:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb7b2ff8-dfd6-5474-a272-fc07e37979fd with identifier: MG28857
2026-03-27 10:42:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb7b2ff8-dfd6-5474-a272-fc07e37979fd with scrape type 2
2026-03-27 10:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb7b2ff8-dfd6-5474-a272-fc07e37979fd with scrape type 2
2026-03-27 10:42:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb7b2ff8-dfd6-5474-a272-fc07e37979fd, identifier: MG28857
2026-03-27 10:42:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7bb5e19-d667-5aa4-b5b4-efe0be29c07b with identifier: PL89727
2026-03-27 10:42:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7bb5e19-d667-5aa4-b5b4-efe0be29c07b with identifier: PL89727
2026-03-27 10:42:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7bb5e19-d667-5aa4-b5b4-efe0be29c07b with identifier: PL89727 to the API
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 195,
'expiration_date': '2026-03-28T16:09:37Z',
'fuel_type': 'diesel',
'id': 'a7bb5e19-d667-5aa4-b5b4-efe0be29c07b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL89727',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 99632,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-27',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2017}
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL89727%27 HTTP/1.1" 200 None
2026-03-27 10:42:30 [auto1.de] INFO: Saving data for PL89727: {'auction_closing_time': 1774714177.0, 'created_time': 1773400140.066234, 'last_price_update_time': 1774608150.943854}
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL89727') HTTP/1.1" 204 0
2026-03-27 10:42:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb7b2ff8-dfd6-5474-a272-fc07e37979fd with identifier: MG28857
2026-03-27 10:42:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb7b2ff8-dfd6-5474-a272-fc07e37979fd with identifier: MG28857
2026-03-27 10:42:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb7b2ff8-dfd6-5474-a272-fc07e37979fd with identifier: MG28857 to the API
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 440,
'expiration_date': '2026-03-28T16:20:24Z',
'fuel_type': 'petrol',
'id': 'bb7b2ff8-dfd6-5474-a272-fc07e37979fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG28857',
'listing': 'auction',
'make': 'Porsche',
'model': 'Cayenne',
'odometer': 178285,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-01',
'seller_name': None,
'title': 'Porsche Cayenne GTS',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG28857%27 HTTP/1.1" 200 None
2026-03-27 10:42:31 [auto1.de] INFO: Saving data for MG28857: {'auction_closing_time': 1774714824.0, 'created_time': 1773340408.249628, 'last_price_update_time': 1774608151.588319}
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG28857') HTTP/1.1" 204 0
2026-03-27 10:42:31 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF84485%27 HTTP/1.1" 200 None
2026-03-27 10:42:31 [auto1.de] INFO: Scrape type for EF84485: 2
2026-03-27 10:42:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c982a3e-2731-5426-8c0b-064a6c424c1f with identifier: EF84485
2026-03-27 10:42:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c982a3e-2731-5426-8c0b-064a6c424c1f with scrape type 2
2026-03-27 10:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c982a3e-2731-5426-8c0b-064a6c424c1f with scrape type 2
2026-03-27 10:42:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c982a3e-2731-5426-8c0b-064a6c424c1f, identifier: EF84485
2026-03-27 10:42:31 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT86021%27 HTTP/1.1" 200 None
2026-03-27 10:42:31 [auto1.de] INFO: Scrape type for JT86021: 2
2026-03-27 10:42:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e47556c7-d40c-5641-926a-3f9b6726671f with identifier: JT86021
2026-03-27 10:42:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e47556c7-d40c-5641-926a-3f9b6726671f with scrape type 2
2026-03-27 10:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e47556c7-d40c-5641-926a-3f9b6726671f with scrape type 2
2026-03-27 10:42:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e47556c7-d40c-5641-926a-3f9b6726671f, identifier: JT86021
2026-03-27 10:42:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c982a3e-2731-5426-8c0b-064a6c424c1f with identifier: EF84485
2026-03-27 10:42:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c982a3e-2731-5426-8c0b-064a6c424c1f with identifier: EF84485
2026-03-27 10:42:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c982a3e-2731-5426-8c0b-064a6c424c1f with identifier: EF84485 to the API
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:22:15Z',
'fuel_type': 'diesel',
'id': '0c982a3e-2731-5426-8c0b-064a6c424c1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF84485',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-05-31',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 220 CDI Ambiente',
'transmission': 'automatic',
'trim': 'Ambiente',
'year': 2001}
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF84485%27 HTTP/1.1" 200 None
2026-03-27 10:42:32 [auto1.de] INFO: Saving data for EF84485: {'auction_closing_time': 1774714935.0, 'created_time': 1773303603.844099, 'last_price_update_time': 1774608152.19389}
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF84485') HTTP/1.1" 204 0
2026-03-27 10:42:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e47556c7-d40c-5641-926a-3f9b6726671f with identifier: JT86021
2026-03-27 10:42:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e47556c7-d40c-5641-926a-3f9b6726671f with identifier: JT86021
2026-03-27 10:42:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e47556c7-d40c-5641-926a-3f9b6726671f with identifier: JT86021 to the API
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 300,
'expiration_date': '2026-03-28T16:26:44Z',
'fuel_type': 'diesel',
'id': 'e47556c7-d40c-5641-926a-3f9b6726671f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT86021',
'listing': 'auction',
'make': 'Jaguar',
'model': 'XF',
'odometer': 166403,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-28',
'seller_name': None,
'title': 'Jaguar XF 30d Prestige',
'transmission': 'automatic',
'trim': 'Prestige',
'year': 2016}
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT86021%27 HTTP/1.1" 200 None
2026-03-27 10:42:32 [auto1.de] INFO: Saving data for JT86021: {'auction_closing_time': 1774715204.0, 'created_time': 1773302801.647291, 'last_price_update_time': 1774608152.587266}
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT86021') HTTP/1.1" 204 0
2026-03-27 10:42:32 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-27 10:42:32 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-27 10:42:32 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-27 10:42:32 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-27 10:42:32 [auto1.de] INFO: Found listing with ID: TZ19731
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ19731%27 HTTP/1.1" 200 None
2026-03-27 10:42:32 [auto1.de] INFO: Scrape type for TZ19731: 2
2026-03-27 10:42:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03ca61cb-fe0c-5cfb-a5d5-a86d44f1a753 with identifier: TZ19731
2026-03-27 10:42:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03ca61cb-fe0c-5cfb-a5d5-a86d44f1a753 with scrape type 2
2026-03-27 10:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03ca61cb-fe0c-5cfb-a5d5-a86d44f1a753 with scrape type 2
2026-03-27 10:42:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03ca61cb-fe0c-5cfb-a5d5-a86d44f1a753, identifier: TZ19731
2026-03-27 10:42:32 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-27 10:42:32 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-27 10:42:32 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-27 10:42:32 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL48246%27 HTTP/1.1" 200 None
2026-03-27 10:42:32 [auto1.de] INFO: Scrape type for PL48246: 2
2026-03-27 10:42:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6 with identifier: PL48246
2026-03-27 10:42:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6 with scrape type 2
2026-03-27 10:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6 with scrape type 2
2026-03-27 10:42:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6, identifier: PL48246
2026-03-27 10:42:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03ca61cb-fe0c-5cfb-a5d5-a86d44f1a753 with identifier: TZ19731
2026-03-27 10:42:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03ca61cb-fe0c-5cfb-a5d5-a86d44f1a753 with identifier: TZ19731
2026-03-27 10:42:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03ca61cb-fe0c-5cfb-a5d5-a86d44f1a753 with identifier: TZ19731 to the API
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:50:41Z',
'fuel_type': 'diesel',
'id': '03ca61cb-fe0c-5cfb-a5d5-a86d44f1a753',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ19731',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 239148,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-07',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2016}
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ19731%27 HTTP/1.1" 200 None
2026-03-27 10:42:33 [auto1.de] INFO: Saving data for TZ19731: {'auction_closing_time': 1774716641.0, 'created_time': 1774034321.32657, 'last_price_update_time': 1774608153.242185}
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ19731') HTTP/1.1" 204 0
2026-03-27 10:42:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6 with identifier: PL48246
2026-03-27 10:42:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6 with identifier: PL48246
2026-03-27 10:42:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 016cb832-c848-5eb9-ad0c-7a8fe7acb9c6 with identifier: PL48246 to the API
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:57:37Z',
'fuel_type': 'petrol',
'id': '016cb832-c848-5eb9-ad0c-7a8fe7acb9c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL48246',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 82976,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-25',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 180 Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2019}
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL48246%27 HTTP/1.1" 200 None
2026-03-27 10:42:34 [auto1.de] INFO: Saving data for PL48246: {'auction_closing_time': 1774717057.0, 'created_time': 1772543840.915684, 'last_price_update_time': 1774608154.108577}
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL48246') HTTP/1.1" 204 0
2026-03-27 10:42:34 [auto1.de] INFO: Found listing with ID: SP58738
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP58738%27 HTTP/1.1" 200 None
2026-03-27 10:42:34 [auto1.de] INFO: Scrape type for SP58738: 2
2026-03-27 10:42:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f74a6fe0-2110-5290-9e66-3f606decf6a8 with identifier: SP58738
2026-03-27 10:42:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f74a6fe0-2110-5290-9e66-3f606decf6a8 with scrape type 2
2026-03-27 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f74a6fe0-2110-5290-9e66-3f606decf6a8 with scrape type 2
2026-03-27 10:42:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f74a6fe0-2110-5290-9e66-3f606decf6a8, identifier: SP58738
2026-03-27 10:42:34 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-27 10:42:34 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91854%27 HTTP/1.1" 200 None
2026-03-27 10:42:34 [auto1.de] INFO: Scrape type for LC91854: 1
2026-03-27 10:42:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f74a6fe0-2110-5290-9e66-3f606decf6a8 with identifier: SP58738
2026-03-27 10:42:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f74a6fe0-2110-5290-9e66-3f606decf6a8 with identifier: SP58738
2026-03-27 10:42:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f74a6fe0-2110-5290-9e66-3f606decf6a8 with identifier: SP58738 to the API
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:54:00Z',
'fuel_type': 'petrol',
'id': 'f74a6fe0-2110-5290-9e66-3f606decf6a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP58738',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 92765,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-15',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2018}
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP58738%27 HTTP/1.1" 200 None
2026-03-27 10:42:34 [auto1.de] INFO: Saving data for SP58738: {'auction_closing_time': 1774716840.0, 'created_time': 1773224305.397775, 'last_price_update_time': 1774608154.832134}
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP58738') HTTP/1.1" 204 0
2026-03-27 10:42:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME69590/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:34 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-27 10:42:34 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-27 10:42:34 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW82123%27 HTTP/1.1" 200 None
2026-03-27 10:42:34 [auto1.de] INFO: Scrape type for VW82123: 2
2026-03-27 10:42:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed0903ec-f813-5d44-879b-644bcd7995e1 with identifier: VW82123
2026-03-27 10:42:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed0903ec-f813-5d44-879b-644bcd7995e1 with scrape type 2
2026-03-27 10:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed0903ec-f813-5d44-879b-644bcd7995e1 with scrape type 2
2026-03-27 10:42:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed0903ec-f813-5d44-879b-644bcd7995e1, identifier: VW82123
2026-03-27 10:42:34 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF67159%27 HTTP/1.1" 200 None
2026-03-27 10:42:35 [auto1.de] INFO: Scrape type for ZF67159: 2
2026-03-27 10:42:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b2a7a36-a626-5768-a530-7b5257554d7a with identifier: ZF67159
2026-03-27 10:42:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b2a7a36-a626-5768-a530-7b5257554d7a with scrape type 2
2026-03-27 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b2a7a36-a626-5768-a530-7b5257554d7a with scrape type 2
2026-03-27 10:42:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b2a7a36-a626-5768-a530-7b5257554d7a, identifier: ZF67159
2026-03-27 10:42:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed0903ec-f813-5d44-879b-644bcd7995e1 with identifier: VW82123
2026-03-27 10:42:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed0903ec-f813-5d44-879b-644bcd7995e1 with identifier: VW82123
2026-03-27 10:42:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed0903ec-f813-5d44-879b-644bcd7995e1 with identifier: VW82123 to the API
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:47:05Z',
'fuel_type': 'diesel',
'id': 'ed0903ec-f813-5d44-879b-644bcd7995e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW82123',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 117396,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-29',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200 CDI Urban',
'transmission': 'manual',
'trim': 'Urban',
'year': 2015}
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW82123%27 HTTP/1.1" 200 None
2026-03-27 10:42:35 [auto1.de] INFO: Saving data for VW82123: {'auction_closing_time': 1774716425.0, 'created_time': 1773830887.628403, 'last_price_update_time': 1774608155.496254}
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW82123') HTTP/1.1" 204 0
2026-03-27 10:42:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b2a7a36-a626-5768-a530-7b5257554d7a with identifier: ZF67159
2026-03-27 10:42:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b2a7a36-a626-5768-a530-7b5257554d7a with identifier: ZF67159
2026-03-27 10:42:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b2a7a36-a626-5768-a530-7b5257554d7a with identifier: ZF67159 to the API
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-28T16:32:56Z',
'fuel_type': 'petrol',
'id': '2b2a7a36-a626-5768-a530-7b5257554d7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF67159',
'listing': 'auction',
'make': 'MINI',
'model': 'Clubman',
'odometer': 75424,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-01',
'seller_name': None,
'title': 'MINI Clubman John Cooper Works ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2021}
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF67159%27 HTTP/1.1" 200 None
2026-03-27 10:42:36 [auto1.de] INFO: Saving data for ZF67159: {'auction_closing_time': 1774715576.0, 'created_time': 1773400589.124209, 'last_price_update_time': 1774608156.044804}
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF67159') HTTP/1.1" 204 0
2026-03-27 10:42:36 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-27 10:42:36 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-27 10:42:36 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-27 10:42:36 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-27 10:42:36 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP50374%27 HTTP/1.1" 200 None
2026-03-27 10:42:36 [auto1.de] INFO: Scrape type for RP50374: 2
2026-03-27 10:42:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c083207e-7ddf-5cb1-a4f9-d1ad6373808a with identifier: RP50374
2026-03-27 10:42:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c083207e-7ddf-5cb1-a4f9-d1ad6373808a with scrape type 2
2026-03-27 10:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c083207e-7ddf-5cb1-a4f9-d1ad6373808a with scrape type 2
2026-03-27 10:42:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c083207e-7ddf-5cb1-a4f9-d1ad6373808a, identifier: RP50374
2026-03-27 10:42:36 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK50983%27 HTTP/1.1" 200 None
2026-03-27 10:42:36 [auto1.de] INFO: Scrape type for LK50983: 0
2026-03-27 10:42:36 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL89727%27 HTTP/1.1" 200 None
2026-03-27 10:42:36 [auto1.de] INFO: Scrape type for PL89727: 0
2026-03-27 10:42:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c083207e-7ddf-5cb1-a4f9-d1ad6373808a with identifier: RP50374
2026-03-27 10:42:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c083207e-7ddf-5cb1-a4f9-d1ad6373808a with identifier: RP50374
2026-03-27 10:42:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c083207e-7ddf-5cb1-a4f9-d1ad6373808a with identifier: RP50374 to the API
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:44:55Z',
'fuel_type': 'diesel',
'id': 'c083207e-7ddf-5cb1-a4f9-d1ad6373808a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP50374',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 321636,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-30',
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2014}
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP50374%27 HTTP/1.1" 200 None
2026-03-27 10:42:36 [auto1.de] INFO: Saving data for RP50374: {'auction_closing_time': 1774716295.0, 'created_time': 1773685901.74374, 'last_price_update_time': 1774608156.633237}
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP50374') HTTP/1.1" 204 0
2026-03-27 10:42:36 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD11713%27 HTTP/1.1" 200 None
2026-03-27 10:42:36 [auto1.de] INFO: Scrape type for XD11713: 2
2026-03-27 10:42:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71a0007e-82fc-524f-8c93-a1303c8d44ec with identifier: XD11713
2026-03-27 10:42:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71a0007e-82fc-524f-8c93-a1303c8d44ec with scrape type 2
2026-03-27 10:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71a0007e-82fc-524f-8c93-a1303c8d44ec with scrape type 2
2026-03-27 10:42:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71a0007e-82fc-524f-8c93-a1303c8d44ec, identifier: XD11713
2026-03-27 10:42:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71a0007e-82fc-524f-8c93-a1303c8d44ec with identifier: XD11713
2026-03-27 10:42:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71a0007e-82fc-524f-8c93-a1303c8d44ec with identifier: XD11713
2026-03-27 10:42:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71a0007e-82fc-524f-8c93-a1303c8d44ec with identifier: XD11713 to the API
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:45:02Z',
'fuel_type': 'diesel',
'id': '71a0007e-82fc-524f-8c93-a1303c8d44ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD11713',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 264567,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-09',
'seller_name': None,
'title': 'Volvo XC90 2.4 D5 Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2025}
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD11713%27 HTTP/1.1" 200 None
2026-03-27 10:42:37 [auto1.de] INFO: Saving data for XD11713: {'auction_closing_time': 1774716302.0, 'created_time': 1773302971.43695, 'last_price_update_time': 1774608157.36544}
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD11713') HTTP/1.1" 204 0
2026-03-27 10:42:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:37 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-27 10:42:37 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-27 10:42:37 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT60499%27 HTTP/1.1" 200 None
2026-03-27 10:42:37 [auto1.de] INFO: Scrape type for YT60499: 2
2026-03-27 10:42:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 314e6253-8b60-580d-b2a3-cb05e09fffff with identifier: YT60499
2026-03-27 10:42:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 314e6253-8b60-580d-b2a3-cb05e09fffff with scrape type 2
2026-03-27 10:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 314e6253-8b60-580d-b2a3-cb05e09fffff with scrape type 2
2026-03-27 10:42:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 314e6253-8b60-580d-b2a3-cb05e09fffff, identifier: YT60499
2026-03-27 10:42:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 314e6253-8b60-580d-b2a3-cb05e09fffff with identifier: YT60499
2026-03-27 10:42:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 314e6253-8b60-580d-b2a3-cb05e09fffff with identifier: YT60499
2026-03-27 10:42:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 314e6253-8b60-580d-b2a3-cb05e09fffff with identifier: YT60499 to the API
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:06:14Z',
'fuel_type': 'petrol',
'id': '314e6253-8b60-580d-b2a3-cb05e09fffff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT60499',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Jimny',
'odometer': 86340,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-04',
'seller_name': None,
'title': 'Suzuki Jimny 1.3 Ranger Comfort',
'transmission': 'manual',
'trim': 'Ranger Comfort',
'year': 2015}
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT60499%27 HTTP/1.1" 200 None
2026-03-27 10:42:38 [auto1.de] INFO: Saving data for YT60499: {'auction_closing_time': 1774713974.0, 'created_time': 1773858693.232277, 'last_price_update_time': 1774608158.063638}
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT60499') HTTP/1.1" 204 0
2026-03-27 10:42:38 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV33173%27 HTTP/1.1" 200 None
2026-03-27 10:42:38 [auto1.de] INFO: Scrape type for NV33173: 2
2026-03-27 10:42:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c465186e-8268-561e-ad6b-eb0a2371b7e4 with identifier: NV33173
2026-03-27 10:42:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c465186e-8268-561e-ad6b-eb0a2371b7e4 with scrape type 2
2026-03-27 10:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c465186e-8268-561e-ad6b-eb0a2371b7e4 with scrape type 2
2026-03-27 10:42:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c465186e-8268-561e-ad6b-eb0a2371b7e4, identifier: NV33173
2026-03-27 10:42:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c465186e-8268-561e-ad6b-eb0a2371b7e4 with identifier: NV33173
2026-03-27 10:42:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c465186e-8268-561e-ad6b-eb0a2371b7e4 with identifier: NV33173
2026-03-27 10:42:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c465186e-8268-561e-ad6b-eb0a2371b7e4 with identifier: NV33173 to the API
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:25:26Z',
'fuel_type': 'petrol',
'id': 'c465186e-8268-561e-ad6b-eb0a2371b7e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV33173',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 106029,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-27',
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2017}
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV33173%27 HTTP/1.1" 200 None
2026-03-27 10:42:38 [auto1.de] INFO: Saving data for NV33173: {'auction_closing_time': 1774715126.0, 'created_time': 1773858921.751075, 'last_price_update_time': 1774608158.564488}
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV33173') HTTP/1.1" 204 0
2026-03-27 10:42:38 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD55568%27 HTTP/1.1" 200 None
2026-03-27 10:42:38 [auto1.de] INFO: Scrape type for WD55568: 2
2026-03-27 10:42:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0076f557-b5b5-58ef-b072-0ac72c7d2562 with identifier: WD55568
2026-03-27 10:42:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0076f557-b5b5-58ef-b072-0ac72c7d2562 with scrape type 2
2026-03-27 10:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0076f557-b5b5-58ef-b072-0ac72c7d2562 with scrape type 2
2026-03-27 10:42:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0076f557-b5b5-58ef-b072-0ac72c7d2562, identifier: WD55568
2026-03-27 10:42:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0076f557-b5b5-58ef-b072-0ac72c7d2562 with identifier: WD55568
2026-03-27 10:42:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0076f557-b5b5-58ef-b072-0ac72c7d2562 with identifier: WD55568
2026-03-27 10:42:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0076f557-b5b5-58ef-b072-0ac72c7d2562 with identifier: WD55568 to the API
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:15:57Z',
'fuel_type': 'diesel',
'id': '0076f557-b5b5-58ef-b072-0ac72c7d2562',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD55568',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 97955,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-10',
'seller_name': None,
'title': 'Volkswagen Touran 1.6 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2018}
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD55568%27 HTTP/1.1" 200 None
2026-03-27 10:42:39 [auto1.de] INFO: Saving data for WD55568: {'auction_closing_time': 1774714557.0, 'created_time': 1773773456.523802, 'last_price_update_time': 1774608159.091883}
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD55568') HTTP/1.1" 204 0
2026-03-27 10:42:39 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE26333%27 HTTP/1.1" 200 None
2026-03-27 10:42:39 [auto1.de] INFO: Scrape type for XE26333: 2
2026-03-27 10:42:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d759cfc9-b2e2-50e0-84ab-45e2145608f2 with identifier: XE26333
2026-03-27 10:42:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d759cfc9-b2e2-50e0-84ab-45e2145608f2 with scrape type 2
2026-03-27 10:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d759cfc9-b2e2-50e0-84ab-45e2145608f2 with scrape type 2
2026-03-27 10:42:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d759cfc9-b2e2-50e0-84ab-45e2145608f2, identifier: XE26333
2026-03-27 10:42:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d759cfc9-b2e2-50e0-84ab-45e2145608f2 with identifier: XE26333
2026-03-27 10:42:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d759cfc9-b2e2-50e0-84ab-45e2145608f2 with identifier: XE26333
2026-03-27 10:42:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d759cfc9-b2e2-50e0-84ab-45e2145608f2 with identifier: XE26333 to the API
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:41:57Z',
'fuel_type': 'diesel',
'id': 'd759cfc9-b2e2-50e0-84ab-45e2145608f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE26333',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 187267,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-26',
'seller_name': None,
'title': 'Volkswagen Golf Plus 2.0 TDI Match',
'transmission': 'manual',
'trim': 'Match',
'year': 2012}
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE26333%27 HTTP/1.1" 200 None
2026-03-27 10:42:39 [auto1.de] INFO: Saving data for XE26333: {'auction_closing_time': 1774716117.0, 'created_time': 1773772239.073326, 'last_price_update_time': 1774608159.58573}
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE26333') HTTP/1.1" 204 0
2026-03-27 10:42:39 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 10530 | hits on page: 40
2026-03-27 10:42:39 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55483%27 HTTP/1.1" 200 None
2026-03-27 10:42:39 [auto1.de] INFO: Scrape type for HS55483: 2
2026-03-27 10:42:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27e2b035-b70f-558c-9af8-265d21cb9619 with identifier: HS55483
2026-03-27 10:42:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27e2b035-b70f-558c-9af8-265d21cb9619 with scrape type 2
2026-03-27 10:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27e2b035-b70f-558c-9af8-265d21cb9619 with scrape type 2
2026-03-27 10:42:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27e2b035-b70f-558c-9af8-265d21cb9619, identifier: HS55483
2026-03-27 10:42:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27e2b035-b70f-558c-9af8-265d21cb9619 with identifier: HS55483
2026-03-27 10:42:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27e2b035-b70f-558c-9af8-265d21cb9619 with identifier: HS55483
2026-03-27 10:42:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27e2b035-b70f-558c-9af8-265d21cb9619 with identifier: HS55483 to the API
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:48:07Z',
'fuel_type': 'petrol',
'id': '27e2b035-b70f-558c-9af8-265d21cb9619',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS55483',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 68336,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-30',
'seller_name': None,
'title': 'Opel Mokka X 1.4 Turbo Active Start/Stop 4x4',
'transmission': 'manual',
'trim': 'Active Start/Stop 4x4',
'year': 2017}
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55483%27 HTTP/1.1" 200 None
2026-03-27 10:42:40 [auto1.de] INFO: Saving data for HS55483: {'auction_closing_time': 1774716487.0, 'created_time': 1773137666.962019, 'last_price_update_time': 1774608160.109242}
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS55483') HTTP/1.1" 204 0
2026-03-27 10:42:40 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-27 10:42:40 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS31219%27 HTTP/1.1" 200 None
2026-03-27 10:42:40 [auto1.de] INFO: Scrape type for JS31219: 2
2026-03-27 10:42:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae55bdd6-1a7d-5d33-8f2a-b46dba209687 with identifier: JS31219
2026-03-27 10:42:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae55bdd6-1a7d-5d33-8f2a-b46dba209687 with scrape type 2
2026-03-27 10:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae55bdd6-1a7d-5d33-8f2a-b46dba209687 with scrape type 2
2026-03-27 10:42:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae55bdd6-1a7d-5d33-8f2a-b46dba209687, identifier: JS31219
2026-03-27 10:42:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:40 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-27 10:42:40 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ40219%27 HTTP/1.1" 200 None
2026-03-27 10:42:40 [auto1.de] INFO: Scrape type for FZ40219: 2
2026-03-27 10:42:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46584ce2-db7a-5b7a-95ef-b2c69c5df76d with identifier: FZ40219
2026-03-27 10:42:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46584ce2-db7a-5b7a-95ef-b2c69c5df76d with scrape type 2
2026-03-27 10:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46584ce2-db7a-5b7a-95ef-b2c69c5df76d with scrape type 2
2026-03-27 10:42:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46584ce2-db7a-5b7a-95ef-b2c69c5df76d, identifier: FZ40219
2026-03-27 10:42:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae55bdd6-1a7d-5d33-8f2a-b46dba209687 with identifier: JS31219
2026-03-27 10:42:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae55bdd6-1a7d-5d33-8f2a-b46dba209687 with identifier: JS31219
2026-03-27 10:42:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae55bdd6-1a7d-5d33-8f2a-b46dba209687 with identifier: JS31219 to the API
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:40:53Z',
'fuel_type': 'diesel',
'id': 'ae55bdd6-1a7d-5d33-8f2a-b46dba209687',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS31219',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 93015,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-27',
'seller_name': None,
'title': 'Opel Meriva 1.7 CDTI 150 Jahre Opel',
'transmission': 'automatic',
'trim': '150 Jahre',
'year': 2012}
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS31219%27 HTTP/1.1" 200 None
2026-03-27 10:42:40 [auto1.de] INFO: Saving data for JS31219: {'auction_closing_time': 1774716053.0, 'created_time': 1773429031.571345, 'last_price_update_time': 1774608160.759316}
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS31219') HTTP/1.1" 204 0
2026-03-27 10:42:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LC91854/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46584ce2-db7a-5b7a-95ef-b2c69c5df76d with identifier: FZ40219
2026-03-27 10:42:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46584ce2-db7a-5b7a-95ef-b2c69c5df76d with identifier: FZ40219
2026-03-27 10:42:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46584ce2-db7a-5b7a-95ef-b2c69c5df76d with identifier: FZ40219 to the API
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:03:22Z',
'fuel_type': 'petrol',
'id': '46584ce2-db7a-5b7a-95ef-b2c69c5df76d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ40219',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 63120,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-21',
'seller_name': None,
'title': 'MINI One Metropolitan',
'transmission': 'manual',
'trim': 'Metropolitan',
'year': 2015}
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ40219%27 HTTP/1.1" 200 None
2026-03-27 10:42:41 [auto1.de] INFO: Saving data for FZ40219: {'auction_closing_time': 1774713802.0, 'created_time': 1773860421.919325, 'last_price_update_time': 1774608161.263972}
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ40219') HTTP/1.1" 204 0
2026-03-27 10:42:41 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89680%27 HTTP/1.1" 200 None
2026-03-27 10:42:41 [auto1.de] INFO: Scrape type for CC89680: 2
2026-03-27 10:42:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e630a218-7e39-5e7d-9622-3e994f3d8c27 with identifier: CC89680
2026-03-27 10:42:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e630a218-7e39-5e7d-9622-3e994f3d8c27 with scrape type 2
2026-03-27 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e630a218-7e39-5e7d-9622-3e994f3d8c27 with scrape type 2
2026-03-27 10:42:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e630a218-7e39-5e7d-9622-3e994f3d8c27, identifier: CC89680
2026-03-27 10:42:41 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM47642%27 HTTP/1.1" 200 None
2026-03-27 10:42:41 [auto1.de] INFO: Scrape type for GM47642: 2
2026-03-27 10:42:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34a330c4-12b1-520f-b19a-9eb7713f2eb0 with identifier: GM47642
2026-03-27 10:42:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34a330c4-12b1-520f-b19a-9eb7713f2eb0 with scrape type 2
2026-03-27 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34a330c4-12b1-520f-b19a-9eb7713f2eb0 with scrape type 2
2026-03-27 10:42:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34a330c4-12b1-520f-b19a-9eb7713f2eb0, identifier: GM47642
2026-03-27 10:42:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e630a218-7e39-5e7d-9622-3e994f3d8c27 with identifier: CC89680
2026-03-27 10:42:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e630a218-7e39-5e7d-9622-3e994f3d8c27 with identifier: CC89680
2026-03-27 10:42:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e630a218-7e39-5e7d-9622-3e994f3d8c27 with identifier: CC89680 to the API
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:21:38Z',
'fuel_type': 'diesel',
'id': 'e630a218-7e39-5e7d-9622-3e994f3d8c27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC89680',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 150208,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-01',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Sport & Style 4Motion BlueMotion Tech',
'year': 2012}
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89680%27 HTTP/1.1" 200 None
2026-03-27 10:42:41 [auto1.de] INFO: Saving data for CC89680: {'auction_closing_time': 1774714898.0, 'created_time': 1773775349.992967, 'last_price_update_time': 1774608161.979096}
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC89680') HTTP/1.1" 204 0
2026-03-27 10:42:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34a330c4-12b1-520f-b19a-9eb7713f2eb0 with identifier: GM47642
2026-03-27 10:42:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34a330c4-12b1-520f-b19a-9eb7713f2eb0 with identifier: GM47642
2026-03-27 10:42:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34a330c4-12b1-520f-b19a-9eb7713f2eb0 with identifier: GM47642 to the API
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:29:48Z',
'fuel_type': 'petrol',
'id': '34a330c4-12b1-520f-b19a-9eb7713f2eb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM47642',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 76651,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-07',
'seller_name': None,
'title': 'Renault Twingo 1.0 SCe Chic',
'transmission': 'manual',
'trim': 'Chic',
'year': 2019}
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM47642%27 HTTP/1.1" 200 None
2026-03-27 10:42:42 [auto1.de] INFO: Saving data for GM47642: {'auction_closing_time': 1774715388.0, 'created_time': 1773859992.552013, 'last_price_update_time': 1774608162.324333}
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM47642') HTTP/1.1" 204 0
2026-03-27 10:42:42 [auto1.de] INFO: Found listing with ID: RY91150
2026-03-27 10:42:42 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR76788%27 HTTP/1.1" 200 None
2026-03-27 10:42:42 [auto1.de] INFO: Scrape type for BR76788: 2
2026-03-27 10:42:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f645e6db-676f-559d-8c38-0bac708f8059 with identifier: BR76788
2026-03-27 10:42:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f645e6db-676f-559d-8c38-0bac708f8059 with scrape type 2
2026-03-27 10:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f645e6db-676f-559d-8c38-0bac708f8059 with scrape type 2
2026-03-27 10:42:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f645e6db-676f-559d-8c38-0bac708f8059, identifier: BR76788
2026-03-27 10:42:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME69590> (referer: https://www.auto1.com/v1/car-details-view/ME69590/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:42 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-27 10:42:42 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM56481%27 HTTP/1.1" 200 None
2026-03-27 10:42:42 [auto1.de] INFO: Scrape type for FM56481: 2
2026-03-27 10:42:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67e91dfa-05b5-5d14-bad5-256387ac454b with identifier: FM56481
2026-03-27 10:42:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67e91dfa-05b5-5d14-bad5-256387ac454b with scrape type 2
2026-03-27 10:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67e91dfa-05b5-5d14-bad5-256387ac454b with scrape type 2
2026-03-27 10:42:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67e91dfa-05b5-5d14-bad5-256387ac454b, identifier: FM56481
2026-03-27 10:42:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f645e6db-676f-559d-8c38-0bac708f8059 with identifier: BR76788
2026-03-27 10:42:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f645e6db-676f-559d-8c38-0bac708f8059 with identifier: BR76788
2026-03-27 10:42:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f645e6db-676f-559d-8c38-0bac708f8059 with identifier: BR76788 to the API
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:19:51Z',
'fuel_type': 'petrol',
'id': 'f645e6db-676f-559d-8c38-0bac708f8059',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR76788',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 193704,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-20',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2012}
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR76788%27 HTTP/1.1" 200 None
2026-03-27 10:42:42 [auto1.de] INFO: Saving data for BR76788: {'auction_closing_time': 1774714791.0, 'created_time': 1773304689.771843, 'last_price_update_time': 1774608162.937211}
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR76788') HTTP/1.1" 204 0
2026-03-27 10:42:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67e91dfa-05b5-5d14-bad5-256387ac454b with identifier: FM56481
2026-03-27 10:42:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67e91dfa-05b5-5d14-bad5-256387ac454b with identifier: FM56481
2026-03-27 10:42:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67e91dfa-05b5-5d14-bad5-256387ac454b with identifier: FM56481 to the API
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:40:35Z',
'fuel_type': 'diesel',
'id': '67e91dfa-05b5-5d14-bad5-256387ac454b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM56481',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 224861,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-23',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2015}
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM56481%27 HTTP/1.1" 200 None
2026-03-27 10:42:43 [auto1.de] INFO: Saving data for FM56481: {'auction_closing_time': 1774716035.0, 'created_time': 1774290713.601124, 'last_price_update_time': 1774608163.34649}
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM56481') HTTP/1.1" 204 0
2026-03-27 10:42:43 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK33721%27 HTTP/1.1" 200 None
2026-03-27 10:42:43 [auto1.de] INFO: Scrape type for BK33721: 2
2026-03-27 10:42:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 412071c1-bba9-5b08-a0d7-17f78cac9a27 with identifier: BK33721
2026-03-27 10:42:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 412071c1-bba9-5b08-a0d7-17f78cac9a27 with scrape type 2
2026-03-27 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 412071c1-bba9-5b08-a0d7-17f78cac9a27 with scrape type 2
2026-03-27 10:42:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 412071c1-bba9-5b08-a0d7-17f78cac9a27, identifier: BK33721
2026-03-27 10:42:43 [auto1.de] INFO: Found listing with ID: MY83778
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY83778%27 HTTP/1.1" 200 None
2026-03-27 10:42:43 [auto1.de] INFO: Scrape type for MY83778: 2
2026-03-27 10:42:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa095269-b25b-5e90-9959-ff24b43c0221 with identifier: MY83778
2026-03-27 10:42:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa095269-b25b-5e90-9959-ff24b43c0221 with scrape type 2
2026-03-27 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa095269-b25b-5e90-9959-ff24b43c0221 with scrape type 2
2026-03-27 10:42:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa095269-b25b-5e90-9959-ff24b43c0221, identifier: MY83778
2026-03-27 10:42:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 412071c1-bba9-5b08-a0d7-17f78cac9a27 with identifier: BK33721
2026-03-27 10:42:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 412071c1-bba9-5b08-a0d7-17f78cac9a27 with identifier: BK33721
2026-03-27 10:42:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 412071c1-bba9-5b08-a0d7-17f78cac9a27 with identifier: BK33721 to the API
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:39:54Z',
'fuel_type': 'diesel',
'id': '412071c1-bba9-5b08-a0d7-17f78cac9a27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK33721',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 211079,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-13',
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel N-Connecta',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2016}
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK33721%27 HTTP/1.1" 200 None
2026-03-27 10:42:43 [auto1.de] INFO: Saving data for BK33721: {'auction_closing_time': 1774715994.0, 'created_time': 1773302587.986018, 'last_price_update_time': 1774608163.973418}
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK33721') HTTP/1.1" 204 0
2026-03-27 10:42:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa095269-b25b-5e90-9959-ff24b43c0221 with identifier: MY83778
2026-03-27 10:42:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa095269-b25b-5e90-9959-ff24b43c0221 with identifier: MY83778
2026-03-27 10:42:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa095269-b25b-5e90-9959-ff24b43c0221 with identifier: MY83778 to the API
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-28T16:45:49Z',
'fuel_type': 'petrol',
'id': 'fa095269-b25b-5e90-9959-ff24b43c0221',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY83778',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Cactus',
'odometer': 88776,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-22',
'seller_name': None,
'title': 'Citroen C4 Cactus 1.2 VTi Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2015}
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY83778%27 HTTP/1.1" 200 None
2026-03-27 10:42:44 [auto1.de] INFO: Saving data for MY83778: {'auction_closing_time': 1774716349.0, 'created_time': 1773305683.087738, 'last_price_update_time': 1774608164.38327}
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY83778') HTTP/1.1" 204 0
2026-03-27 10:42:44 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-27 10:42:44 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG27437%27 HTTP/1.1" 200 None
2026-03-27 10:42:44 [auto1.de] INFO: Scrape type for CG27437: 2
2026-03-27 10:42:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f75f6a61-3768-5130-89b4-e9aea0cb319b with identifier: CG27437
2026-03-27 10:42:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f75f6a61-3768-5130-89b4-e9aea0cb319b with scrape type 2
2026-03-27 10:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f75f6a61-3768-5130-89b4-e9aea0cb319b with scrape type 2
2026-03-27 10:42:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f75f6a61-3768-5130-89b4-e9aea0cb319b, identifier: CG27437
2026-03-27 10:42:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01909457-3e7f-57c6-995b-5a5fb67a33cc with identifier: ME69590
2026-03-27 10:42:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01909457-3e7f-57c6-995b-5a5fb67a33cc with scrape type 1
2026-03-27 10:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01909457-3e7f-57c6-995b-5a5fb67a33cc
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_67f2f8a055daa7397860683e8d049a2e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_67f2f8a055daa7397860683e8d049a2e.jpg not downloaded yet
2026-03-27 10:42:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:44 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL69510%27 HTTP/1.1" 200 None
2026-03-27 10:42:44 [auto1.de] INFO: Scrape type for TL69510: 2
2026-03-27 10:42:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f972975e-5b75-5849-b630-26553e6dd0d5 with identifier: TL69510
2026-03-27 10:42:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f972975e-5b75-5849-b630-26553e6dd0d5 with scrape type 2
2026-03-27 10:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f972975e-5b75-5849-b630-26553e6dd0d5 with scrape type 2
2026-03-27 10:42:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f972975e-5b75-5849-b630-26553e6dd0d5, identifier: TL69510
2026-03-27 10:42:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f75f6a61-3768-5130-89b4-e9aea0cb319b with identifier: CG27437
2026-03-27 10:42:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f75f6a61-3768-5130-89b4-e9aea0cb319b with identifier: CG27437
2026-03-27 10:42:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f75f6a61-3768-5130-89b4-e9aea0cb319b with identifier: CG27437 to the API
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:38:50Z',
'fuel_type': 'petrol',
'id': 'f75f6a61-3768-5130-89b4-e9aea0cb319b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG27437',
'listing': 'auction',
'make': 'Citroen',
'model': 'C8',
'odometer': 235391,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-23',
'seller_name': None,
'title': 'Citroen C8 2.0 Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2006}
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG27437%27 HTTP/1.1" 200 None
2026-03-27 10:42:45 [auto1.de] INFO: Saving data for CG27437: {'auction_closing_time': 1774715930.0, 'created_time': 1774118381.392202, 'last_price_update_time': 1774608165.045757}
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG27437') HTTP/1.1" 204 0
2026-03-27 10:42:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f972975e-5b75-5849-b630-26553e6dd0d5 with identifier: TL69510
2026-03-27 10:42:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f972975e-5b75-5849-b630-26553e6dd0d5 with identifier: TL69510
2026-03-27 10:42:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f972975e-5b75-5849-b630-26553e6dd0d5 with identifier: TL69510 to the API
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:10:05Z',
'fuel_type': 'diesel',
'id': 'f972975e-5b75-5849-b630-26553e6dd0d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL69510',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 70004,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-06',
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi 340 L1 Trail',
'transmission': 'manual',
'trim': '340 L1 Trail',
'year': 2022}
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL69510%27 HTTP/1.1" 200 None
2026-03-27 10:42:45 [auto1.de] INFO: Saving data for TL69510: {'auction_closing_time': 1774714205.0, 'created_time': 1773426861.937701, 'last_price_update_time': 1774608165.52524}
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL69510') HTTP/1.1" 204 0
2026-03-27 10:42:45 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-27 10:42:45 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-27 10:42:45 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT60185%27 HTTP/1.1" 200 None
2026-03-27 10:42:45 [auto1.de] INFO: Scrape type for NT60185: 2
2026-03-27 10:42:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abe15317-01ff-5dd8-a58a-abeea1216824 with identifier: NT60185
2026-03-27 10:42:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abe15317-01ff-5dd8-a58a-abeea1216824 with scrape type 2
2026-03-27 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abe15317-01ff-5dd8-a58a-abeea1216824 with scrape type 2
2026-03-27 10:42:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abe15317-01ff-5dd8-a58a-abeea1216824, identifier: NT60185
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_c522d3ab75e49b5e72780bf3b96988a8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_c522d3ab75e49b5e72780bf3b96988a8.jpg not downloaded yet
2026-03-27 10:42:45 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV05301%27 HTTP/1.1" 200 None
2026-03-27 10:42:45 [auto1.de] INFO: Scrape type for RV05301: 2
2026-03-27 10:42:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 431ce18c-82c4-57bf-b8f5-21e7299e3ba4 with identifier: RV05301
2026-03-27 10:42:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 431ce18c-82c4-57bf-b8f5-21e7299e3ba4 with scrape type 2
2026-03-27 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 431ce18c-82c4-57bf-b8f5-21e7299e3ba4 with scrape type 2
2026-03-27 10:42:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 431ce18c-82c4-57bf-b8f5-21e7299e3ba4, identifier: RV05301
2026-03-27 10:42:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abe15317-01ff-5dd8-a58a-abeea1216824 with identifier: NT60185
2026-03-27 10:42:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abe15317-01ff-5dd8-a58a-abeea1216824 with identifier: NT60185
2026-03-27 10:42:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abe15317-01ff-5dd8-a58a-abeea1216824 with identifier: NT60185 to the API
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:30:03Z',
'fuel_type': 'petrol',
'id': 'abe15317-01ff-5dd8-a58a-abeea1216824',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT60185',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 73291,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-25',
'seller_name': None,
'title': 'Hyundai i30 1.4 Trend blue',
'transmission': 'manual',
'trim': 'Trend blue',
'year': 2016}
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT60185%27 HTTP/1.1" 200 None
2026-03-27 10:42:46 [auto1.de] INFO: Saving data for NT60185: {'auction_closing_time': 1774715403.0, 'created_time': 1773466618.589498, 'last_price_update_time': 1774608166.275341}
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT60185') HTTP/1.1" 204 0
2026-03-27 10:42:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 431ce18c-82c4-57bf-b8f5-21e7299e3ba4 with identifier: RV05301
2026-03-27 10:42:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 431ce18c-82c4-57bf-b8f5-21e7299e3ba4 with identifier: RV05301
2026-03-27 10:42:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 431ce18c-82c4-57bf-b8f5-21e7299e3ba4 with identifier: RV05301 to the API
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:11:30Z',
'fuel_type': 'diesel',
'id': '431ce18c-82c4-57bf-b8f5-21e7299e3ba4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV05301',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 180724,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-06',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Shooting Brake AMG Line',
'transmission': 'manual',
'trim': 'AMG Line',
'year': 2017}
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV05301%27 HTTP/1.1" 200 None
2026-03-27 10:42:46 [auto1.de] INFO: Saving data for RV05301: {'auction_closing_time': 1774714290.0, 'created_time': 1773830149.684609, 'last_price_update_time': 1774608166.879383}
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV05301') HTTP/1.1" 204 0
2026-03-27 10:42:46 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-27 10:42:46 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY07773%27 HTTP/1.1" 200 None
2026-03-27 10:42:46 [auto1.de] INFO: Scrape type for NY07773: 2
2026-03-27 10:42:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d831275b-282c-5125-8313-4e3b3d532bee with identifier: NY07773
2026-03-27 10:42:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d831275b-282c-5125-8313-4e3b3d532bee with scrape type 2
2026-03-27 10:42:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d831275b-282c-5125-8313-4e3b3d532bee with scrape type 2
2026-03-27 10:42:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d831275b-282c-5125-8313-4e3b3d532bee, identifier: NY07773
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_1a9c266f959bd32659da7ffeccbdc0d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_1a9c266f959bd32659da7ffeccbdc0d7.jpg not downloaded yet
2026-03-27 10:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:47 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW79477%27 HTTP/1.1" 200 None
2026-03-27 10:42:47 [auto1.de] INFO: Scrape type for WW79477: 2
2026-03-27 10:42:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d024d65-1a7e-57a9-a3bb-65b68b2474e3 with identifier: WW79477
2026-03-27 10:42:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d024d65-1a7e-57a9-a3bb-65b68b2474e3 with scrape type 2
2026-03-27 10:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d024d65-1a7e-57a9-a3bb-65b68b2474e3 with scrape type 2
2026-03-27 10:42:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d024d65-1a7e-57a9-a3bb-65b68b2474e3, identifier: WW79477
2026-03-27 10:42:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d831275b-282c-5125-8313-4e3b3d532bee with identifier: NY07773
2026-03-27 10:42:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d831275b-282c-5125-8313-4e3b3d532bee with identifier: NY07773
2026-03-27 10:42:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d831275b-282c-5125-8313-4e3b3d532bee with identifier: NY07773 to the API
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:40:05Z',
'fuel_type': 'diesel',
'id': 'd831275b-282c-5125-8313-4e3b3d532bee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY07773',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 77993,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-08',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2020}
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY07773%27 HTTP/1.1" 200 None
2026-03-27 10:42:47 [auto1.de] INFO: Saving data for NY07773: {'auction_closing_time': 1774716005.0, 'created_time': 1773775491.261199, 'last_price_update_time': 1774608167.884089}
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY07773') HTTP/1.1" 204 0
2026-03-27 10:42:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d024d65-1a7e-57a9-a3bb-65b68b2474e3 with identifier: WW79477
2026-03-27 10:42:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d024d65-1a7e-57a9-a3bb-65b68b2474e3 with identifier: WW79477
2026-03-27 10:42:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d024d65-1a7e-57a9-a3bb-65b68b2474e3 with identifier: WW79477 to the API
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:11:27Z',
'fuel_type': 'petrol',
'id': '5d024d65-1a7e-57a9-a3bb-65b68b2474e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW79477',
'listing': 'auction',
'make': 'Seat',
'model': 'Altea',
'odometer': 148452,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-31',
'seller_name': None,
'title': 'Seat Altea 1.2 TSI Style Ecomotive',
'transmission': 'manual',
'trim': 'Style Ecomotive',
'year': 2011}
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW79477%27 HTTP/1.1" 200 None
2026-03-27 10:42:48 [auto1.de] INFO: Saving data for WW79477: {'auction_closing_time': 1774714287.0, 'created_time': 1774262252.696002, 'last_price_update_time': 1774608168.526569}
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW79477') HTTP/1.1" 204 0
2026-03-27 10:42:48 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-27 10:42:48 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-27 10:42:48 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-27 10:42:48 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53261%27 HTTP/1.1" 200 None
2026-03-27 10:42:48 [auto1.de] INFO: Scrape type for KL53261: 1
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_db8c34bf2bb4f9c3b2de25cfb0ae8e82.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_db8c34bf2bb4f9c3b2de25cfb0ae8e82.jpg not downloaded yet
2026-03-27 10:42:48 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG14507%27 HTTP/1.1" 200 None
2026-03-27 10:42:48 [auto1.de] INFO: Scrape type for GG14507: 2
2026-03-27 10:42:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5380c6c-6f5f-547b-951a-a508a6b76001 with identifier: GG14507
2026-03-27 10:42:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5380c6c-6f5f-547b-951a-a508a6b76001 with scrape type 2
2026-03-27 10:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5380c6c-6f5f-547b-951a-a508a6b76001 with scrape type 2
2026-03-27 10:42:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5380c6c-6f5f-547b-951a-a508a6b76001, identifier: GG14507
2026-03-27 10:42:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5380c6c-6f5f-547b-951a-a508a6b76001 with identifier: GG14507
2026-03-27 10:42:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5380c6c-6f5f-547b-951a-a508a6b76001 with identifier: GG14507
2026-03-27 10:42:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5380c6c-6f5f-547b-951a-a508a6b76001 with identifier: GG14507 to the API
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:56:34Z',
'fuel_type': 'diesel',
'id': 'e5380c6c-6f5f-547b-951a-a508a6b76001',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG14507',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 300747,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-04',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 250 CDI T 4Matic BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T 4Matic BlueEfficiency Avantgarde',
'year': 2011}
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG14507%27 HTTP/1.1" 200 None
2026-03-27 10:42:49 [auto1.de] INFO: Saving data for GG14507: {'auction_closing_time': 1774716994.0, 'created_time': 1774293749.214221, 'last_price_update_time': 1774608169.065406}
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG14507') HTTP/1.1" 204 0
2026-03-27 10:42:49 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ26035%27 HTTP/1.1" 200 None
2026-03-27 10:42:49 [auto1.de] INFO: Scrape type for XJ26035: 2
2026-03-27 10:42:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db92ae2d-2098-5620-ae30-97002b745125 with identifier: XJ26035
2026-03-27 10:42:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db92ae2d-2098-5620-ae30-97002b745125 with scrape type 2
2026-03-27 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db92ae2d-2098-5620-ae30-97002b745125 with scrape type 2
2026-03-27 10:42:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db92ae2d-2098-5620-ae30-97002b745125, identifier: XJ26035
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_d8df9fdcb63b391dd8358d79020053a8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_d8df9fdcb63b391dd8358d79020053a8.jpg not downloaded yet
2026-03-27 10:42:49 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS86742%27 HTTP/1.1" 200 None
2026-03-27 10:42:49 [auto1.de] INFO: Scrape type for VS86742: 2
2026-03-27 10:42:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82006470-a810-59fb-b933-94aeeee466a8 with identifier: VS86742
2026-03-27 10:42:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82006470-a810-59fb-b933-94aeeee466a8 with scrape type 2
2026-03-27 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82006470-a810-59fb-b933-94aeeee466a8 with scrape type 2
2026-03-27 10:42:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82006470-a810-59fb-b933-94aeeee466a8, identifier: VS86742
2026-03-27 10:42:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db92ae2d-2098-5620-ae30-97002b745125 with identifier: XJ26035
2026-03-27 10:42:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db92ae2d-2098-5620-ae30-97002b745125 with identifier: XJ26035
2026-03-27 10:42:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db92ae2d-2098-5620-ae30-97002b745125 with identifier: XJ26035 to the API
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 441,
'expiration_date': '2026-03-28T16:34:23Z',
'fuel_type': 'petrol',
'id': 'db92ae2d-2098-5620-ae30-97002b745125',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ26035',
'listing': 'auction',
'make': 'Porsche',
'model': 'Macan',
'odometer': 109422,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-13',
'seller_name': None,
'title': 'Porsche Macan Turbo',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ26035%27 HTTP/1.1" 200 None
2026-03-27 10:42:49 [auto1.de] INFO: Saving data for XJ26035: {'auction_closing_time': 1774715663.0, 'created_time': 1774033108.242731, 'last_price_update_time': 1774608169.841588}
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ26035') HTTP/1.1" 204 0
2026-03-27 10:42:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:49 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 10531 | hits on page: 40
2026-03-27 10:42:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82006470-a810-59fb-b933-94aeeee466a8 with identifier: VS86742
2026-03-27 10:42:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82006470-a810-59fb-b933-94aeeee466a8 with identifier: VS86742
2026-03-27 10:42:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82006470-a810-59fb-b933-94aeeee466a8 with identifier: VS86742 to the API
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:00:54Z',
'fuel_type': 'petrol',
'id': '82006470-a810-59fb-b933-94aeeee466a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS86742',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 161028,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-31',
'seller_name': None,
'title': 'Opel Astra 1.6 Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2015}
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS86742%27 HTTP/1.1" 200 None
2026-03-27 10:42:50 [auto1.de] INFO: Saving data for VS86742: {'auction_closing_time': 1774713654.0, 'created_time': 1774294700.782556, 'last_price_update_time': 1774608170.398055}
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS86742') HTTP/1.1" 204 0
2026-03-27 10:42:50 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-27 10:42:50 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB92999%27 HTTP/1.1" 200 None
2026-03-27 10:42:50 [auto1.de] INFO: Scrape type for EB92999: 2
2026-03-27 10:42:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95713ae8-6435-5868-b6af-fd757137e7ab with identifier: EB92999
2026-03-27 10:42:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95713ae8-6435-5868-b6af-fd757137e7ab with scrape type 2
2026-03-27 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95713ae8-6435-5868-b6af-fd757137e7ab with scrape type 2
2026-03-27 10:42:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95713ae8-6435-5868-b6af-fd757137e7ab, identifier: EB92999
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_89627ad31f255cd76a8dc6aecb21be72.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_89627ad31f255cd76a8dc6aecb21be72.jpg not downloaded yet
2026-03-27 10:42:50 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-27 10:42:50 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA95886%27 HTTP/1.1" 200 None
2026-03-27 10:42:50 [auto1.de] INFO: Scrape type for YA95886: 2
2026-03-27 10:42:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4d7653f-d6ac-501d-a1c2-cbb49ea863a5 with identifier: YA95886
2026-03-27 10:42:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4d7653f-d6ac-501d-a1c2-cbb49ea863a5 with scrape type 2
2026-03-27 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4d7653f-d6ac-501d-a1c2-cbb49ea863a5 with scrape type 2
2026-03-27 10:42:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4d7653f-d6ac-501d-a1c2-cbb49ea863a5, identifier: YA95886
2026-03-27 10:42:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95713ae8-6435-5868-b6af-fd757137e7ab with identifier: EB92999
2026-03-27 10:42:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95713ae8-6435-5868-b6af-fd757137e7ab with identifier: EB92999
2026-03-27 10:42:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95713ae8-6435-5868-b6af-fd757137e7ab with identifier: EB92999 to the API
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:19:26Z',
'fuel_type': 'petrol',
'id': '95713ae8-6435-5868-b6af-fd757137e7ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB92999',
'listing': 'auction',
'make': 'Volvo',
'model': 'C70',
'odometer': 165515,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-08-27',
'seller_name': None,
'title': 'Volvo C70 2.4 Summum',
'transmission': 'manual',
'trim': 'Summum',
'year': 2007}
2026-03-27 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB92999%27 HTTP/1.1" 200 None
2026-03-27 10:42:51 [auto1.de] INFO: Saving data for EB92999: {'auction_closing_time': 1774714766.0, 'created_time': 1773226219.991848, 'last_price_update_time': 1774608171.616566}
2026-03-27 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB92999') HTTP/1.1" 204 0
2026-03-27 10:42:51 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-27 10:42:51 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-27 10:42:51 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-27 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT19745%27 HTTP/1.1" 200 None
2026-03-27 10:42:51 [auto1.de] INFO: Scrape type for ZT19745: 2
2026-03-27 10:42:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23c1c00f-e897-5d4d-a512-23f164f7b79c with identifier: ZT19745
2026-03-27 10:42:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23c1c00f-e897-5d4d-a512-23f164f7b79c with scrape type 2
2026-03-27 10:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23c1c00f-e897-5d4d-a512-23f164f7b79c with scrape type 2
2026-03-27 10:42:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23c1c00f-e897-5d4d-a512-23f164f7b79c, identifier: ZT19745
2026-03-27 10:42:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4d7653f-d6ac-501d-a1c2-cbb49ea863a5 with identifier: YA95886
2026-03-27 10:42:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4d7653f-d6ac-501d-a1c2-cbb49ea863a5 with identifier: YA95886
2026-03-27 10:42:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4d7653f-d6ac-501d-a1c2-cbb49ea863a5 with identifier: YA95886 to the API
2026-03-27 10:42:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:26:53Z',
'fuel_type': 'petrol',
'id': 'c4d7653f-d6ac-501d-a1c2-cbb49ea863a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA95886',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLK-Klasse',
'odometer': 64764,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-03-16',
'seller_name': None,
'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
'transmission': 'automatic',
'trim': '',
'year': 2005}
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA95886%27 HTTP/1.1" 200 None
2026-03-27 10:42:52 [auto1.de] INFO: Saving data for YA95886: {'auction_closing_time': 1774715213.0, 'created_time': 1773687306.071139, 'last_price_update_time': 1774608172.470768}
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA95886') HTTP/1.1" 204 0
2026-03-27 10:42:52 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-27 10:42:52 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-27 10:42:52 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-27 10:42:52 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-27 10:42:52 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU72034%27 HTTP/1.1" 200 None
2026-03-27 10:42:52 [auto1.de] INFO: Scrape type for EU72034: 2
2026-03-27 10:42:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4d6d7bb-71d0-543e-8dc1-f6debd3fab26 with identifier: EU72034
2026-03-27 10:42:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4d6d7bb-71d0-543e-8dc1-f6debd3fab26 with scrape type 2
2026-03-27 10:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4d6d7bb-71d0-543e-8dc1-f6debd3fab26 with scrape type 2
2026-03-27 10:42:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4d6d7bb-71d0-543e-8dc1-f6debd3fab26, identifier: EU72034
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_3461a50929b2ec8ecc8137b09f7422b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_3461a50929b2ec8ecc8137b09f7422b2.jpg not downloaded yet
2026-03-27 10:42:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23c1c00f-e897-5d4d-a512-23f164f7b79c with identifier: ZT19745
2026-03-27 10:42:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23c1c00f-e897-5d4d-a512-23f164f7b79c with identifier: ZT19745
2026-03-27 10:42:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23c1c00f-e897-5d4d-a512-23f164f7b79c with identifier: ZT19745 to the API
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:40:44Z',
'fuel_type': 'diesel',
'id': '23c1c00f-e897-5d4d-a512-23f164f7b79c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT19745',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 241747,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-08',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 CDI',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT19745%27 HTTP/1.1" 200 None
2026-03-27 10:42:52 [auto1.de] INFO: Saving data for ZT19745: {'auction_closing_time': 1774716044.0, 'created_time': 1772729586.532447, 'last_price_update_time': 1774608172.962819}
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT19745') HTTP/1.1" 204 0
2026-03-27 10:42:53 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN16879%27 HTTP/1.1" 200 None
2026-03-27 10:42:53 [auto1.de] INFO: Scrape type for BN16879: 2
2026-03-27 10:42:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e84b357c-5975-53f1-9428-e9c9406e7413 with identifier: BN16879
2026-03-27 10:42:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e84b357c-5975-53f1-9428-e9c9406e7413 with scrape type 2
2026-03-27 10:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e84b357c-5975-53f1-9428-e9c9406e7413 with scrape type 2
2026-03-27 10:42:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e84b357c-5975-53f1-9428-e9c9406e7413, identifier: BN16879
2026-03-27 10:42:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4d6d7bb-71d0-543e-8dc1-f6debd3fab26 with identifier: EU72034
2026-03-27 10:42:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4d6d7bb-71d0-543e-8dc1-f6debd3fab26 with identifier: EU72034
2026-03-27 10:42:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4d6d7bb-71d0-543e-8dc1-f6debd3fab26 with identifier: EU72034 to the API
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 265,
'expiration_date': '2026-03-28T16:17:09Z',
'fuel_type': 'diesel',
'id': 'c4d6d7bb-71d0-543e-8dc1-f6debd3fab26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU72034',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 124574,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-17',
'seller_name': None,
'title': 'BMW 3er 330d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU72034%27 HTTP/1.1" 200 None
2026-03-27 10:42:53 [auto1.de] INFO: Saving data for EU72034: {'auction_closing_time': 1774714629.0, 'created_time': 1773307033.754092, 'last_price_update_time': 1774608173.674508}
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU72034') HTTP/1.1" 204 0
2026-03-27 10:42:53 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-27 10:42:53 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH46132%27 HTTP/1.1" 200 None
2026-03-27 10:42:53 [auto1.de] INFO: Scrape type for KH46132: 2
2026-03-27 10:42:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aecf218-ebd9-5529-aea2-fe91ca5d706f with identifier: KH46132
2026-03-27 10:42:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aecf218-ebd9-5529-aea2-fe91ca5d706f with scrape type 2
2026-03-27 10:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aecf218-ebd9-5529-aea2-fe91ca5d706f with scrape type 2
2026-03-27 10:42:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9aecf218-ebd9-5529-aea2-fe91ca5d706f, identifier: KH46132
2026-03-27 10:42:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e84b357c-5975-53f1-9428-e9c9406e7413 with identifier: BN16879
2026-03-27 10:42:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e84b357c-5975-53f1-9428-e9c9406e7413 with identifier: BN16879
2026-03-27 10:42:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e84b357c-5975-53f1-9428-e9c9406e7413 with identifier: BN16879 to the API
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:38:10Z',
'fuel_type': 'diesel',
'id': 'e84b357c-5975-53f1-9428-e9c9406e7413',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN16879',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 189540,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-23',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2014}
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN16879%27 HTTP/1.1" 200 None
2026-03-27 10:42:54 [auto1.de] INFO: Saving data for BN16879: {'auction_closing_time': 1774715890.0, 'created_time': 1774292828.516682, 'last_price_update_time': 1774608174.403919}
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN16879') HTTP/1.1" 204 0
2026-03-27 10:42:54 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-27 10:42:54 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB31140%27 HTTP/1.1" 200 None
2026-03-27 10:42:54 [auto1.de] INFO: Scrape type for FB31140: 2
2026-03-27 10:42:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 647943a7-4e95-5bb2-8f5c-9489c90a4963 with identifier: FB31140
2026-03-27 10:42:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 647943a7-4e95-5bb2-8f5c-9489c90a4963 with scrape type 2
2026-03-27 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 647943a7-4e95-5bb2-8f5c-9489c90a4963 with scrape type 2
2026-03-27 10:42:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 647943a7-4e95-5bb2-8f5c-9489c90a4963, identifier: FB31140
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_26d55a198bb0dd6bfc802a2c577b58ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_26d55a198bb0dd6bfc802a2c577b58ca.jpg not downloaded yet
2026-03-27 10:42:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9aecf218-ebd9-5529-aea2-fe91ca5d706f with identifier: KH46132
2026-03-27 10:42:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9aecf218-ebd9-5529-aea2-fe91ca5d706f with identifier: KH46132
2026-03-27 10:42:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9aecf218-ebd9-5529-aea2-fe91ca5d706f with identifier: KH46132 to the API
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 145,
'expiration_date': '2026-03-28T16:51:12Z',
'fuel_type': 'petrol',
'id': '9aecf218-ebd9-5529-aea2-fe91ca5d706f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH46132',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 161139,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-10',
'seller_name': None,
'title': 'Audi A5 Sportback 1.8 TFSI',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH46132%27 HTTP/1.1" 200 None
2026-03-27 10:42:54 [auto1.de] INFO: Saving data for KH46132: {'auction_closing_time': 1774716672.0, 'created_time': 1773662246.605323, 'last_price_update_time': 1774608174.936275}
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH46132') HTTP/1.1" 204 0
2026-03-27 10:42:54 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-27 10:42:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 647943a7-4e95-5bb2-8f5c-9489c90a4963 with identifier: FB31140
2026-03-27 10:42:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 647943a7-4e95-5bb2-8f5c-9489c90a4963 with identifier: FB31140
2026-03-27 10:42:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 647943a7-4e95-5bb2-8f5c-9489c90a4963 with identifier: FB31140 to the API
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 155,
'expiration_date': '2026-03-28T16:48:58Z',
'fuel_type': 'petrol',
'id': '647943a7-4e95-5bb2-8f5c-9489c90a4963',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB31140',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 266965,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-06',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency',
'transmission': 'manual',
'trim': 'BlueEfficiency',
'year': 2012}
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB31140%27 HTTP/1.1" 200 None
2026-03-27 10:42:55 [auto1.de] INFO: Saving data for FB31140: {'auction_closing_time': 1774716538.0, 'created_time': 1773860710.128866, 'last_price_update_time': 1774608175.308556}
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB31140') HTTP/1.1" 204 0
2026-03-27 10:42:55 [auto1.de] INFO: Found listing with ID: AB79504
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB79504%27 HTTP/1.1" 200 None
2026-03-27 10:42:55 [auto1.de] INFO: Scrape type for AB79504: 1
2026-03-27 10:42:55 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-27 10:42:55 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX71045%27 HTTP/1.1" 200 None
2026-03-27 10:42:55 [auto1.de] INFO: Scrape type for UX71045: 2
2026-03-27 10:42:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da2edc74-54cf-5d4f-b79e-0971b0d785cf with identifier: UX71045
2026-03-27 10:42:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2edc74-54cf-5d4f-b79e-0971b0d785cf with scrape type 2
2026-03-27 10:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da2edc74-54cf-5d4f-b79e-0971b0d785cf with scrape type 2
2026-03-27 10:42:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da2edc74-54cf-5d4f-b79e-0971b0d785cf, identifier: UX71045
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_470caa10d8b9f5f73345fae77e52c335.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_470caa10d8b9f5f73345fae77e52c335.jpg not downloaded yet
2026-03-27 10:42:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da2edc74-54cf-5d4f-b79e-0971b0d785cf with identifier: UX71045
2026-03-27 10:42:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da2edc74-54cf-5d4f-b79e-0971b0d785cf with identifier: UX71045
2026-03-27 10:42:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da2edc74-54cf-5d4f-b79e-0971b0d785cf with identifier: UX71045 to the API
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 245,
'expiration_date': '2026-03-28T16:18:00Z',
'fuel_type': 'petrol',
'id': 'da2edc74-54cf-5d4f-b79e-0971b0d785cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX71045',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLC-Klasse',
'odometer': 146465,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-03',
'seller_name': None,
'title': 'Mercedes-Benz SLC-Klasse SLC 300 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2017}
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX71045%27 HTTP/1.1" 200 None
2026-03-27 10:42:57 [auto1.de] INFO: Saving data for UX71045: {'auction_closing_time': 1774714680.0, 'created_time': 1773306358.837761, 'last_price_update_time': 1774608177.66068}
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX71045') HTTP/1.1" 204 0
2026-03-27 10:42:57 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE39343%27 HTTP/1.1" 200 None
2026-03-27 10:42:57 [auto1.de] INFO: Scrape type for TE39343: 2
2026-03-27 10:42:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a615796-5005-5ed1-9c2a-e3cee4072121 with identifier: TE39343
2026-03-27 10:42:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a615796-5005-5ed1-9c2a-e3cee4072121 with scrape type 2
2026-03-27 10:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a615796-5005-5ed1-9c2a-e3cee4072121 with scrape type 2
2026-03-27 10:42:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a615796-5005-5ed1-9c2a-e3cee4072121, identifier: TE39343
2026-03-27 10:42:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LC91854> (referer: https://www.auto1.com/v1/car-details-view/LC91854/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_c522d3ab75e49b5e72780bf3b96988a8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:57 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35007%27 HTTP/1.1" 200 None
2026-03-27 10:42:57 [auto1.de] INFO: Scrape type for NC35007: 2
2026-03-27 10:42:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d37f7090-8fc8-5390-9fb5-6098960ed969 with identifier: NC35007
2026-03-27 10:42:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d37f7090-8fc8-5390-9fb5-6098960ed969 with scrape type 2
2026-03-27 10:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d37f7090-8fc8-5390-9fb5-6098960ed969 with scrape type 2
2026-03-27 10:42:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d37f7090-8fc8-5390-9fb5-6098960ed969, identifier: NC35007
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_4536190fcac60ba61f16aa92e2098e68.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_4536190fcac60ba61f16aa92e2098e68.jpg not downloaded yet
2026-03-27 10:42:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a615796-5005-5ed1-9c2a-e3cee4072121 with identifier: TE39343
2026-03-27 10:42:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a615796-5005-5ed1-9c2a-e3cee4072121 with identifier: TE39343
2026-03-27 10:42:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a615796-5005-5ed1-9c2a-e3cee4072121 with identifier: TE39343 to the API
2026-03-27 10:42:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:28:42Z',
'fuel_type': 'petrol',
'id': '3a615796-5005-5ed1-9c2a-e3cee4072121',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE39343',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 130813,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-27',
'seller_name': None,
'title': 'Volkswagen Scirocco 1.4 TSI',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE39343%27 HTTP/1.1" 200 None
2026-03-27 10:42:59 [auto1.de] INFO: Saving data for TE39343: {'auction_closing_time': 1774715322.0, 'created_time': 1773343749.517569, 'last_price_update_time': 1774608179.659454}
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE39343') HTTP/1.1" 204 0
2026-03-27 10:42:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d37f7090-8fc8-5390-9fb5-6098960ed969 with identifier: NC35007
2026-03-27 10:42:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d37f7090-8fc8-5390-9fb5-6098960ed969 with identifier: NC35007
2026-03-27 10:42:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d37f7090-8fc8-5390-9fb5-6098960ed969 with identifier: NC35007 to the API
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:37:43Z',
'fuel_type': 'petrol',
'id': 'd37f7090-8fc8-5390-9fb5-6098960ed969',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC35007',
'listing': 'auction',
'make': 'Seat',
'model': 'Altea',
'odometer': 74073,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-10',
'seller_name': None,
'title': 'Seat Altea 1.4 TSI Style Copa',
'transmission': 'manual',
'trim': 'Style Copa',
'year': 2013}
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35007%27 HTTP/1.1" 200 None
2026-03-27 10:43:00 [auto1.de] INFO: Saving data for NC35007: {'auction_closing_time': 1774715863.0, 'created_time': 1773466753.331596, 'last_price_update_time': 1774608180.123006}
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC35007') HTTP/1.1" 204 0
2026-03-27 10:43:00 [auto1.de] INFO: Found listing with ID: US92808
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US92808%27 HTTP/1.1" 200 None
2026-03-27 10:43:00 [auto1.de] INFO: Scrape type for US92808: 2
2026-03-27 10:43:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 043cb944-7be5-5ff5-b28d-fe814ebeef02 with identifier: US92808
2026-03-27 10:43:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 043cb944-7be5-5ff5-b28d-fe814ebeef02 with scrape type 2
2026-03-27 10:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 043cb944-7be5-5ff5-b28d-fe814ebeef02 with scrape type 2
2026-03-27 10:43:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 043cb944-7be5-5ff5-b28d-fe814ebeef02, identifier: US92808
2026-03-27 10:43:00 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81277%27 HTTP/1.1" 200 None
2026-03-27 10:43:00 [auto1.de] INFO: Scrape type for YS81277: 0
2026-03-27 10:43:00 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-27 10:43:00 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-27 10:43:00 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-27 10:43:00 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA73417%27 HTTP/1.1" 200 None
2026-03-27 10:43:00 [auto1.de] INFO: Scrape type for BA73417: 2
2026-03-27 10:43:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d1e964c-8882-515d-b2cd-eb22d01542e7 with identifier: BA73417
2026-03-27 10:43:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d1e964c-8882-515d-b2cd-eb22d01542e7 with scrape type 2
2026-03-27 10:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d1e964c-8882-515d-b2cd-eb22d01542e7 with scrape type 2
2026-03-27 10:43:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d1e964c-8882-515d-b2cd-eb22d01542e7, identifier: BA73417
2026-03-27 10:43:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 043cb944-7be5-5ff5-b28d-fe814ebeef02 with identifier: US92808
2026-03-27 10:43:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 043cb944-7be5-5ff5-b28d-fe814ebeef02 with identifier: US92808
2026-03-27 10:43:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 043cb944-7be5-5ff5-b28d-fe814ebeef02 with identifier: US92808 to the API
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:10:32Z',
'fuel_type': 'petrol',
'id': '043cb944-7be5-5ff5-b28d-fe814ebeef02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US92808',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 137176,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-24',
'seller_name': None,
'title': 'Seat Alhambra 1.4 TSI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2013}
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US92808%27 HTTP/1.1" 200 None
2026-03-27 10:43:00 [auto1.de] INFO: Saving data for US92808: {'auction_closing_time': 1774714232.0, 'created_time': 1774264926.92802, 'last_price_update_time': 1774608180.780593}
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US92808') HTTP/1.1" 204 0
2026-03-27 10:43:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d1e964c-8882-515d-b2cd-eb22d01542e7 with identifier: BA73417
2026-03-27 10:43:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d1e964c-8882-515d-b2cd-eb22d01542e7 with identifier: BA73417
2026-03-27 10:43:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d1e964c-8882-515d-b2cd-eb22d01542e7 with identifier: BA73417 to the API
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:22:00Z',
'fuel_type': 'diesel',
'id': '9d1e964c-8882-515d-b2cd-eb22d01542e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA73417',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Freelander',
'odometer': 161202,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-08',
'seller_name': None,
'title': 'Land Rover Freelander 2.2 Td4 E',
'transmission': 'manual',
'trim': 'E',
'year': 2012}
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA73417%27 HTTP/1.1" 200 None
2026-03-27 10:43:01 [auto1.de] INFO: Saving data for BA73417: {'auction_closing_time': 1774714920.0, 'created_time': 1774294210.947705, 'last_price_update_time': 1774608181.623194}
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA73417') HTTP/1.1" 204 0
2026-03-27 10:43:01 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-27 10:43:01 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK65785%27 HTTP/1.1" 200 None
2026-03-27 10:43:01 [auto1.de] INFO: Scrape type for AK65785: 2
2026-03-27 10:43:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8 with identifier: AK65785
2026-03-27 10:43:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8 with scrape type 2
2026-03-27 10:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8 with scrape type 2
2026-03-27 10:43:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8, identifier: AK65785
2026-03-27 10:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL53261/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19d8c31a-db4b-5a8a-86a3-e22584b70f1d with identifier: LC91854
2026-03-27 10:43:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19d8c31a-db4b-5a8a-86a3-e22584b70f1d with scrape type 1
2026-03-27 10:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 19d8c31a-db4b-5a8a-86a3-e22584b70f1d
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c2e5682da1a74e633c322015f9719%252Fpa%252FLC91854_61cde2faffa2cb01369bf62e8da3e899.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_61cde2faffa2cb01369bf62e8da3e899.jpg already downloaded
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c2e5682da1a74e633c322015f9719%252Fpa%252FLC91854_e0529c546860c89be5e0672ad788e421.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_e0529c546860c89be5e0672ad788e421.jpg already downloaded
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c2e5682da1a74e633c322015f9719%252Fpa%252FLC91854_63119f66433283748db0afe5eb63cff7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_63119f66433283748db0afe5eb63cff7.jpg already downloaded
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c2e5682da1a74e633c322015f9719%252Fpa%252FLC91854_e07433e191181554cc5171550012e2e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_e07433e191181554cc5171550012e2e8.jpg already downloaded
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c2e5682da1a74e633c322015f9719%252Fpa%252FLC91854_727f1ca2f783703b92fc52822f2054b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_727f1ca2f783703b92fc52822f2054b4.jpg already downloaded
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c2e5682da1a74e633c322015f9719%252Fpa%252FLC91854_625f1149481ac5c8916886364570230d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_625f1149481ac5c8916886364570230d.jpg already downloaded
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c2e5682da1a74e633c322015f9719%252Fpa%252FLC91854_09c42b124d219492b42a40715f366654.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_09c42b124d219492b42a40715f366654.jpg already downloaded
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c2e5682da1a74e633c322015f9719%252Fpa%252FLC91854_c07ddf763735a805265a35954ec72ab2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_c07ddf763735a805265a35954ec72ab2.jpg already downloaded
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c2e5682da1a74e633c322015f9719%252Fpa%252FLC91854_77caa85c07547b2e051f1313c69fef74.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_77caa85c07547b2e051f1313c69fef74.jpg already downloaded
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c2e5682da1a74e633c322015f9719%252Fpa%252FLC91854_ef441a489c721d333d68d9c390314372.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_ef441a489c721d333d68d9c390314372.jpg already downloaded
2026-03-27 10:43:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19d8c31a-db4b-5a8a-86a3-e22584b70f1d, identifier: LC91854
2026-03-27 10:43:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5396410>
2026-03-27 10:43:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_c522d3ab75e49b5e72780bf3b96988a8.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_c522d3ab75e49b5e72780bf3b96988a8.jpg saved to cache
2026-03-27 10:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01909457-3e7f-57c6-995b-5a5fb67a33cc
2026-03-27 10:43:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_db8c34bf2bb4f9c3b2de25cfb0ae8e82.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:02 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF95451%27 HTTP/1.1" 200 None
2026-03-27 10:43:02 [auto1.de] INFO: Scrape type for JF95451: 2
2026-03-27 10:43:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33e48a98-fb1d-5000-be9e-d2b634b38df0 with identifier: JF95451
2026-03-27 10:43:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e48a98-fb1d-5000-be9e-d2b634b38df0 with scrape type 2
2026-03-27 10:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33e48a98-fb1d-5000-be9e-d2b634b38df0 with scrape type 2
2026-03-27 10:43:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33e48a98-fb1d-5000-be9e-d2b634b38df0, identifier: JF95451
2026-03-27 10:43:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8 with identifier: AK65785
2026-03-27 10:43:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8 with identifier: AK65785
2026-03-27 10:43:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8 with identifier: AK65785 to the API
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:42:25Z',
'fuel_type': 'diesel',
'id': 'fe2d5cf5-23b5-5f86-afc6-5d57cd6bb5f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK65785',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 254611,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-08',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2010}
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK65785%27 HTTP/1.1" 200 None
2026-03-27 10:43:02 [auto1.de] INFO: Saving data for AK65785: {'auction_closing_time': 1774716145.0, 'created_time': 1773340412.094104, 'last_price_update_time': 1774608182.544911}
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK65785') HTTP/1.1" 204 0
2026-03-27 10:43:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19d8c31a-db4b-5a8a-86a3-e22584b70f1d with identifier: LC91854
2026-03-27 10:43:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19d8c31a-db4b-5a8a-86a3-e22584b70f1d with identifier: LC91854
2026-03-27 10:43:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19d8c31a-db4b-5a8a-86a3-e22584b70f1d with identifier: LC91854 to the API
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LC91854>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': 'Rental',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:53:49Z',
'fuel_type': 'diesel',
'id': '19d8c31a-db4b-5a8a-86a3-e22584b70f1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC91854',
'listing': 'auction',
'location': 'DE, Schkopau (OT Rassnitz)',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 298768,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_61cde2faffa2cb01369bf62e8da3e899.jpg',
'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_e0529c546860c89be5e0672ad788e421.jpg',
'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_63119f66433283748db0afe5eb63cff7.jpg',
'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_e07433e191181554cc5171550012e2e8.jpg',
'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_727f1ca2f783703b92fc52822f2054b4.jpg',
'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_625f1149481ac5c8916886364570230d.jpg',
'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_09c42b124d219492b42a40715f366654.jpg',
'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_c07ddf763735a805265a35954ec72ab2.jpg',
'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_77caa85c07547b2e051f1313c69fef74.jpg',
'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_ef441a489c721d333d68d9c390314372.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d8c31a-db4b-5a8a-86a3-e22584b70f1d/19d8c31a-db4b-5a8a-86a3-e22584b70f1d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80074,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_61cde2faffa2cb01369bf62e8da3e899.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d8c31a-db4b-5a8a-86a3-e22584b70f1d/19d8c31a-db4b-5a8a-86a3-e22584b70f1d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_e0529c546860c89be5e0672ad788e421.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d8c31a-db4b-5a8a-86a3-e22584b70f1d/19d8c31a-db4b-5a8a-86a3-e22584b70f1d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78391,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_63119f66433283748db0afe5eb63cff7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d8c31a-db4b-5a8a-86a3-e22584b70f1d/19d8c31a-db4b-5a8a-86a3-e22584b70f1d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3069646,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_e07433e191181554cc5171550012e2e8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d8c31a-db4b-5a8a-86a3-e22584b70f1d/19d8c31a-db4b-5a8a-86a3-e22584b70f1d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80383,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_727f1ca2f783703b92fc52822f2054b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d8c31a-db4b-5a8a-86a3-e22584b70f1d/19d8c31a-db4b-5a8a-86a3-e22584b70f1d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_625f1149481ac5c8916886364570230d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d8c31a-db4b-5a8a-86a3-e22584b70f1d/19d8c31a-db4b-5a8a-86a3-e22584b70f1d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_09c42b124d219492b42a40715f366654.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d8c31a-db4b-5a8a-86a3-e22584b70f1d/19d8c31a-db4b-5a8a-86a3-e22584b70f1d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_c07ddf763735a805265a35954ec72ab2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d8c31a-db4b-5a8a-86a3-e22584b70f1d/19d8c31a-db4b-5a8a-86a3-e22584b70f1d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3160666,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_77caa85c07547b2e051f1313c69fef74.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d8c31a-db4b-5a8a-86a3-e22584b70f1d/19d8c31a-db4b-5a8a-86a3-e22584b70f1d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56908,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c2e5682da1a74e633c322015f9719/pa/LC91854_ef441a489c721d333d68d9c390314372.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-04-11',
'seats_number': 7,
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2016}
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91854%27 HTTP/1.1" 200 None
2026-03-27 10:43:02 [auto1.de] INFO: Saving data for LC91854: {'created_time': 1774608182.975268, 'last_price_update_time': 1774608182.975279, 'auction_closing_time': 1774716829.0}
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC91854') HTTP/1.1" 204 0
2026-03-27 10:43:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_d8df9fdcb63b391dd8358d79020053a8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_470caa10d8b9f5f73345fae77e52c335.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33e48a98-fb1d-5000-be9e-d2b634b38df0 with identifier: JF95451
2026-03-27 10:43:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33e48a98-fb1d-5000-be9e-d2b634b38df0 with identifier: JF95451
2026-03-27 10:43:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33e48a98-fb1d-5000-be9e-d2b634b38df0 with identifier: JF95451 to the API
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:06:47Z',
'fuel_type': 'petrol',
'id': '33e48a98-fb1d-5000-be9e-d2b634b38df0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF95451',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 135234,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-18',
'seller_name': None,
'title': 'Opel Corsa 1.2 Selective',
'transmission': 'manual',
'trim': 'Selective',
'year': 2012}
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF95451%27 HTTP/1.1" 200 None
2026-03-27 10:43:03 [auto1.de] INFO: Saving data for JF95451: {'auction_closing_time': 1774714007.0, 'created_time': 1773661903.507089, 'last_price_update_time': 1774608183.334769}
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JF95451') HTTP/1.1" 204 0
2026-03-27 10:43:03 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX61886%27 HTTP/1.1" 200 None
2026-03-27 10:43:03 [auto1.de] INFO: Scrape type for DX61886: 2
2026-03-27 10:43:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1669ee62-6172-5c20-bf51-2dd54c7f34c9 with identifier: DX61886
2026-03-27 10:43:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1669ee62-6172-5c20-bf51-2dd54c7f34c9 with scrape type 2
2026-03-27 10:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1669ee62-6172-5c20-bf51-2dd54c7f34c9 with scrape type 2
2026-03-27 10:43:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1669ee62-6172-5c20-bf51-2dd54c7f34c9, identifier: DX61886
2026-03-27 10:43:03 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-27 10:43:03 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF02739%27 HTTP/1.1" 200 None
2026-03-27 10:43:03 [auto1.de] INFO: Scrape type for DF02739: 1
2026-03-27 10:43:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1669ee62-6172-5c20-bf51-2dd54c7f34c9 with identifier: DX61886
2026-03-27 10:43:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1669ee62-6172-5c20-bf51-2dd54c7f34c9 with identifier: DX61886
2026-03-27 10:43:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1669ee62-6172-5c20-bf51-2dd54c7f34c9 with identifier: DX61886 to the API
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:01:41Z',
'fuel_type': 'diesel',
'id': '1669ee62-6172-5c20-bf51-2dd54c7f34c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX61886',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 288118,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-31',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline',
'transmission': 'automatic',
'trim': 'Comfortline',
'year': 2009}
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX61886%27 HTTP/1.1" 200 None
2026-03-27 10:43:03 [auto1.de] INFO: Saving data for DX61886: {'auction_closing_time': 1774713701.0, 'created_time': 1773304013.021955, 'last_price_update_time': 1774608183.919557}
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX61886') HTTP/1.1" 204 0
2026-03-27 10:43:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:04 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN84809%27 HTTP/1.1" 200 None
2026-03-27 10:43:04 [auto1.de] INFO: Scrape type for GN84809: 2
2026-03-27 10:43:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1413d98a-f689-5bad-8148-522bccaf80b0 with identifier: GN84809
2026-03-27 10:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1413d98a-f689-5bad-8148-522bccaf80b0 with scrape type 2
2026-03-27 10:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1413d98a-f689-5bad-8148-522bccaf80b0 with scrape type 2
2026-03-27 10:43:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1413d98a-f689-5bad-8148-522bccaf80b0, identifier: GN84809
2026-03-27 10:43:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_89627ad31f255cd76a8dc6aecb21be72.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:04 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE46941%27 HTTP/1.1" 200 None
2026-03-27 10:43:04 [auto1.de] INFO: Scrape type for YE46941: 2
2026-03-27 10:43:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d63ba39-de09-516d-95e4-e3885ba51ce3 with identifier: YE46941
2026-03-27 10:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d63ba39-de09-516d-95e4-e3885ba51ce3 with scrape type 2
2026-03-27 10:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d63ba39-de09-516d-95e4-e3885ba51ce3 with scrape type 2
2026-03-27 10:43:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d63ba39-de09-516d-95e4-e3885ba51ce3, identifier: YE46941
2026-03-27 10:43:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1413d98a-f689-5bad-8148-522bccaf80b0 with identifier: GN84809
2026-03-27 10:43:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1413d98a-f689-5bad-8148-522bccaf80b0 with identifier: GN84809
2026-03-27 10:43:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1413d98a-f689-5bad-8148-522bccaf80b0 with identifier: GN84809 to the API
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:15:44Z',
'fuel_type': 'petrol',
'id': '1413d98a-f689-5bad-8148-522bccaf80b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN84809',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 46280,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-13',
'seller_name': None,
'title': 'Volkswagen Caddy 1.4 TSI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2018}
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN84809%27 HTTP/1.1" 200 None
2026-03-27 10:43:04 [auto1.de] INFO: Saving data for GN84809: {'auction_closing_time': 1774714544.0, 'created_time': 1774292734.001056, 'last_price_update_time': 1774608184.67747}
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN84809') HTTP/1.1" 204 0
2026-03-27 10:43:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf58a050>
2026-03-27 10:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_db8c34bf2bb4f9c3b2de25cfb0ae8e82.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_db8c34bf2bb4f9c3b2de25cfb0ae8e82.jpg saved to cache
2026-03-27 10:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01909457-3e7f-57c6-995b-5a5fb67a33cc
2026-03-27 10:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf38b950>
2026-03-27 10:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_d8df9fdcb63b391dd8358d79020053a8.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_d8df9fdcb63b391dd8358d79020053a8.jpg saved to cache
2026-03-27 10:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01909457-3e7f-57c6-995b-5a5fb67a33cc
2026-03-27 10:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be23dc90>
2026-03-27 10:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_470caa10d8b9f5f73345fae77e52c335.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_470caa10d8b9f5f73345fae77e52c335.jpg saved to cache
2026-03-27 10:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01909457-3e7f-57c6-995b-5a5fb67a33cc
2026-03-27 10:43:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_4536190fcac60ba61f16aa92e2098e68.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d63ba39-de09-516d-95e4-e3885ba51ce3 with identifier: YE46941
2026-03-27 10:43:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d63ba39-de09-516d-95e4-e3885ba51ce3 with identifier: YE46941
2026-03-27 10:43:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d63ba39-de09-516d-95e4-e3885ba51ce3 with identifier: YE46941 to the API
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-28T16:44:47Z',
'fuel_type': 'diesel',
'id': '6d63ba39-de09-516d-95e4-e3885ba51ce3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE46941',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 129869,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-22',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2016}
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE46941%27 HTTP/1.1" 200 None
2026-03-27 10:43:05 [auto1.de] INFO: Saving data for YE46941: {'auction_closing_time': 1774716287.0, 'created_time': 1773304500.754375, 'last_price_update_time': 1774608185.189817}
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE46941') HTTP/1.1" 204 0
2026-03-27 10:43:05 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52276%27 HTTP/1.1" 200 None
2026-03-27 10:43:05 [auto1.de] INFO: Scrape type for RS52276: 2
2026-03-27 10:43:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a1ef24b-0de9-5da0-97e9-5b85172f74c7 with identifier: RS52276
2026-03-27 10:43:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a1ef24b-0de9-5da0-97e9-5b85172f74c7 with scrape type 2
2026-03-27 10:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a1ef24b-0de9-5da0-97e9-5b85172f74c7 with scrape type 2
2026-03-27 10:43:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a1ef24b-0de9-5da0-97e9-5b85172f74c7, identifier: RS52276
2026-03-27 10:43:05 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-27 10:43:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a1ef24b-0de9-5da0-97e9-5b85172f74c7 with identifier: RS52276
2026-03-27 10:43:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a1ef24b-0de9-5da0-97e9-5b85172f74c7 with identifier: RS52276
2026-03-27 10:43:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a1ef24b-0de9-5da0-97e9-5b85172f74c7 with identifier: RS52276 to the API
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:10:21Z',
'fuel_type': 'diesel',
'id': '5a1ef24b-0de9-5da0-97e9-5b85172f74c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS52276',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 138688,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-21',
'seller_name': None,
'title': 'Nissan Juke 1.5 Turbodiesel N-Connecta',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2018}
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52276%27 HTTP/1.1" 200 None
2026-03-27 10:43:05 [auto1.de] INFO: Saving data for RS52276: {'auction_closing_time': 1774714221.0, 'created_time': 1773686860.273271, 'last_price_update_time': 1774608185.72338}
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS52276') HTTP/1.1" 204 0
2026-03-27 10:43:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:05 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 10533 | hits on page: 40
2026-03-27 10:43:05 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ16115%27 HTTP/1.1" 200 None
2026-03-27 10:43:05 [auto1.de] INFO: Scrape type for TJ16115: 2
2026-03-27 10:43:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47cd58ea-691f-574d-a63d-e5c94ebbc9a9 with identifier: TJ16115
2026-03-27 10:43:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47cd58ea-691f-574d-a63d-e5c94ebbc9a9 with scrape type 2
2026-03-27 10:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47cd58ea-691f-574d-a63d-e5c94ebbc9a9 with scrape type 2
2026-03-27 10:43:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47cd58ea-691f-574d-a63d-e5c94ebbc9a9, identifier: TJ16115
2026-03-27 10:43:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47cd58ea-691f-574d-a63d-e5c94ebbc9a9 with identifier: TJ16115
2026-03-27 10:43:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47cd58ea-691f-574d-a63d-e5c94ebbc9a9 with identifier: TJ16115
2026-03-27 10:43:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47cd58ea-691f-574d-a63d-e5c94ebbc9a9 with identifier: TJ16115 to the API
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:34:39Z',
'fuel_type': 'petrol',
'id': '47cd58ea-691f-574d-a63d-e5c94ebbc9a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ16115',
'listing': 'auction',
'make': 'Dodge',
'model': 'Journey',
'odometer': 118837,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-07-21',
'seller_name': None,
'title': 'Dodge Journey 2.4 SE',
'transmission': 'manual',
'trim': 'SE',
'year': 2008}
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ16115%27 HTTP/1.1" 200 None
2026-03-27 10:43:06 [auto1.de] INFO: Saving data for TJ16115: {'auction_closing_time': 1774715679.0, 'created_time': 1774290667.910521, 'last_price_update_time': 1774608186.322244}
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ16115') HTTP/1.1" 204 0
2026-03-27 10:43:06 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-27 10:43:06 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP47747%27 HTTP/1.1" 200 None
2026-03-27 10:43:06 [auto1.de] INFO: Scrape type for WP47747: 2
2026-03-27 10:43:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16 with identifier: WP47747
2026-03-27 10:43:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16 with scrape type 2
2026-03-27 10:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16 with scrape type 2
2026-03-27 10:43:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16, identifier: WP47747
2026-03-27 10:43:06 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88975%27 HTTP/1.1" 200 None
2026-03-27 10:43:06 [auto1.de] INFO: Scrape type for ZM88975: 2
2026-03-27 10:43:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e4010db-f408-54ff-8bb7-bd1b5ed02f72 with identifier: ZM88975
2026-03-27 10:43:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e4010db-f408-54ff-8bb7-bd1b5ed02f72 with scrape type 2
2026-03-27 10:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e4010db-f408-54ff-8bb7-bd1b5ed02f72 with scrape type 2
2026-03-27 10:43:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e4010db-f408-54ff-8bb7-bd1b5ed02f72, identifier: ZM88975
2026-03-27 10:43:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16 with identifier: WP47747
2026-03-27 10:43:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16 with identifier: WP47747
2026-03-27 10:43:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bbc95e2-a1ab-5df4-8482-2c6da3d42c16 with identifier: WP47747 to the API
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:32:51Z',
'fuel_type': 'petrol',
'id': '4bbc95e2-a1ab-5df4-8482-2c6da3d42c16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP47747',
'listing': 'auction',
'make': 'Opel',
'model': 'Combo',
'odometer': 132429,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-31',
'seller_name': None,
'title': 'Opel Combo 1.4 Kasten',
'transmission': 'manual',
'trim': 'Kasten',
'year': 2009}
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP47747%27 HTTP/1.1" 200 None
2026-03-27 10:43:06 [auto1.de] INFO: Saving data for WP47747: {'auction_closing_time': 1774715571.0, 'created_time': 1773686305.440238, 'last_price_update_time': 1774608186.894473}
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP47747') HTTP/1.1" 204 0
2026-03-27 10:43:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2fab50>
2026-03-27 10:43:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_89627ad31f255cd76a8dc6aecb21be72.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_89627ad31f255cd76a8dc6aecb21be72.jpg saved to cache
2026-03-27 10:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01909457-3e7f-57c6-995b-5a5fb67a33cc
2026-03-27 10:43:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4d8910>
2026-03-27 10:43:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_4536190fcac60ba61f16aa92e2098e68.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_4536190fcac60ba61f16aa92e2098e68.jpg saved to cache
2026-03-27 10:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01909457-3e7f-57c6-995b-5a5fb67a33cc
2026-03-27 10:43:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e4010db-f408-54ff-8bb7-bd1b5ed02f72 with identifier: ZM88975
2026-03-27 10:43:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e4010db-f408-54ff-8bb7-bd1b5ed02f72 with identifier: ZM88975
2026-03-27 10:43:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e4010db-f408-54ff-8bb7-bd1b5ed02f72 with identifier: ZM88975 to the API
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:53:45Z',
'fuel_type': 'petrol',
'id': '8e4010db-f408-54ff-8bb7-bd1b5ed02f72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM88975',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 147322,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-19',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.2 TSI Match',
'transmission': 'manual',
'trim': 'Match',
'year': 2013}
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88975%27 HTTP/1.1" 200 None
2026-03-27 10:43:07 [auto1.de] INFO: Saving data for ZM88975: {'auction_closing_time': 1774716825.0, 'created_time': 1773306829.193955, 'last_price_update_time': 1774608187.348241}
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM88975') HTTP/1.1" 204 0
2026-03-27 10:43:07 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ79893%27 HTTP/1.1" 200 None
2026-03-27 10:43:07 [auto1.de] INFO: Scrape type for ZZ79893: 1
2026-03-27 10:43:07 [scrapy.extensions.logstats] INFO: Crawled 358 pages (at 10 pages/min), scraped 780 items (at 93 items/min)
2026-03-27 10:43:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-27 10:43:07 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-27 10:43:07 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-27 10:43:07 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE73392%27 HTTP/1.1" 200 None
2026-03-27 10:43:07 [auto1.de] INFO: Scrape type for GE73392: 2
2026-03-27 10:43:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2211956b-d640-524c-aa47-e3c27fd05087 with identifier: GE73392
2026-03-27 10:43:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2211956b-d640-524c-aa47-e3c27fd05087 with scrape type 2
2026-03-27 10:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2211956b-d640-524c-aa47-e3c27fd05087 with scrape type 2
2026-03-27 10:43:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2211956b-d640-524c-aa47-e3c27fd05087, identifier: GE73392
2026-03-27 10:43:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2211956b-d640-524c-aa47-e3c27fd05087 with identifier: GE73392
2026-03-27 10:43:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2211956b-d640-524c-aa47-e3c27fd05087 with identifier: GE73392
2026-03-27 10:43:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2211956b-d640-524c-aa47-e3c27fd05087 with identifier: GE73392 to the API
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:02:53Z',
'fuel_type': 'petrol',
'id': '2211956b-d640-524c-aa47-e3c27fd05087',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE73392',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 169383,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-11',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.0 TSI Sound',
'transmission': 'manual',
'trim': 'Sound',
'year': 2017}
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE73392%27 HTTP/1.1" 200 None
2026-03-27 10:43:07 [auto1.de] INFO: Saving data for GE73392: {'auction_closing_time': 1774713773.0, 'created_time': 1773401026.680172, 'last_price_update_time': 1774608187.838423}
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE73392') HTTP/1.1" 204 0
2026-03-27 10:43:07 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-27 10:43:07 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-27 10:43:07 [auto1.de] INFO: Found listing with ID: HK54486
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK54486%27 HTTP/1.1" 200 None
2026-03-27 10:43:07 [auto1.de] INFO: Scrape type for HK54486: 1
2026-03-27 10:43:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:07 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK97582%27 HTTP/1.1" 200 None
2026-03-27 10:43:07 [auto1.de] INFO: Scrape type for AK97582: 2
2026-03-27 10:43:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a96c028-88df-5a2b-ad32-08e90bfc63a7 with identifier: AK97582
2026-03-27 10:43:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a96c028-88df-5a2b-ad32-08e90bfc63a7 with scrape type 2
2026-03-27 10:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a96c028-88df-5a2b-ad32-08e90bfc63a7 with scrape type 2
2026-03-27 10:43:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a96c028-88df-5a2b-ad32-08e90bfc63a7, identifier: AK97582
2026-03-27 10:43:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a96c028-88df-5a2b-ad32-08e90bfc63a7 with identifier: AK97582
2026-03-27 10:43:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a96c028-88df-5a2b-ad32-08e90bfc63a7 with identifier: AK97582
2026-03-27 10:43:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a96c028-88df-5a2b-ad32-08e90bfc63a7 with identifier: AK97582 to the API
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:36:00Z',
'fuel_type': 'diesel',
'id': '3a96c028-88df-5a2b-ad32-08e90bfc63a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK97582',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 171299,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-07',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
'transmission': 'manual',
'trim': 'GTD BlueMotion Tech',
'year': 2016}
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK97582%27 HTTP/1.1" 200 None
2026-03-27 10:43:08 [auto1.de] INFO: Saving data for AK97582: {'auction_closing_time': 1774715760.0, 'created_time': 1773400040.589577, 'last_price_update_time': 1774608188.488157}
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK97582') HTTP/1.1" 204 0
2026-03-27 10:43:08 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-27 10:43:08 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-27 10:43:08 [auto1.de] INFO: Found listing with ID: KK51592
2026-03-27 10:43:08 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD58993%27 HTTP/1.1" 200 None
2026-03-27 10:43:08 [auto1.de] INFO: Scrape type for XD58993: 2
2026-03-27 10:43:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab34de3c-8ce6-5bd7-a9cf-2943e620d101 with identifier: XD58993
2026-03-27 10:43:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab34de3c-8ce6-5bd7-a9cf-2943e620d101 with scrape type 2
2026-03-27 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab34de3c-8ce6-5bd7-a9cf-2943e620d101 with scrape type 2
2026-03-27 10:43:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab34de3c-8ce6-5bd7-a9cf-2943e620d101, identifier: XD58993
2026-03-27 10:43:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:08 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ25575%27 HTTP/1.1" 200 None
2026-03-27 10:43:08 [auto1.de] INFO: Scrape type for EJ25575: 0
2026-03-27 10:43:08 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-27 10:43:08 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-27 10:43:08 [auto1.de] INFO: Found listing with ID: WJ93096
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ93096%27 HTTP/1.1" 200 None
2026-03-27 10:43:08 [auto1.de] INFO: Scrape type for WJ93096: 1
2026-03-27 10:43:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab34de3c-8ce6-5bd7-a9cf-2943e620d101 with identifier: XD58993
2026-03-27 10:43:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab34de3c-8ce6-5bd7-a9cf-2943e620d101 with identifier: XD58993
2026-03-27 10:43:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab34de3c-8ce6-5bd7-a9cf-2943e620d101 with identifier: XD58993 to the API
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:32:49Z',
'fuel_type': 'petrol',
'id': 'ab34de3c-8ce6-5bd7-a9cf-2943e620d101',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD58993',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 79439,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-19',
'seller_name': None,
'title': 'BMW 1er 118i',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-27 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD58993%27 HTTP/1.1" 200 None
2026-03-27 10:43:09 [auto1.de] INFO: Saving data for XD58993: {'auction_closing_time': 1774715569.0, 'created_time': 1774292078.54508, 'last_price_update_time': 1774608189.55123}
2026-03-27 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD58993') HTTP/1.1" 204 0
2026-03-27 10:43:09 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-27 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA88457%27 HTTP/1.1" 200 None
2026-03-27 10:43:09 [auto1.de] INFO: Scrape type for PA88457: 2
2026-03-27 10:43:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a24cda0c-a7b8-5c54-87f4-2082439417f9 with identifier: PA88457
2026-03-27 10:43:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a24cda0c-a7b8-5c54-87f4-2082439417f9 with scrape type 2
2026-03-27 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a24cda0c-a7b8-5c54-87f4-2082439417f9 with scrape type 2
2026-03-27 10:43:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a24cda0c-a7b8-5c54-87f4-2082439417f9, identifier: PA88457
2026-03-27 10:43:09 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-27 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE74408%27 HTTP/1.1" 200 None
2026-03-27 10:43:09 [auto1.de] INFO: Scrape type for PE74408: 2
2026-03-27 10:43:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 159e9741-1e31-5964-8229-43882a37d005 with identifier: PE74408
2026-03-27 10:43:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 159e9741-1e31-5964-8229-43882a37d005 with scrape type 2
2026-03-27 10:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 159e9741-1e31-5964-8229-43882a37d005 with scrape type 2
2026-03-27 10:43:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 159e9741-1e31-5964-8229-43882a37d005, identifier: PE74408
2026-03-27 10:43:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a24cda0c-a7b8-5c54-87f4-2082439417f9 with identifier: PA88457
2026-03-27 10:43:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a24cda0c-a7b8-5c54-87f4-2082439417f9 with identifier: PA88457
2026-03-27 10:43:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a24cda0c-a7b8-5c54-87f4-2082439417f9 with identifier: PA88457 to the API
2026-03-27 10:43:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:35:30Z',
'fuel_type': 'petrol',
'id': 'a24cda0c-a7b8-5c54-87f4-2082439417f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA88457',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 99627,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-17',
'seller_name': None,
'title': 'Kia Sportage 1.6 GDI FIFA World Cup Edition 2WD',
'transmission': 'manual',
'trim': 'FIFA World Cup Edition 2WD',
'year': 2014}
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA88457%27 HTTP/1.1" 200 None
2026-03-27 10:43:10 [auto1.de] INFO: Saving data for PA88457: {'auction_closing_time': 1774715730.0, 'created_time': 1773427388.413136, 'last_price_update_time': 1774608190.212094}
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA88457') HTTP/1.1" 204 0
2026-03-27 10:43:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 159e9741-1e31-5964-8229-43882a37d005 with identifier: PE74408
2026-03-27 10:43:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 159e9741-1e31-5964-8229-43882a37d005 with identifier: PE74408
2026-03-27 10:43:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 159e9741-1e31-5964-8229-43882a37d005 with identifier: PE74408 to the API
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-28T16:02:12Z',
'fuel_type': 'petrol',
'id': '159e9741-1e31-5964-8229-43882a37d005',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE74408',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 112645,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-26',
'seller_name': None,
'title': 'Skoda Fabia 1.2 Special',
'transmission': 'manual',
'trim': 'Special',
'year': 2011}
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE74408%27 HTTP/1.1" 200 None
2026-03-27 10:43:10 [auto1.de] INFO: Saving data for PE74408: {'auction_closing_time': 1774713732.0, 'created_time': 1773686803.45991, 'last_price_update_time': 1774608190.57187}
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE74408') HTTP/1.1" 204 0
2026-03-27 10:43:10 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU93791%27 HTTP/1.1" 200 None
2026-03-27 10:43:10 [auto1.de] INFO: Scrape type for CU93791: 2
2026-03-27 10:43:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88a0781d-9fb6-5681-a8d9-72f4f6bad567 with identifier: CU93791
2026-03-27 10:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88a0781d-9fb6-5681-a8d9-72f4f6bad567 with scrape type 2
2026-03-27 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88a0781d-9fb6-5681-a8d9-72f4f6bad567 with scrape type 2
2026-03-27 10:43:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88a0781d-9fb6-5681-a8d9-72f4f6bad567, identifier: CU93791
2026-03-27 10:43:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:10 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY58997%27 HTTP/1.1" 200 None
2026-03-27 10:43:10 [auto1.de] INFO: Scrape type for UY58997: 2
2026-03-27 10:43:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54791adc-5d23-549f-bd47-19b2bc5830b8 with identifier: UY58997
2026-03-27 10:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54791adc-5d23-549f-bd47-19b2bc5830b8 with scrape type 2
2026-03-27 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54791adc-5d23-549f-bd47-19b2bc5830b8 with scrape type 2
2026-03-27 10:43:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54791adc-5d23-549f-bd47-19b2bc5830b8, identifier: UY58997
2026-03-27 10:43:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88a0781d-9fb6-5681-a8d9-72f4f6bad567 with identifier: CU93791
2026-03-27 10:43:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88a0781d-9fb6-5681-a8d9-72f4f6bad567 with identifier: CU93791
2026-03-27 10:43:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88a0781d-9fb6-5681-a8d9-72f4f6bad567 with identifier: CU93791 to the API
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:04:41Z',
'fuel_type': 'diesel',
'id': '88a0781d-9fb6-5681-a8d9-72f4f6bad567',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU93791',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 191121,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-21',
'seller_name': None,
'title': 'Mercedes-Benz Vito 115 CDI lang',
'transmission': 'manual',
'trim': 'lang',
'year': 2010}
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU93791%27 HTTP/1.1" 200 None
2026-03-27 10:43:11 [auto1.de] INFO: Saving data for CU93791: {'auction_closing_time': 1774713881.0, 'created_time': 1773135415.80223, 'last_price_update_time': 1774608191.128501}
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU93791') HTTP/1.1" 204 0
2026-03-27 10:43:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54791adc-5d23-549f-bd47-19b2bc5830b8 with identifier: UY58997
2026-03-27 10:43:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54791adc-5d23-549f-bd47-19b2bc5830b8 with identifier: UY58997
2026-03-27 10:43:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54791adc-5d23-549f-bd47-19b2bc5830b8 with identifier: UY58997 to the API
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:23:57Z',
'fuel_type': 'petrol',
'id': '54791adc-5d23-549f-bd47-19b2bc5830b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY58997',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 211633,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-23',
'seller_name': None,
'title': 'Seat Leon 1.2 TSI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2015}
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY58997%27 HTTP/1.1" 200 None
2026-03-27 10:43:11 [auto1.de] INFO: Saving data for UY58997: {'auction_closing_time': 1774715037.0, 'created_time': 1773400151.835633, 'last_price_update_time': 1774608191.470496}
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY58997') HTTP/1.1" 204 0
2026-03-27 10:43:11 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-27 10:43:11 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-27 10:43:11 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-27 10:43:11 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-27 10:43:11 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-27 10:43:11 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47046%27 HTTP/1.1" 200 None
2026-03-27 10:43:11 [auto1.de] INFO: Scrape type for EN47046: 2
2026-03-27 10:43:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb8a476f-fbfb-5fb0-aad4-d11096cca2f8 with identifier: EN47046
2026-03-27 10:43:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb8a476f-fbfb-5fb0-aad4-d11096cca2f8 with scrape type 2
2026-03-27 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb8a476f-fbfb-5fb0-aad4-d11096cca2f8 with scrape type 2
2026-03-27 10:43:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb8a476f-fbfb-5fb0-aad4-d11096cca2f8, identifier: EN47046
2026-03-27 10:43:11 [auto1.de] INFO: Found listing with ID: GG04913
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG04913%27 HTTP/1.1" 200 None
2026-03-27 10:43:11 [auto1.de] INFO: Scrape type for GG04913: 1
2026-03-27 10:43:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb8a476f-fbfb-5fb0-aad4-d11096cca2f8 with identifier: EN47046
2026-03-27 10:43:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb8a476f-fbfb-5fb0-aad4-d11096cca2f8 with identifier: EN47046
2026-03-27 10:43:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb8a476f-fbfb-5fb0-aad4-d11096cca2f8 with identifier: EN47046 to the API
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:23:37Z',
'fuel_type': 'petrol',
'id': 'bb8a476f-fbfb-5fb0-aad4-d11096cca2f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN47046',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII Sportsvan',
'odometer': 50733,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-09',
'seller_name': None,
'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Comfortline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion Tech',
'year': 2014}
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47046%27 HTTP/1.1" 200 None
2026-03-27 10:43:11 [auto1.de] INFO: Saving data for EN47046: {'auction_closing_time': 1774715017.0, 'created_time': 1773304504.903672, 'last_price_update_time': 1774608191.948977}
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN47046') HTTP/1.1" 204 0
2026-03-27 10:43:12 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-27 10:43:12 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-27 10:43:12 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-27 10:43:12 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-27 10:43:12 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-27 10:43:12 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA01437%27 HTTP/1.1" 200 None
2026-03-27 10:43:12 [auto1.de] INFO: Scrape type for FA01437: 2
2026-03-27 10:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf7faba9-cc21-5799-99dc-585bf8cf5059 with identifier: FA01437
2026-03-27 10:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf7faba9-cc21-5799-99dc-585bf8cf5059 with scrape type 2
2026-03-27 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf7faba9-cc21-5799-99dc-585bf8cf5059 with scrape type 2
2026-03-27 10:43:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf7faba9-cc21-5799-99dc-585bf8cf5059, identifier: FA01437
2026-03-27 10:43:12 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-27 10:43:12 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV64166%27 HTTP/1.1" 200 None
2026-03-27 10:43:12 [auto1.de] INFO: Scrape type for ZV64166: 2
2026-03-27 10:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099 with identifier: ZV64166
2026-03-27 10:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099 with scrape type 2
2026-03-27 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099 with scrape type 2
2026-03-27 10:43:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099, identifier: ZV64166
2026-03-27 10:43:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf7faba9-cc21-5799-99dc-585bf8cf5059 with identifier: FA01437
2026-03-27 10:43:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf7faba9-cc21-5799-99dc-585bf8cf5059 with identifier: FA01437
2026-03-27 10:43:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf7faba9-cc21-5799-99dc-585bf8cf5059 with identifier: FA01437 to the API
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:56:43Z',
'fuel_type': 'diesel',
'id': 'cf7faba9-cc21-5799-99dc-585bf8cf5059',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA01437',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 182275,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-10',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Allstar BlueMotion Tech',
'transmission': 'manual',
'trim': 'Allstar BlueMotion Tech',
'year': 2017}
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA01437%27 HTTP/1.1" 200 None
2026-03-27 10:43:12 [auto1.de] INFO: Saving data for FA01437: {'auction_closing_time': 1774717003.0, 'created_time': 1773468869.642692, 'last_price_update_time': 1774608192.629415}
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA01437') HTTP/1.1" 204 0
2026-03-27 10:43:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099 with identifier: ZV64166
2026-03-27 10:43:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099 with identifier: ZV64166
2026-03-27 10:43:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099 with identifier: ZV64166 to the API
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-28T16:08:54Z',
'fuel_type': 'diesel',
'id': '6d7bf11e-5fd9-5e9c-b328-d13dc5b6c099',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV64166',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 158433,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-28',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 CDI 4Matic BlueTEC Avantgarde',
'transmission': 'automatic',
'trim': '4Matic BlueTEC Avantgarde',
'year': 2015}
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV64166%27 HTTP/1.1" 200 None
2026-03-27 10:43:13 [auto1.de] INFO: Saving data for ZV64166: {'auction_closing_time': 1774714134.0, 'created_time': 1773859696.164347, 'last_price_update_time': 1774608193.021726}
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV64166') HTTP/1.1" 204 0
2026-03-27 10:43:13 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF96299%27 HTTP/1.1" 200 None
2026-03-27 10:43:13 [auto1.de] INFO: Scrape type for PF96299: 2
2026-03-27 10:43:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbc4fbc3-f0da-5025-92a3-c519958b6b77 with identifier: PF96299
2026-03-27 10:43:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbc4fbc3-f0da-5025-92a3-c519958b6b77 with scrape type 2
2026-03-27 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbc4fbc3-f0da-5025-92a3-c519958b6b77 with scrape type 2
2026-03-27 10:43:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbc4fbc3-f0da-5025-92a3-c519958b6b77, identifier: PF96299
2026-03-27 10:43:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:13 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL44277%27 HTTP/1.1" 200 None
2026-03-27 10:43:13 [auto1.de] INFO: Scrape type for JL44277: 2
2026-03-27 10:43:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19f22e8c-2112-5084-a9a8-ad17ff597449 with identifier: JL44277
2026-03-27 10:43:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19f22e8c-2112-5084-a9a8-ad17ff597449 with scrape type 2
2026-03-27 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19f22e8c-2112-5084-a9a8-ad17ff597449 with scrape type 2
2026-03-27 10:43:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19f22e8c-2112-5084-a9a8-ad17ff597449, identifier: JL44277
2026-03-27 10:43:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbc4fbc3-f0da-5025-92a3-c519958b6b77 with identifier: PF96299
2026-03-27 10:43:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbc4fbc3-f0da-5025-92a3-c519958b6b77 with identifier: PF96299
2026-03-27 10:43:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbc4fbc3-f0da-5025-92a3-c519958b6b77 with identifier: PF96299 to the API
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:25:22Z',
'fuel_type': 'diesel',
'id': 'bbc4fbc3-f0da-5025-92a3-c519958b6b77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF96299',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 245018,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-08',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2013}
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF96299%27 HTTP/1.1" 200 None
2026-03-27 10:43:13 [auto1.de] INFO: Saving data for PF96299: {'auction_closing_time': 1774715122.0, 'created_time': 1773860148.160139, 'last_price_update_time': 1774608193.595957}
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF96299') HTTP/1.1" 204 0
2026-03-27 10:43:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19f22e8c-2112-5084-a9a8-ad17ff597449 with identifier: JL44277
2026-03-27 10:43:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19f22e8c-2112-5084-a9a8-ad17ff597449 with identifier: JL44277
2026-03-27 10:43:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19f22e8c-2112-5084-a9a8-ad17ff597449 with identifier: JL44277 to the API
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 380,
'expiration_date': '2026-03-28T16:59:11Z',
'fuel_type': 'petrol',
'id': '19f22e8c-2112-5084-a9a8-ad17ff597449',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL44277',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 102170,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-26',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 45 Shooting Brake AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2018}
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL44277%27 HTTP/1.1" 200 None
2026-03-27 10:43:13 [auto1.de] INFO: Saving data for JL44277: {'auction_closing_time': 1774717151.0, 'created_time': 1773400272.865453, 'last_price_update_time': 1774608193.941439}
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL44277') HTTP/1.1" 204 0
2026-03-27 10:43:13 [auto1.de] INFO: Found listing with ID: YW30878
2026-03-27 10:43:13 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS30363%27 HTTP/1.1" 200 None
2026-03-27 10:43:13 [auto1.de] INFO: Scrape type for WS30363: 2
2026-03-27 10:43:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d40c8af3-85dc-5213-beaf-c8ffeb1c4308 with identifier: WS30363
2026-03-27 10:43:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d40c8af3-85dc-5213-beaf-c8ffeb1c4308 with scrape type 2
2026-03-27 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d40c8af3-85dc-5213-beaf-c8ffeb1c4308 with scrape type 2
2026-03-27 10:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d40c8af3-85dc-5213-beaf-c8ffeb1c4308, identifier: WS30363
2026-03-27 10:43:14 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-27 10:43:14 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47676%27 HTTP/1.1" 200 None
2026-03-27 10:43:14 [auto1.de] INFO: Scrape type for ZS47676: 2
2026-03-27 10:43:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed011539-6c54-56ca-a50a-4ce55ee95ad3 with identifier: ZS47676
2026-03-27 10:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed011539-6c54-56ca-a50a-4ce55ee95ad3 with scrape type 2
2026-03-27 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed011539-6c54-56ca-a50a-4ce55ee95ad3 with scrape type 2
2026-03-27 10:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed011539-6c54-56ca-a50a-4ce55ee95ad3, identifier: ZS47676
2026-03-27 10:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d40c8af3-85dc-5213-beaf-c8ffeb1c4308 with identifier: WS30363
2026-03-27 10:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d40c8af3-85dc-5213-beaf-c8ffeb1c4308 with identifier: WS30363
2026-03-27 10:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d40c8af3-85dc-5213-beaf-c8ffeb1c4308 with identifier: WS30363 to the API
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:17:59Z',
'fuel_type': 'diesel',
'id': 'd40c8af3-85dc-5213-beaf-c8ffeb1c4308',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS30363',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 183701,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-21',
'seller_name': None,
'title': 'BMW 1er 116d',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS30363%27 HTTP/1.1" 200 None
2026-03-27 10:43:14 [auto1.de] INFO: Saving data for WS30363: {'auction_closing_time': 1774714679.0, 'created_time': 1773776182.625323, 'last_price_update_time': 1774608194.57399}
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS30363') HTTP/1.1" 204 0
2026-03-27 10:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ79893/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed011539-6c54-56ca-a50a-4ce55ee95ad3 with identifier: ZS47676
2026-03-27 10:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed011539-6c54-56ca-a50a-4ce55ee95ad3 with identifier: ZS47676
2026-03-27 10:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed011539-6c54-56ca-a50a-4ce55ee95ad3 with identifier: ZS47676 to the API
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:42:57Z',
'fuel_type': 'diesel',
'id': 'ed011539-6c54-56ca-a50a-4ce55ee95ad3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS47676',
'listing': 'auction',
'make': 'Volvo',
'model': 'S80',
'odometer': 297353,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-13',
'seller_name': None,
'title': 'Volvo S80 2.0 D4 Summum',
'transmission': 'automatic',
'trim': 'Summum',
'year': 2016}
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47676%27 HTTP/1.1" 200 None
2026-03-27 10:43:15 [auto1.de] INFO: Saving data for ZS47676: {'auction_closing_time': 1774716177.0, 'created_time': 1773659610.705324, 'last_price_update_time': 1774608195.09844}
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS47676') HTTP/1.1" 204 0
2026-03-27 10:43:15 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-27 10:43:15 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL62342%27 HTTP/1.1" 200 None
2026-03-27 10:43:15 [auto1.de] INFO: Scrape type for XL62342: 2
2026-03-27 10:43:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f1918c4-2534-5147-91cd-34cec44efe9c with identifier: XL62342
2026-03-27 10:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f1918c4-2534-5147-91cd-34cec44efe9c with scrape type 2
2026-03-27 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f1918c4-2534-5147-91cd-34cec44efe9c with scrape type 2
2026-03-27 10:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f1918c4-2534-5147-91cd-34cec44efe9c, identifier: XL62342
2026-03-27 10:43:15 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39650%27 HTTP/1.1" 200 None
2026-03-27 10:43:15 [auto1.de] INFO: Scrape type for EG39650: 2
2026-03-27 10:43:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eeafaff6-53e5-5f11-8bfc-7fca17bbadd7 with identifier: EG39650
2026-03-27 10:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eeafaff6-53e5-5f11-8bfc-7fca17bbadd7 with scrape type 2
2026-03-27 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eeafaff6-53e5-5f11-8bfc-7fca17bbadd7 with scrape type 2
2026-03-27 10:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eeafaff6-53e5-5f11-8bfc-7fca17bbadd7, identifier: EG39650
2026-03-27 10:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f1918c4-2534-5147-91cd-34cec44efe9c with identifier: XL62342
2026-03-27 10:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f1918c4-2534-5147-91cd-34cec44efe9c with identifier: XL62342
2026-03-27 10:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f1918c4-2534-5147-91cd-34cec44efe9c with identifier: XL62342 to the API
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-28T16:48:56Z',
'fuel_type': 'diesel',
'id': '0f1918c4-2534-5147-91cd-34cec44efe9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL62342',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 195504,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-15',
'seller_name': None,
'title': 'Citroen Berlingo 1.6 e-HDi Selection',
'transmission': 'automatic',
'trim': 'Selection',
'year': 2012}
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL62342%27 HTTP/1.1" 200 None
2026-03-27 10:43:15 [auto1.de] INFO: Saving data for XL62342: {'auction_closing_time': 1774716536.0, 'created_time': 1773776268.888814, 'last_price_update_time': 1774608195.70059}
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL62342') HTTP/1.1" 204 0
2026-03-27 10:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eeafaff6-53e5-5f11-8bfc-7fca17bbadd7 with identifier: EG39650
2026-03-27 10:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eeafaff6-53e5-5f11-8bfc-7fca17bbadd7 with identifier: EG39650
2026-03-27 10:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eeafaff6-53e5-5f11-8bfc-7fca17bbadd7 with identifier: EG39650 to the API
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:51:11Z',
'fuel_type': 'petrol',
'id': 'eeafaff6-53e5-5f11-8bfc-7fca17bbadd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG39650',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 23305,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-30',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.5 TSI ACT Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2022}
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39650%27 HTTP/1.1" 200 None
2026-03-27 10:43:16 [auto1.de] INFO: Saving data for EG39650: {'auction_closing_time': 1774716671.0, 'created_time': 1773427446.950694, 'last_price_update_time': 1774608196.081404}
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG39650') HTTP/1.1" 204 0
2026-03-27 10:43:16 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-27 10:43:16 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV32404%27 HTTP/1.1" 200 None
2026-03-27 10:43:16 [auto1.de] INFO: Scrape type for JV32404: 2
2026-03-27 10:43:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d2535b8-9fd6-519a-a0c4-0e668ad58837 with identifier: JV32404
2026-03-27 10:43:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d2535b8-9fd6-519a-a0c4-0e668ad58837 with scrape type 2
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d2535b8-9fd6-519a-a0c4-0e668ad58837 with scrape type 2
2026-03-27 10:43:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d2535b8-9fd6-519a-a0c4-0e668ad58837, identifier: JV32404
2026-03-27 10:43:16 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-27 10:43:16 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62018%27 HTTP/1.1" 200 None
2026-03-27 10:43:16 [auto1.de] INFO: Scrape type for KB62018: 2
2026-03-27 10:43:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a8946c4-b99a-539b-844f-81a6e922f860 with identifier: KB62018
2026-03-27 10:43:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a8946c4-b99a-539b-844f-81a6e922f860 with scrape type 2
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a8946c4-b99a-539b-844f-81a6e922f860 with scrape type 2
2026-03-27 10:43:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a8946c4-b99a-539b-844f-81a6e922f860, identifier: KB62018
2026-03-27 10:43:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d2535b8-9fd6-519a-a0c4-0e668ad58837 with identifier: JV32404
2026-03-27 10:43:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d2535b8-9fd6-519a-a0c4-0e668ad58837 with identifier: JV32404
2026-03-27 10:43:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d2535b8-9fd6-519a-a0c4-0e668ad58837 with identifier: JV32404 to the API
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 232,
'expiration_date': '2026-03-28T16:57:02Z',
'fuel_type': 'diesel',
'id': '9d2535b8-9fd6-519a-a0c4-0e668ad58837',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV32404',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 351956,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-10-18',
'seller_name': None,
'title': 'Audi A4 3.0 V6 TDI quattro',
'transmission': 'manual',
'trim': 'quattro',
'year': 2006}
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV32404%27 HTTP/1.1" 200 None
2026-03-27 10:43:16 [auto1.de] INFO: Saving data for JV32404: {'auction_closing_time': 1774717022.0, 'created_time': 1773400107.858584, 'last_price_update_time': 1774608196.699113}
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV32404') HTTP/1.1" 204 0
2026-03-27 10:43:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a8946c4-b99a-539b-844f-81a6e922f860 with identifier: KB62018
2026-03-27 10:43:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a8946c4-b99a-539b-844f-81a6e922f860 with identifier: KB62018
2026-03-27 10:43:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a8946c4-b99a-539b-844f-81a6e922f860 with identifier: KB62018 to the API
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-28T16:05:16Z',
'fuel_type': 'petrol',
'id': '3a8946c4-b99a-539b-844f-81a6e922f860',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB62018',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 87971,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-20',
'seller_name': None,
'title': 'Dacia Sandero 1.0 Essentiel',
'transmission': 'manual',
'trim': 'Essentiel',
'year': 2016}
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62018%27 HTTP/1.1" 200 None
2026-03-27 10:43:17 [auto1.de] INFO: Saving data for KB62018: {'auction_closing_time': 1774713916.0, 'created_time': 1773687140.572818, 'last_price_update_time': 1774608197.065836}
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB62018') HTTP/1.1" 204 0
2026-03-27 10:43:17 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-27 10:43:17 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-27 10:43:17 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC75051%27 HTTP/1.1" 200 None
2026-03-27 10:43:17 [auto1.de] INFO: Scrape type for CC75051: 2
2026-03-27 10:43:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2460f77-95c6-5715-bbc6-95a00bb6111b with identifier: CC75051
2026-03-27 10:43:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2460f77-95c6-5715-bbc6-95a00bb6111b with scrape type 2
2026-03-27 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2460f77-95c6-5715-bbc6-95a00bb6111b with scrape type 2
2026-03-27 10:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2460f77-95c6-5715-bbc6-95a00bb6111b, identifier: CC75051
2026-03-27 10:43:17 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK94674%27 HTTP/1.1" 200 None
2026-03-27 10:43:17 [auto1.de] INFO: Scrape type for BK94674: 2
2026-03-27 10:43:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 198b82d6-c514-566b-92a6-0e5d2dc209e3 with identifier: BK94674
2026-03-27 10:43:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 198b82d6-c514-566b-92a6-0e5d2dc209e3 with scrape type 2
2026-03-27 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 198b82d6-c514-566b-92a6-0e5d2dc209e3 with scrape type 2
2026-03-27 10:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 198b82d6-c514-566b-92a6-0e5d2dc209e3, identifier: BK94674
2026-03-27 10:43:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2460f77-95c6-5715-bbc6-95a00bb6111b with identifier: CC75051
2026-03-27 10:43:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2460f77-95c6-5715-bbc6-95a00bb6111b with identifier: CC75051
2026-03-27 10:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2460f77-95c6-5715-bbc6-95a00bb6111b with identifier: CC75051 to the API
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:02:04Z',
'fuel_type': 'diesel',
'id': 'c2460f77-95c6-5715-bbc6-95a00bb6111b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC75051',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 253612,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-18',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Style 4x4',
'transmission': 'automatic',
'trim': 'Style 4x4',
'year': 2016}
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC75051%27 HTTP/1.1" 200 None
2026-03-27 10:43:17 [auto1.de] INFO: Saving data for CC75051: {'auction_closing_time': 1774713724.0, 'created_time': 1773732634.766448, 'last_price_update_time': 1774608197.691427}
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC75051') HTTP/1.1" 204 0
2026-03-27 10:43:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 198b82d6-c514-566b-92a6-0e5d2dc209e3 with identifier: BK94674
2026-03-27 10:43:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 198b82d6-c514-566b-92a6-0e5d2dc209e3 with identifier: BK94674
2026-03-27 10:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 198b82d6-c514-566b-92a6-0e5d2dc209e3 with identifier: BK94674 to the API
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:59:11Z',
'fuel_type': 'diesel',
'id': '198b82d6-c514-566b-92a6-0e5d2dc209e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK94674',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 154701,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-07',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line 2WD',
'transmission': 'manual',
'trim': 'Exclusive-Line 2WD',
'year': 2016}
2026-03-27 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK94674%27 HTTP/1.1" 200 None
2026-03-27 10:43:18 [auto1.de] INFO: Saving data for BK94674: {'auction_closing_time': 1774717151.0, 'created_time': 1773307443.015212, 'last_price_update_time': 1774608198.138066}
2026-03-27 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK94674') HTTP/1.1" 204 0
2026-03-27 10:43:18 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-27 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF62239%27 HTTP/1.1" 200 None
2026-03-27 10:43:18 [auto1.de] INFO: Scrape type for GF62239: 2
2026-03-27 10:43:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fa94e8c-48c3-5744-a920-05845ee84e20 with identifier: GF62239
2026-03-27 10:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fa94e8c-48c3-5744-a920-05845ee84e20 with scrape type 2
2026-03-27 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fa94e8c-48c3-5744-a920-05845ee84e20 with scrape type 2
2026-03-27 10:43:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fa94e8c-48c3-5744-a920-05845ee84e20, identifier: GF62239
2026-03-27 10:43:18 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-27 10:43:18 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-27 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD14897%27 HTTP/1.1" 200 None
2026-03-27 10:43:18 [auto1.de] INFO: Scrape type for HD14897: 2
2026-03-27 10:43:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41c581c3-0e12-5593-a40f-1af187fc8a22 with identifier: HD14897
2026-03-27 10:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41c581c3-0e12-5593-a40f-1af187fc8a22 with scrape type 2
2026-03-27 10:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41c581c3-0e12-5593-a40f-1af187fc8a22 with scrape type 2
2026-03-27 10:43:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41c581c3-0e12-5593-a40f-1af187fc8a22, identifier: HD14897
2026-03-27 10:43:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fa94e8c-48c3-5744-a920-05845ee84e20 with identifier: GF62239
2026-03-27 10:43:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fa94e8c-48c3-5744-a920-05845ee84e20 with identifier: GF62239
2026-03-27 10:43:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fa94e8c-48c3-5744-a920-05845ee84e20 with identifier: GF62239 to the API
2026-03-27 10:43:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:54:50Z',
'fuel_type': 'diesel',
'id': '8fa94e8c-48c3-5744-a920-05845ee84e20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF62239',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto Evo',
'odometer': 179392,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-19',
'seller_name': None,
'title': 'Fiat Punto Evo 1.3 JTD Cult',
'transmission': 'manual',
'trim': 'Cult',
'year': 2014}
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF62239%27 HTTP/1.1" 200 None
2026-03-27 10:43:19 [auto1.de] INFO: Saving data for GF62239: {'auction_closing_time': 1774716890.0, 'created_time': 1773399870.549056, 'last_price_update_time': 1774608199.139316}
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF62239') HTTP/1.1" 204 0
2026-03-27 10:43:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41c581c3-0e12-5593-a40f-1af187fc8a22 with identifier: HD14897
2026-03-27 10:43:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41c581c3-0e12-5593-a40f-1af187fc8a22 with identifier: HD14897
2026-03-27 10:43:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41c581c3-0e12-5593-a40f-1af187fc8a22 with identifier: HD14897 to the API
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 382,
'expiration_date': '2026-03-28T16:23:17Z',
'fuel_type': 'diesel',
'id': '41c581c3-0e12-5593-a40f-1af187fc8a22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD14897',
'listing': 'auction',
'make': 'Porsche',
'model': 'Cayenne',
'odometer': 259189,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-21',
'seller_name': None,
'title': 'Porsche Cayenne S Diesel',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD14897%27 HTTP/1.1" 200 None
2026-03-27 10:43:19 [auto1.de] INFO: Saving data for HD14897: {'auction_closing_time': 1774714997.0, 'created_time': 1773860073.807691, 'last_price_update_time': 1774608199.548913}
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD14897') HTTP/1.1" 204 0
2026-03-27 10:43:19 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ79939%27 HTTP/1.1" 200 None
2026-03-27 10:43:19 [auto1.de] INFO: Scrape type for DZ79939: 2
2026-03-27 10:43:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52deb2f5-a259-59b9-bb91-865725f0cc4a with identifier: DZ79939
2026-03-27 10:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52deb2f5-a259-59b9-bb91-865725f0cc4a with scrape type 2
2026-03-27 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52deb2f5-a259-59b9-bb91-865725f0cc4a with scrape type 2
2026-03-27 10:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52deb2f5-a259-59b9-bb91-865725f0cc4a, identifier: DZ79939
2026-03-27 10:43:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL53261> (referer: https://www.auto1.com/v1/car-details-view/KL53261/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:19 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC93517%27 HTTP/1.1" 200 None
2026-03-27 10:43:19 [auto1.de] INFO: Scrape type for EC93517: 2
2026-03-27 10:43:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 682696fe-9d7c-55a9-9875-9e834f054b1e with identifier: EC93517
2026-03-27 10:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 682696fe-9d7c-55a9-9875-9e834f054b1e with scrape type 2
2026-03-27 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 682696fe-9d7c-55a9-9875-9e834f054b1e with scrape type 2
2026-03-27 10:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 682696fe-9d7c-55a9-9875-9e834f054b1e, identifier: EC93517
2026-03-27 10:43:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52deb2f5-a259-59b9-bb91-865725f0cc4a with identifier: DZ79939
2026-03-27 10:43:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52deb2f5-a259-59b9-bb91-865725f0cc4a with identifier: DZ79939
2026-03-27 10:43:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52deb2f5-a259-59b9-bb91-865725f0cc4a with identifier: DZ79939 to the API
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:48:19Z',
'fuel_type': 'diesel',
'id': '52deb2f5-a259-59b9-bb91-865725f0cc4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ79939',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 232234,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-29',
'seller_name': None,
'title': 'Audi A5 Sportback 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ79939%27 HTTP/1.1" 200 None
2026-03-27 10:43:20 [auto1.de] INFO: Saving data for DZ79939: {'auction_closing_time': 1774716499.0, 'created_time': 1773134525.548942, 'last_price_update_time': 1774608200.16818}
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ79939') HTTP/1.1" 204 0
2026-03-27 10:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 682696fe-9d7c-55a9-9875-9e834f054b1e with identifier: EC93517
2026-03-27 10:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 682696fe-9d7c-55a9-9875-9e834f054b1e with identifier: EC93517
2026-03-27 10:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 682696fe-9d7c-55a9-9875-9e834f054b1e with identifier: EC93517 to the API
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 192,
'expiration_date': '2026-03-28T16:42:55Z',
'fuel_type': 'petrol',
'id': '682696fe-9d7c-55a9-9875-9e834f054b1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC93517',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 215659,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-06-25',
'seller_name': None,
'title': 'BMW 3er 325i Edition Exclusiv',
'transmission': 'automatic',
'trim': 'Edition Exclusiv',
'year': 2003}
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC93517%27 HTTP/1.1" 200 None
2026-03-27 10:43:20 [auto1.de] INFO: Saving data for EC93517: {'auction_closing_time': 1774716175.0, 'created_time': 1773400170.806879, 'last_price_update_time': 1774608200.556529}
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC93517') HTTP/1.1" 204 0
2026-03-27 10:43:20 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND02727%27 HTTP/1.1" 200 None
2026-03-27 10:43:20 [auto1.de] INFO: Scrape type for ND02727: 2
2026-03-27 10:43:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93e40ab7-fce8-5160-99be-206fa14f8d8b with identifier: ND02727
2026-03-27 10:43:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93e40ab7-fce8-5160-99be-206fa14f8d8b with scrape type 2
2026-03-27 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93e40ab7-fce8-5160-99be-206fa14f8d8b with scrape type 2
2026-03-27 10:43:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93e40ab7-fce8-5160-99be-206fa14f8d8b, identifier: ND02727
2026-03-27 10:43:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ93096/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:20 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-27 10:43:20 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP47747%27 HTTP/1.1" 200 None
2026-03-27 10:43:20 [auto1.de] INFO: Scrape type for WP47747: 0
2026-03-27 10:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93e40ab7-fce8-5160-99be-206fa14f8d8b with identifier: ND02727
2026-03-27 10:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93e40ab7-fce8-5160-99be-206fa14f8d8b with identifier: ND02727
2026-03-27 10:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93e40ab7-fce8-5160-99be-206fa14f8d8b with identifier: ND02727 to the API
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:16:58Z',
'fuel_type': 'diesel',
'id': '93e40ab7-fce8-5160-99be-206fa14f8d8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND02727',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 37556,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-27',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi L1 Active',
'transmission': 'automatic',
'trim': 'L1 Active',
'year': 2023}
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND02727%27 HTTP/1.1" 200 None
2026-03-27 10:43:21 [auto1.de] INFO: Saving data for ND02727: {'auction_closing_time': 1774714618.0, 'created_time': 1774293438.588247, 'last_price_update_time': 1774608201.040034}
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND02727') HTTP/1.1" 204 0
2026-03-27 10:43:21 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ85569%27 HTTP/1.1" 200 None
2026-03-27 10:43:21 [auto1.de] INFO: Scrape type for AJ85569: 2
2026-03-27 10:43:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f0491a4-301d-5a14-9fc0-017fd1969586 with identifier: AJ85569
2026-03-27 10:43:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f0491a4-301d-5a14-9fc0-017fd1969586 with scrape type 2
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f0491a4-301d-5a14-9fc0-017fd1969586 with scrape type 2
2026-03-27 10:43:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f0491a4-301d-5a14-9fc0-017fd1969586, identifier: AJ85569
2026-03-27 10:43:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75b34864-2364-59c2-a9c5-b94e2c1576f7 with identifier: KL53261
2026-03-27 10:43:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75b34864-2364-59c2-a9c5-b94e2c1576f7 with scrape type 1
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 75b34864-2364-59c2-a9c5-b94e2c1576f7
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff1%252Fd6f1f13454be3d1fd8195311f8cc5fa1%252Fpa%252FKL53261_75d4af90a05470d58eebf4754d23b5c3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_75d4af90a05470d58eebf4754d23b5c3.jpg already downloaded
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff1%252Fd6f1f13454be3d1fd8195311f8cc5fa1%252Fpa%252FKL53261_9a43397315f4ca08cc0881e2696d631e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_9a43397315f4ca08cc0881e2696d631e.jpg already downloaded
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff1%252Fd6f1f13454be3d1fd8195311f8cc5fa1%252Fpa%252FKL53261_40e5d9197049aa42ff4cad0e3c337337.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_40e5d9197049aa42ff4cad0e3c337337.jpg already downloaded
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff1%252Fd6f1f13454be3d1fd8195311f8cc5fa1%252Fpa%252FKL53261_bf75ead60f512191a75e2ddaf47dbf99.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_bf75ead60f512191a75e2ddaf47dbf99.jpg already downloaded
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff1%252Fd6f1f13454be3d1fd8195311f8cc5fa1%252Fpa%252FKL53261_c0d4aff55c3627eb6a8b2df03cdb15b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_c0d4aff55c3627eb6a8b2df03cdb15b1.jpg already downloaded
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff1%252Fd6f1f13454be3d1fd8195311f8cc5fa1%252Fpa%252FKL53261_94883900ecb3ecd0e44c97b942882288.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_94883900ecb3ecd0e44c97b942882288.jpg already downloaded
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff1%252Fd6f1f13454be3d1fd8195311f8cc5fa1%252Fpa%252FKL53261_917e3a17778c1ebf5c90c22657eaf9f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_917e3a17778c1ebf5c90c22657eaf9f2.jpg already downloaded
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff1%252Fd6f1f13454be3d1fd8195311f8cc5fa1%252Fpa%252FKL53261_8366ccd8f793ff3d72cbcc24cc6cdf0d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_8366ccd8f793ff3d72cbcc24cc6cdf0d.jpg already downloaded
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff1%252Fd6f1f13454be3d1fd8195311f8cc5fa1%252Fpa%252FKL53261_87720e98de24d3ff1a6b7d61aa50bf32.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_87720e98de24d3ff1a6b7d61aa50bf32.jpg already downloaded
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff1%252Fd6f1f13454be3d1fd8195311f8cc5fa1%252Fpa%252FKL53261_be83b7bd533cc87d7c6fe8eb166f624d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_be83b7bd533cc87d7c6fe8eb166f624d.jpg already downloaded
2026-03-27 10:43:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75b34864-2364-59c2-a9c5-b94e2c1576f7, identifier: KL53261
2026-03-27 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_67f2f8a055daa7397860683e8d049a2e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f0491a4-301d-5a14-9fc0-017fd1969586 with identifier: AJ85569
2026-03-27 10:43:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f0491a4-301d-5a14-9fc0-017fd1969586 with identifier: AJ85569
2026-03-27 10:43:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f0491a4-301d-5a14-9fc0-017fd1969586 with identifier: AJ85569 to the API
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:22:50Z',
'fuel_type': 'diesel',
'id': '6f0491a4-301d-5a14-9fc0-017fd1969586',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ85569',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 76827,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-04',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi Mild-Hybrid 320 L1 Tourneo Titanium X',
'transmission': 'manual',
'trim': '320 L1 Tourneo Titanium X',
'year': 2020}
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ85569%27 HTTP/1.1" 200 None
2026-03-27 10:43:21 [auto1.de] INFO: Saving data for AJ85569: {'auction_closing_time': 1774714970.0, 'created_time': 1773135031.474286, 'last_price_update_time': 1774608201.856829}
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ85569') HTTP/1.1" 204 0
2026-03-27 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF02739/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75b34864-2364-59c2-a9c5-b94e2c1576f7 with identifier: KL53261
2026-03-27 10:43:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75b34864-2364-59c2-a9c5-b94e2c1576f7 with identifier: KL53261
2026-03-27 10:43:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75b34864-2364-59c2-a9c5-b94e2c1576f7 with identifier: KL53261 to the API
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KL53261>
{'auction_title': '',
'c_o_2_emission_value': 163,
'category': 'Rental',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 250,
'expiration_date': '2026-03-28T16:19:23Z',
'fuel_type': 'petrol',
'id': '75b34864-2364-59c2-a9c5-b94e2c1576f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL53261',
'listing': 'auction',
'location': 'DE, Ellerau',
'make': 'Volvo',
'model': 'S60',
'odometer': 53881,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_75d4af90a05470d58eebf4754d23b5c3.jpg',
'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_9a43397315f4ca08cc0881e2696d631e.jpg',
'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_40e5d9197049aa42ff4cad0e3c337337.jpg',
'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_bf75ead60f512191a75e2ddaf47dbf99.jpg',
'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_c0d4aff55c3627eb6a8b2df03cdb15b1.jpg',
'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_94883900ecb3ecd0e44c97b942882288.jpg',
'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_917e3a17778c1ebf5c90c22657eaf9f2.jpg',
'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_8366ccd8f793ff3d72cbcc24cc6cdf0d.jpg',
'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_87720e98de24d3ff1a6b7d61aa50bf32.jpg',
'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_be83b7bd533cc87d7c6fe8eb166f624d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75b34864-2364-59c2-a9c5-b94e2c1576f7/75b34864-2364-59c2-a9c5-b94e2c1576f7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_75d4af90a05470d58eebf4754d23b5c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75b34864-2364-59c2-a9c5-b94e2c1576f7/75b34864-2364-59c2-a9c5-b94e2c1576f7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_9a43397315f4ca08cc0881e2696d631e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75b34864-2364-59c2-a9c5-b94e2c1576f7/75b34864-2364-59c2-a9c5-b94e2c1576f7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84942,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_40e5d9197049aa42ff4cad0e3c337337.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75b34864-2364-59c2-a9c5-b94e2c1576f7/75b34864-2364-59c2-a9c5-b94e2c1576f7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_bf75ead60f512191a75e2ddaf47dbf99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75b34864-2364-59c2-a9c5-b94e2c1576f7/75b34864-2364-59c2-a9c5-b94e2c1576f7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80531,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_c0d4aff55c3627eb6a8b2df03cdb15b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75b34864-2364-59c2-a9c5-b94e2c1576f7/75b34864-2364-59c2-a9c5-b94e2c1576f7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83493,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_94883900ecb3ecd0e44c97b942882288.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75b34864-2364-59c2-a9c5-b94e2c1576f7/75b34864-2364-59c2-a9c5-b94e2c1576f7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78173,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_917e3a17778c1ebf5c90c22657eaf9f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75b34864-2364-59c2-a9c5-b94e2c1576f7/75b34864-2364-59c2-a9c5-b94e2c1576f7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94875,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_8366ccd8f793ff3d72cbcc24cc6cdf0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75b34864-2364-59c2-a9c5-b94e2c1576f7/75b34864-2364-59c2-a9c5-b94e2c1576f7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_87720e98de24d3ff1a6b7d61aa50bf32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75b34864-2364-59c2-a9c5-b94e2c1576f7/75b34864-2364-59c2-a9c5-b94e2c1576f7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/f1/d6f1f13454be3d1fd8195311f8cc5fa1/pa/KL53261_be83b7bd533cc87d7c6fe8eb166f624d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-04-08',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo S60 2.0 B5 Mild-Hybrid Ultimate Dark AWD',
'transmission': 'automatic',
'trim': 'Ultimate Dark AWD',
'year': 2024}
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53261%27 HTTP/1.1" 200 None
2026-03-27 10:43:22 [auto1.de] INFO: Saving data for KL53261: {'created_time': 1774608202.326095, 'last_price_update_time': 1774608202.326107, 'auction_closing_time': 1774714763.0}
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL53261') HTTP/1.1" 204 0
2026-03-27 10:43:22 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-27 10:43:22 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC90555%27 HTTP/1.1" 200 None
2026-03-27 10:43:22 [auto1.de] INFO: Scrape type for DC90555: 2
2026-03-27 10:43:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 332b15ed-913a-5e5b-9834-defa8e804cac with identifier: DC90555
2026-03-27 10:43:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 332b15ed-913a-5e5b-9834-defa8e804cac with scrape type 2
2026-03-27 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 332b15ed-913a-5e5b-9834-defa8e804cac with scrape type 2
2026-03-27 10:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 332b15ed-913a-5e5b-9834-defa8e804cac, identifier: DC90555
2026-03-27 10:43:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK54486/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 332b15ed-913a-5e5b-9834-defa8e804cac with identifier: DC90555
2026-03-27 10:43:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 332b15ed-913a-5e5b-9834-defa8e804cac with identifier: DC90555
2026-03-27 10:43:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 332b15ed-913a-5e5b-9834-defa8e804cac with identifier: DC90555 to the API
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:42:28Z',
'fuel_type': 'diesel',
'id': '332b15ed-913a-5e5b-9834-defa8e804cac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC90555',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII Sportsvan',
'odometer': 106358,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-18',
'seller_name': None,
'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI Lounge BlueMotion Tech',
'transmission': 'manual',
'trim': 'Lounge BlueMotion Tech',
'year': 2016}
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC90555%27 HTTP/1.1" 200 None
2026-03-27 10:43:23 [auto1.de] INFO: Saving data for DC90555: {'auction_closing_time': 1774716148.0, 'created_time': 1774293285.570253, 'last_price_update_time': 1774608203.342205}
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC90555') HTTP/1.1" 204 0
2026-03-27 10:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be283990>
2026-03-27 10:43:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_67f2f8a055daa7397860683e8d049a2e.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_67f2f8a055daa7397860683e8d049a2e.jpg saved to cache
2026-03-27 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01909457-3e7f-57c6-995b-5a5fb67a33cc
2026-03-27 10:43:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_1a9c266f959bd32659da7ffeccbdc0d7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ79893> (referer: https://www.auto1.com/v1/car-details-view/ZZ79893/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB79504/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_3461a50929b2ec8ecc8137b09f7422b2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:23 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 10535 | hits on page: 40
2026-03-27 10:43:23 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-27 10:43:23 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC90555%27 HTTP/1.1" 200 None
2026-03-27 10:43:23 [auto1.de] INFO: Scrape type for DC90555: 0
2026-03-27 10:43:23 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF42870%27 HTTP/1.1" 200 None
2026-03-27 10:43:23 [auto1.de] INFO: Scrape type for YF42870: 2
2026-03-27 10:43:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22fa2fb4-7dde-567c-bf1f-357452f9d8c5 with identifier: YF42870
2026-03-27 10:43:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22fa2fb4-7dde-567c-bf1f-357452f9d8c5 with scrape type 2
2026-03-27 10:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22fa2fb4-7dde-567c-bf1f-357452f9d8c5 with scrape type 2
2026-03-27 10:43:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22fa2fb4-7dde-567c-bf1f-357452f9d8c5, identifier: YF42870
2026-03-27 10:43:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22fa2fb4-7dde-567c-bf1f-357452f9d8c5 with identifier: YF42870
2026-03-27 10:43:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22fa2fb4-7dde-567c-bf1f-357452f9d8c5 with identifier: YF42870
2026-03-27 10:43:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22fa2fb4-7dde-567c-bf1f-357452f9d8c5 with identifier: YF42870 to the API
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-28T16:21:32Z',
'fuel_type': 'diesel',
'id': '22fa2fb4-7dde-567c-bf1f-357452f9d8c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF42870',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 236141,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-11',
'seller_name': None,
'title': 'BMW 5er 530d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-27 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF42870%27 HTTP/1.1" 200 None
2026-03-27 10:43:24 [auto1.de] INFO: Saving data for YF42870: {'auction_closing_time': 1774714892.0, 'created_time': 1773859512.128462, 'last_price_update_time': 1774608204.963466}
2026-03-27 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF42870') HTTP/1.1" 204 0
2026-03-27 10:43:24 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-27 10:43:24 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-27 10:43:24 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-27 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW56389%27 HTTP/1.1" 200 None
2026-03-27 10:43:25 [auto1.de] INFO: Scrape type for VW56389: 2
2026-03-27 10:43:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e with identifier: VW56389
2026-03-27 10:43:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e with scrape type 2
2026-03-27 10:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e with scrape type 2
2026-03-27 10:43:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e, identifier: VW56389
2026-03-27 10:43:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e with identifier: VW56389
2026-03-27 10:43:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e with identifier: VW56389
2026-03-27 10:43:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9df2b1f6-ab6c-52b5-a538-bfdb67ae759e with identifier: VW56389 to the API
2026-03-27 10:43:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:33:22Z',
'fuel_type': 'petrol',
'id': '9df2b1f6-ab6c-52b5-a538-bfdb67ae759e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW56389',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 62023,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-10',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2014}
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW56389%27 HTTP/1.1" 200 None
2026-03-27 10:43:26 [auto1.de] INFO: Saving data for VW56389: {'auction_closing_time': 1774715602.0, 'created_time': 1773860021.136409, 'last_price_update_time': 1774608206.529879}
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW56389') HTTP/1.1" 204 0
2026-03-27 10:43:26 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-27 10:43:26 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-27 10:43:26 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-27 10:43:26 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR64586%27 HTTP/1.1" 200 None
2026-03-27 10:43:26 [auto1.de] INFO: Scrape type for NR64586: 2
2026-03-27 10:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9 with identifier: NR64586
2026-03-27 10:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9 with scrape type 2
2026-03-27 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9 with scrape type 2
2026-03-27 10:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9, identifier: NR64586
2026-03-27 10:43:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_26d55a198bb0dd6bfc802a2c577b58ca.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9 with identifier: NR64586
2026-03-27 10:43:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9 with identifier: NR64586
2026-03-27 10:43:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56f36d76-2d8c-5eb9-96ca-6e0a9656daf9 with identifier: NR64586 to the API
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 239,
'expiration_date': '2026-03-28T16:47:40Z',
'fuel_type': 'diesel',
'id': '56f36d76-2d8c-5eb9-96ca-6e0a9656daf9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR64586',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 104861,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-26',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 BiTDI RS 4x4',
'transmission': 'automatic',
'trim': 'RS 4x4',
'year': 2019}
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR64586%27 HTTP/1.1" 200 None
2026-03-27 10:43:27 [auto1.de] INFO: Saving data for NR64586: {'auction_closing_time': 1774716460.0, 'created_time': 1773340269.764206, 'last_price_update_time': 1774608207.015453}
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR64586') HTTP/1.1" 204 0
2026-03-27 10:43:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2d86d0>
2026-03-27 10:43:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_1a9c266f959bd32659da7ffeccbdc0d7.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_1a9c266f959bd32659da7ffeccbdc0d7.jpg saved to cache
2026-03-27 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01909457-3e7f-57c6-995b-5a5fb67a33cc
2026-03-27 10:43:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d511f27d-b882-54db-8c50-d5592c08d4bb with identifier: ZZ79893
2026-03-27 10:43:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d511f27d-b882-54db-8c50-d5592c08d4bb with scrape type 1
2026-03-27 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d511f27d-b882-54db-8c50-d5592c08d4bb
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F12%252Fde12e3fbbaf7ab9cc6c6f63fb7d0ab39%252Fpa%252FZZ79893_08adcab7101cd0193b2408a6f4067fe2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/12/de12e3fbbaf7ab9cc6c6f63fb7d0ab39/pa/ZZ79893_08adcab7101cd0193b2408a6f4067fe2.jpg already downloaded
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F12%252Fde12e3fbbaf7ab9cc6c6f63fb7d0ab39%252Fpa%252FZZ79893_cc7f8b69c7392895fafda5e1c5e70a82.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/12/de12e3fbbaf7ab9cc6c6f63fb7d0ab39/pa/ZZ79893_cc7f8b69c7392895fafda5e1c5e70a82.jpg already downloaded
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F12%252Fde12e3fbbaf7ab9cc6c6f63fb7d0ab39%252Fpa%252FZZ79893_acc4f2597f41f7c1cf2c482993d7d620.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/12/de12e3fbbaf7ab9cc6c6f63fb7d0ab39/pa/ZZ79893_acc4f2597f41f7c1cf2c482993d7d620.jpg already downloaded
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F12%252Fde12e3fbbaf7ab9cc6c6f63fb7d0ab39%252Fpa%252FZZ79893_c0c0a40ef5faa046975c796bb807f7ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/12/de12e3fbbaf7ab9cc6c6f63fb7d0ab39/pa/ZZ79893_c0c0a40ef5faa046975c796bb807f7ba.jpg already downloaded
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F12%252Fde12e3fbbaf7ab9cc6c6f63fb7d0ab39%252Fpa%252FZZ79893_4f2370c27c4647f14ffe3ba4bc82938e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/12/de12e3fbbaf7ab9cc6c6f63fb7d0ab39/pa/ZZ79893_4f2370c27c4647f14ffe3ba4bc82938e.jpg already downloaded
2026-03-27 10:43:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d511f27d-b882-54db-8c50-d5592c08d4bb, identifier: ZZ79893
2026-03-27 10:43:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f04d0>
2026-03-27 10:43:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_3461a50929b2ec8ecc8137b09f7422b2.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_3461a50929b2ec8ecc8137b09f7422b2.jpg saved to cache
2026-03-27 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01909457-3e7f-57c6-995b-5a5fb67a33cc
2026-03-27 10:43:27 [auto1.de] INFO: Found listing with ID: CE61200
2026-03-27 10:43:27 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-27 10:43:27 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR34750%27 HTTP/1.1" 200 None
2026-03-27 10:43:27 [auto1.de] INFO: Scrape type for KR34750: 2
2026-03-27 10:43:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46 with identifier: KR34750
2026-03-27 10:43:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46 with scrape type 2
2026-03-27 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46 with scrape type 2
2026-03-27 10:43:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46, identifier: KR34750
2026-03-27 10:43:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d511f27d-b882-54db-8c50-d5592c08d4bb with identifier: ZZ79893
2026-03-27 10:43:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d511f27d-b882-54db-8c50-d5592c08d4bb with identifier: ZZ79893
2026-03-27 10:43:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d511f27d-b882-54db-8c50-d5592c08d4bb with identifier: ZZ79893 to the API
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZZ79893>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.1L',
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:42:23Z',
'fuel_type': 'diesel',
'id': 'd511f27d-b882-54db-8c50-d5592c08d4bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ79893',
'listing': 'auction',
'location': 'DE, Seddiner See',
'make': 'Mercedes-Benz',
'model': 'Sprinter',
'odometer': 313169,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgde/12/de12e3fbbaf7ab9cc6c6f63fb7d0ab39/pa/ZZ79893_08adcab7101cd0193b2408a6f4067fe2.jpg',
'https://img-pa.auto1.com/imgde/12/de12e3fbbaf7ab9cc6c6f63fb7d0ab39/pa/ZZ79893_cc7f8b69c7392895fafda5e1c5e70a82.jpg',
'https://img-pa.auto1.com/imgde/12/de12e3fbbaf7ab9cc6c6f63fb7d0ab39/pa/ZZ79893_acc4f2597f41f7c1cf2c482993d7d620.jpg',
'https://img-pa.auto1.com/imgde/12/de12e3fbbaf7ab9cc6c6f63fb7d0ab39/pa/ZZ79893_c0c0a40ef5faa046975c796bb807f7ba.jpg',
'https://img-pa.auto1.com/imgde/12/de12e3fbbaf7ab9cc6c6f63fb7d0ab39/pa/ZZ79893_4f2370c27c4647f14ffe3ba4bc82938e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d511f27d-b882-54db-8c50-d5592c08d4bb/d511f27d-b882-54db-8c50-d5592c08d4bb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/12/de12e3fbbaf7ab9cc6c6f63fb7d0ab39/pa/ZZ79893_08adcab7101cd0193b2408a6f4067fe2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d511f27d-b882-54db-8c50-d5592c08d4bb/d511f27d-b882-54db-8c50-d5592c08d4bb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/12/de12e3fbbaf7ab9cc6c6f63fb7d0ab39/pa/ZZ79893_cc7f8b69c7392895fafda5e1c5e70a82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d511f27d-b882-54db-8c50-d5592c08d4bb/d511f27d-b882-54db-8c50-d5592c08d4bb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/12/de12e3fbbaf7ab9cc6c6f63fb7d0ab39/pa/ZZ79893_acc4f2597f41f7c1cf2c482993d7d620.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d511f27d-b882-54db-8c50-d5592c08d4bb/d511f27d-b882-54db-8c50-d5592c08d4bb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/12/de12e3fbbaf7ab9cc6c6f63fb7d0ab39/pa/ZZ79893_c0c0a40ef5faa046975c796bb807f7ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d511f27d-b882-54db-8c50-d5592c08d4bb/d511f27d-b882-54db-8c50-d5592c08d4bb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102437,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/12/de12e3fbbaf7ab9cc6c6f63fb7d0ab39/pa/ZZ79893_4f2370c27c4647f14ffe3ba4bc82938e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2003-07-16',
'seats_number': 2,
'seller_name': None,
'title': 'Mercedes-Benz Sprinter 211 CDI',
'transmission': 'manual',
'trim': '',
'year': 2003}
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ79893%27 HTTP/1.1" 200 None
2026-03-27 10:43:28 [auto1.de] INFO: Saving data for ZZ79893: {'created_time': 1774608208.2517, 'last_price_update_time': 1774608208.251711, 'auction_closing_time': 1774716143.0}
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ79893') HTTP/1.1" 204 0
2026-03-27 10:43:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46 with identifier: KR34750
2026-03-27 10:43:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46 with identifier: KR34750
2026-03-27 10:43:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 396db2f4-8d9a-5b2b-ba57-f984ed2e0c46 with identifier: KR34750 to the API
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:39:07Z',
'fuel_type': 'petrol',
'id': '396db2f4-8d9a-5b2b-ba57-f984ed2e0c46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR34750',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 167835,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-31',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Cool&Connect',
'transmission': 'manual',
'trim': 'Cool&Connect',
'year': 2018}
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR34750%27 HTTP/1.1" 200 None
2026-03-27 10:43:28 [auto1.de] INFO: Saving data for KR34750: {'auction_closing_time': 1774715947.0, 'created_time': 1773427340.341182, 'last_price_update_time': 1774608208.938247}
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR34750') HTTP/1.1" 204 0
2026-03-27 10:43:28 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-27 10:43:28 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF21072%27 HTTP/1.1" 200 None
2026-03-27 10:43:28 [auto1.de] INFO: Scrape type for UF21072: 2
2026-03-27 10:43:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64ed201d-2143-55a2-99e3-33ebd4607baa with identifier: UF21072
2026-03-27 10:43:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64ed201d-2143-55a2-99e3-33ebd4607baa with scrape type 2
2026-03-27 10:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64ed201d-2143-55a2-99e3-33ebd4607baa with scrape type 2
2026-03-27 10:43:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64ed201d-2143-55a2-99e3-33ebd4607baa, identifier: UF21072
2026-03-27 10:43:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64ed201d-2143-55a2-99e3-33ebd4607baa with identifier: UF21072
2026-03-27 10:43:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64ed201d-2143-55a2-99e3-33ebd4607baa with identifier: UF21072
2026-03-27 10:43:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64ed201d-2143-55a2-99e3-33ebd4607baa with identifier: UF21072 to the API
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:12:46Z',
'fuel_type': 'petrol',
'id': '64ed201d-2143-55a2-99e3-33ebd4607baa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF21072',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 85362,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-05',
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2018}
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF21072%27 HTTP/1.1" 200 None
2026-03-27 10:43:29 [auto1.de] INFO: Saving data for UF21072: {'auction_closing_time': 1774714366.0, 'created_time': 1773307809.842107, 'last_price_update_time': 1774608209.453531}
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF21072') HTTP/1.1" 204 0
2026-03-27 10:43:29 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB99961%27 HTTP/1.1" 200 None
2026-03-27 10:43:29 [auto1.de] INFO: Scrape type for PB99961: 2
2026-03-27 10:43:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5556c295-1c7e-5a61-8600-fb12ec46023d with identifier: PB99961
2026-03-27 10:43:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5556c295-1c7e-5a61-8600-fb12ec46023d with scrape type 2
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5556c295-1c7e-5a61-8600-fb12ec46023d with scrape type 2
2026-03-27 10:43:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5556c295-1c7e-5a61-8600-fb12ec46023d, identifier: PB99961
2026-03-27 10:43:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be214150>
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F19%252F36190ab05bc1a58703183753071f324f%252Fpa%252FME69590_26d55a198bb0dd6bfc802a2c577b58ca.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_26d55a198bb0dd6bfc802a2c577b58ca.jpg saved to cache
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01909457-3e7f-57c6-995b-5a5fb67a33cc
2026-03-27 10:43:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01909457-3e7f-57c6-995b-5a5fb67a33cc, skipping ID generation
2026-03-27 10:43:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01909457-3e7f-57c6-995b-5a5fb67a33cc with scrape type 1
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01909457-3e7f-57c6-995b-5a5fb67a33cc sending to next pipeline
2026-03-27 10:43:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01909457-3e7f-57c6-995b-5a5fb67a33cc, identifier: ME69590
2026-03-27 10:43:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5556c295-1c7e-5a61-8600-fb12ec46023d with identifier: PB99961
2026-03-27 10:43:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5556c295-1c7e-5a61-8600-fb12ec46023d with identifier: PB99961
2026-03-27 10:43:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5556c295-1c7e-5a61-8600-fb12ec46023d with identifier: PB99961 to the API
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 280,
'expiration_date': '2026-03-28T16:00:56Z',
'fuel_type': 'petrol',
'id': '5556c295-1c7e-5a61-8600-fb12ec46023d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB99961',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 30840,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-09',
'seller_name': None,
'title': 'Hyundai i30 2.0 T-GDI N Performance',
'transmission': 'automatic',
'trim': 'N Performance',
'year': 2022}
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB99961%27 HTTP/1.1" 200 None
2026-03-27 10:43:30 [auto1.de] INFO: Saving data for PB99961: {'auction_closing_time': 1774713656.0, 'created_time': 1773303705.857701, 'last_price_update_time': 1774608210.26498}
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB99961') HTTP/1.1" 204 0
2026-03-27 10:43:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01909457-3e7f-57c6-995b-5a5fb67a33cc with identifier: ME69590
2026-03-27 10:43:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01909457-3e7f-57c6-995b-5a5fb67a33cc with identifier: ME69590
2026-03-27 10:43:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01909457-3e7f-57c6-995b-5a5fb67a33cc with identifier: ME69590 to the API
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_26d55a198bb0dd6bfc802a2c577b58ca.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:20:52Z',
'fuel_type': 'diesel',
'id': '01909457-3e7f-57c6-995b-5a5fb67a33cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME69590',
'listing': 'auction',
'location': 'Mainz-Kastel (Wiesbaden)',
'make': 'Opel',
'model': 'Astra',
'odometer': 151005,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3212293,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_67f2f8a055daa7397860683e8d049a2e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_c522d3ab75e49b5e72780bf3b96988a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3303058,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_1a9c266f959bd32659da7ffeccbdc0d7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83928,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_db8c34bf2bb4f9c3b2de25cfb0ae8e82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_d8df9fdcb63b391dd8358d79020053a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97606,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_89627ad31f255cd76a8dc6aecb21be72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2945345,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_3461a50929b2ec8ecc8137b09f7422b2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3206903,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_26d55a198bb0dd6bfc802a2c577b58ca.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98382,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_470caa10d8b9f5f73345fae77e52c335.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01909457-3e7f-57c6-995b-5a5fb67a33cc/01909457-3e7f-57c6-995b-5a5fb67a33cc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81404,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/19/36190ab05bc1a58703183753071f324f/pa/ME69590_4536190fcac60ba61f16aa92e2098e68.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-06-02',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI DPF Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2015}
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME69590%27 HTTP/1.1" 200 None
2026-03-27 10:43:30 [auto1.de] INFO: Saving data for ME69590: {'created_time': 1774608210.699593, 'last_price_update_time': 1774608210.699603, 'auction_closing_time': 1774714852.0}
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME69590') HTTP/1.1" 204 0
2026-03-27 10:43:30 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM08692%27 HTTP/1.1" 200 None
2026-03-27 10:43:30 [auto1.de] INFO: Scrape type for ZM08692: 2
2026-03-27 10:43:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76f7498c-7868-53a3-a7cb-16238f9114c5 with identifier: ZM08692
2026-03-27 10:43:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76f7498c-7868-53a3-a7cb-16238f9114c5 with scrape type 2
2026-03-27 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76f7498c-7868-53a3-a7cb-16238f9114c5 with scrape type 2
2026-03-27 10:43:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76f7498c-7868-53a3-a7cb-16238f9114c5, identifier: ZM08692
2026-03-27 10:43:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76f7498c-7868-53a3-a7cb-16238f9114c5 with identifier: ZM08692
2026-03-27 10:43:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76f7498c-7868-53a3-a7cb-16238f9114c5 with identifier: ZM08692
2026-03-27 10:43:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76f7498c-7868-53a3-a7cb-16238f9114c5 with identifier: ZM08692 to the API
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 255,
'expiration_date': '2026-03-28T16:34:35Z',
'fuel_type': 'diesel',
'id': '76f7498c-7868-53a3-a7cb-16238f9114c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM08692',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Discovery 4',
'odometer': 287320,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-01',
'seller_name': None,
'title': 'Land Rover Discovery 4 3.0 TD V6 SDV6 HSE',
'transmission': 'automatic',
'trim': 'SDV6 HSE',
'year': 2013}
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM08692%27 HTTP/1.1" 200 None
2026-03-27 10:43:31 [auto1.de] INFO: Saving data for ZM08692: {'auction_closing_time': 1774715675.0, 'created_time': 1774290637.775782, 'last_price_update_time': 1774608211.405202}
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM08692') HTTP/1.1" 204 0
2026-03-27 10:43:31 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-27 10:43:31 [auto1.de] INFO: Found listing with ID: US46384
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US46384%27 HTTP/1.1" 200 None
2026-03-27 10:43:31 [auto1.de] INFO: Scrape type for US46384: 2
2026-03-27 10:43:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c68b3be-eb31-58f4-a344-c9ce042e75b8 with identifier: US46384
2026-03-27 10:43:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c68b3be-eb31-58f4-a344-c9ce042e75b8 with scrape type 2
2026-03-27 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c68b3be-eb31-58f4-a344-c9ce042e75b8 with scrape type 2
2026-03-27 10:43:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c68b3be-eb31-58f4-a344-c9ce042e75b8, identifier: US46384
2026-03-27 10:43:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c68b3be-eb31-58f4-a344-c9ce042e75b8 with identifier: US46384
2026-03-27 10:43:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c68b3be-eb31-58f4-a344-c9ce042e75b8 with identifier: US46384
2026-03-27 10:43:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c68b3be-eb31-58f4-a344-c9ce042e75b8 with identifier: US46384 to the API
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:38:18Z',
'fuel_type': 'petrol',
'id': '7c68b3be-eb31-58f4-a344-c9ce042e75b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US46384',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 84954,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-31',
'seller_name': None,
'title': 'BMW X3 xDrive 20i Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2017}
2026-03-27 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US46384%27 HTTP/1.1" 200 None
2026-03-27 10:43:32 [auto1.de] INFO: Saving data for US46384: {'auction_closing_time': 1774715898.0, 'created_time': 1773307201.119595, 'last_price_update_time': 1774608212.178968}
2026-03-27 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US46384') HTTP/1.1" 204 0
2026-03-27 10:43:32 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-27 10:43:32 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-27 10:43:32 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-27 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY61993%27 HTTP/1.1" 200 None
2026-03-27 10:43:32 [auto1.de] INFO: Scrape type for VY61993: 2
2026-03-27 10:43:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15ca00c4-cff3-5e3d-acc7-803f0f43615c with identifier: VY61993
2026-03-27 10:43:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15ca00c4-cff3-5e3d-acc7-803f0f43615c with scrape type 2
2026-03-27 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15ca00c4-cff3-5e3d-acc7-803f0f43615c with scrape type 2
2026-03-27 10:43:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15ca00c4-cff3-5e3d-acc7-803f0f43615c, identifier: VY61993
2026-03-27 10:43:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15ca00c4-cff3-5e3d-acc7-803f0f43615c with identifier: VY61993
2026-03-27 10:43:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15ca00c4-cff3-5e3d-acc7-803f0f43615c with identifier: VY61993
2026-03-27 10:43:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15ca00c4-cff3-5e3d-acc7-803f0f43615c with identifier: VY61993 to the API
2026-03-27 10:43:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:46:24Z',
'fuel_type': 'petrol',
'id': '15ca00c4-cff3-5e3d-acc7-803f0f43615c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY61993',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 150703,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-12',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Allstar BlueMotion Tech',
'transmission': 'manual',
'trim': 'Allstar BlueMotion Tech',
'year': 2016}
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY61993%27 HTTP/1.1" 200 None
2026-03-27 10:43:33 [auto1.de] INFO: Saving data for VY61993: {'auction_closing_time': 1774716384.0, 'created_time': 1773860188.656103, 'last_price_update_time': 1774608213.14977}
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY61993') HTTP/1.1" 204 0
2026-03-27 10:43:33 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD02189%27 HTTP/1.1" 200 None
2026-03-27 10:43:33 [auto1.de] INFO: Scrape type for ZD02189: 2
2026-03-27 10:43:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3ed0bce-6b83-5d8d-a4f3-318f90615c49 with identifier: ZD02189
2026-03-27 10:43:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3ed0bce-6b83-5d8d-a4f3-318f90615c49 with scrape type 2
2026-03-27 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3ed0bce-6b83-5d8d-a4f3-318f90615c49 with scrape type 2
2026-03-27 10:43:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3ed0bce-6b83-5d8d-a4f3-318f90615c49, identifier: ZD02189
2026-03-27 10:43:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3ed0bce-6b83-5d8d-a4f3-318f90615c49 with identifier: ZD02189
2026-03-27 10:43:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3ed0bce-6b83-5d8d-a4f3-318f90615c49 with identifier: ZD02189
2026-03-27 10:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3ed0bce-6b83-5d8d-a4f3-318f90615c49 with identifier: ZD02189 to the API
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 129,
'expiration_date': '2026-03-28T16:27:36Z',
'fuel_type': 'petrol',
'id': 'e3ed0bce-6b83-5d8d-a4f3-318f90615c49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD02189',
'listing': 'auction',
'make': 'Suzuki',
'model': 'SX4 S-Cross',
'odometer': 181219,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-22',
'seller_name': None,
'title': 'Suzuki SX4 S-Cross 1.4 BoosterJet Mild-Hybrid Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2014}
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD02189%27 HTTP/1.1" 200 None
2026-03-27 10:43:33 [auto1.de] INFO: Saving data for ZD02189: {'auction_closing_time': 1774715256.0, 'created_time': 1773305352.015686, 'last_price_update_time': 1774608213.646643}
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD02189') HTTP/1.1" 204 0
2026-03-27 10:43:33 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP02747%27 HTTP/1.1" 200 None
2026-03-27 10:43:33 [auto1.de] INFO: Scrape type for BP02747: 1
2026-03-27 10:43:33 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-27 10:43:33 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC37503%27 HTTP/1.1" 200 None
2026-03-27 10:43:33 [auto1.de] INFO: Scrape type for LC37503: 2
2026-03-27 10:43:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f with identifier: LC37503
2026-03-27 10:43:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f with scrape type 2
2026-03-27 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f with scrape type 2
2026-03-27 10:43:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f, identifier: LC37503
2026-03-27 10:43:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f with identifier: LC37503
2026-03-27 10:43:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f with identifier: LC37503
2026-03-27 10:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f with identifier: LC37503 to the API
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 58,
'expiration_date': '2026-03-28T16:26:50Z',
'fuel_type': 'petrol',
'id': 'fa7fec79-9e4b-55a3-91d5-a7dda6aaca7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC37503',
'listing': 'auction',
'make': 'Daihatsu',
'model': 'Cuore',
'odometer': 118916,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-08-27',
'seller_name': None,
'title': 'Daihatsu Cuore 1.0 Blu',
'transmission': 'automatic',
'trim': 'Blu',
'year': 2006}
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC37503%27 HTTP/1.1" 200 None
2026-03-27 10:43:34 [auto1.de] INFO: Saving data for LC37503: {'auction_closing_time': 1774715210.0, 'created_time': 1774089252.766841, 'last_price_update_time': 1774608214.154969}
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC37503') HTTP/1.1" 204 0
2026-03-27 10:43:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:34 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN93893%27 HTTP/1.1" 200 None
2026-03-27 10:43:34 [auto1.de] INFO: Scrape type for AN93893: 2
2026-03-27 10:43:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 664a47e5-cdb0-5cb9-adb1-2b35c8758626 with identifier: AN93893
2026-03-27 10:43:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 664a47e5-cdb0-5cb9-adb1-2b35c8758626 with scrape type 2
2026-03-27 10:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 664a47e5-cdb0-5cb9-adb1-2b35c8758626 with scrape type 2
2026-03-27 10:43:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 664a47e5-cdb0-5cb9-adb1-2b35c8758626, identifier: AN93893
2026-03-27 10:43:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 664a47e5-cdb0-5cb9-adb1-2b35c8758626 with identifier: AN93893
2026-03-27 10:43:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 664a47e5-cdb0-5cb9-adb1-2b35c8758626 with identifier: AN93893
2026-03-27 10:43:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 664a47e5-cdb0-5cb9-adb1-2b35c8758626 with identifier: AN93893 to the API
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:13:35Z',
'fuel_type': 'diesel',
'id': '664a47e5-cdb0-5cb9-adb1-2b35c8758626',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN93893',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 277598,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-25',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2018}
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN93893%27 HTTP/1.1" 200 None
2026-03-27 10:43:34 [auto1.de] INFO: Saving data for AN93893: {'auction_closing_time': 1774714415.0, 'created_time': 1773307951.607186, 'last_price_update_time': 1774608214.800323}
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN93893') HTTP/1.1" 204 0
2026-03-27 10:43:34 [auto1.de] INFO: Found listing with ID: PZ17668
2026-03-27 10:43:34 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG63340%27 HTTP/1.1" 200 None
2026-03-27 10:43:34 [auto1.de] INFO: Scrape type for MG63340: 2
2026-03-27 10:43:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9086c65-31c6-5ae1-8775-d95151bf24ae with identifier: MG63340
2026-03-27 10:43:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9086c65-31c6-5ae1-8775-d95151bf24ae with scrape type 2
2026-03-27 10:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9086c65-31c6-5ae1-8775-d95151bf24ae with scrape type 2
2026-03-27 10:43:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9086c65-31c6-5ae1-8775-d95151bf24ae, identifier: MG63340
2026-03-27 10:43:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9086c65-31c6-5ae1-8775-d95151bf24ae with identifier: MG63340
2026-03-27 10:43:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9086c65-31c6-5ae1-8775-d95151bf24ae with identifier: MG63340
2026-03-27 10:43:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9086c65-31c6-5ae1-8775-d95151bf24ae with identifier: MG63340 to the API
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:28:27Z',
'fuel_type': 'diesel',
'id': 'e9086c65-31c6-5ae1-8775-d95151bf24ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG63340',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 157749,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-06',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2016}
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG63340%27 HTTP/1.1" 200 None
2026-03-27 10:43:35 [auto1.de] INFO: Saving data for MG63340: {'auction_closing_time': 1774715307.0, 'created_time': 1773775150.209452, 'last_price_update_time': 1774608215.270155}
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG63340') HTTP/1.1" 204 0
2026-03-27 10:43:35 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-27 10:43:35 [auto1.de] INFO: Found listing with ID: AY58726
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY58726%27 HTTP/1.1" 200 None
2026-03-27 10:43:35 [auto1.de] INFO: Scrape type for AY58726: 1
2026-03-27 10:43:35 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-27 10:43:35 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX88340%27 HTTP/1.1" 200 None
2026-03-27 10:43:35 [auto1.de] INFO: Scrape type for FX88340: 2
2026-03-27 10:43:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: affa8d52-2496-5d6f-9d30-d541e849270e with identifier: FX88340
2026-03-27 10:43:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item affa8d52-2496-5d6f-9d30-d541e849270e with scrape type 2
2026-03-27 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item affa8d52-2496-5d6f-9d30-d541e849270e with scrape type 2
2026-03-27 10:43:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: affa8d52-2496-5d6f-9d30-d541e849270e, identifier: FX88340
2026-03-27 10:43:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: affa8d52-2496-5d6f-9d30-d541e849270e with identifier: FX88340
2026-03-27 10:43:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: affa8d52-2496-5d6f-9d30-d541e849270e with identifier: FX88340
2026-03-27 10:43:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: affa8d52-2496-5d6f-9d30-d541e849270e with identifier: FX88340 to the API
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:39:36Z',
'fuel_type': 'diesel',
'id': 'affa8d52-2496-5d6f-9d30-d541e849270e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX88340',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 232965,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-07',
'seller_name': None,
'title': 'Volkswagen Touran 1.6 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2013}
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX88340%27 HTTP/1.1" 200 None
2026-03-27 10:43:35 [auto1.de] INFO: Saving data for FX88340: {'auction_closing_time': 1774715976.0, 'created_time': 1773303813.950314, 'last_price_update_time': 1774608215.760187}
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX88340') HTTP/1.1" 204 0
2026-03-27 10:43:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:35 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-27 10:43:35 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH93335%27 HTTP/1.1" 200 None
2026-03-27 10:43:35 [auto1.de] INFO: Scrape type for YH93335: 2
2026-03-27 10:43:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f498da1d-5208-5a84-a2bd-5be7e2af31be with identifier: YH93335
2026-03-27 10:43:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f498da1d-5208-5a84-a2bd-5be7e2af31be with scrape type 2
2026-03-27 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f498da1d-5208-5a84-a2bd-5be7e2af31be with scrape type 2
2026-03-27 10:43:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f498da1d-5208-5a84-a2bd-5be7e2af31be, identifier: YH93335
2026-03-27 10:43:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f498da1d-5208-5a84-a2bd-5be7e2af31be with identifier: YH93335
2026-03-27 10:43:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f498da1d-5208-5a84-a2bd-5be7e2af31be with identifier: YH93335
2026-03-27 10:43:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f498da1d-5208-5a84-a2bd-5be7e2af31be with identifier: YH93335 to the API
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:14:40Z',
'fuel_type': 'diesel',
'id': 'f498da1d-5208-5a84-a2bd-5be7e2af31be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH93335',
'listing': 'auction',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 103531,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-27',
'seller_name': None,
'title': 'Seat Tarraco 2.0 TDI Xcellence 4Drive',
'transmission': 'automatic',
'trim': 'Xcellence 4Drive',
'year': 2019}
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH93335%27 HTTP/1.1" 200 None
2026-03-27 10:43:36 [auto1.de] INFO: Saving data for YH93335: {'auction_closing_time': 1774714480.0, 'created_time': 1773134593.0644, 'last_price_update_time': 1774608216.298329}
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH93335') HTTP/1.1" 204 0
2026-03-27 10:43:36 [auto1.de] INFO: Found listing with ID: EF65370
2026-03-27 10:43:36 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH95980%27 HTTP/1.1" 200 None
2026-03-27 10:43:36 [auto1.de] INFO: Scrape type for AH95980: 2
2026-03-27 10:43:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4adea14b-accc-50ee-8651-ac60449ee690 with identifier: AH95980
2026-03-27 10:43:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4adea14b-accc-50ee-8651-ac60449ee690 with scrape type 2
2026-03-27 10:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4adea14b-accc-50ee-8651-ac60449ee690 with scrape type 2
2026-03-27 10:43:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4adea14b-accc-50ee-8651-ac60449ee690, identifier: AH95980
2026-03-27 10:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK54486> (referer: https://www.auto1.com/v1/car-details-view/HK54486/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4adea14b-accc-50ee-8651-ac60449ee690 with identifier: AH95980
2026-03-27 10:43:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4adea14b-accc-50ee-8651-ac60449ee690 with identifier: AH95980
2026-03-27 10:43:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4adea14b-accc-50ee-8651-ac60449ee690 with identifier: AH95980 to the API
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:20:37Z',
'fuel_type': 'diesel',
'id': '4adea14b-accc-50ee-8651-ac60449ee690',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH95980',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 179753,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-01',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
'transmission': 'manual',
'trim': 'Allure Pack',
'year': 2022}
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH95980%27 HTTP/1.1" 200 None
2026-03-27 10:43:36 [auto1.de] INFO: Saving data for AH95980: {'auction_closing_time': 1774714837.0, 'created_time': 1773400587.35671, 'last_price_update_time': 1774608216.88655}
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH95980') HTTP/1.1" 204 0
2026-03-27 10:43:37 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-27 10:43:37 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR05539%27 HTTP/1.1" 200 None
2026-03-27 10:43:37 [auto1.de] INFO: Scrape type for AR05539: 2
2026-03-27 10:43:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02753508-7a13-5340-8199-ecb2445c458c with identifier: AR05539
2026-03-27 10:43:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02753508-7a13-5340-8199-ecb2445c458c with scrape type 2
2026-03-27 10:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02753508-7a13-5340-8199-ecb2445c458c with scrape type 2
2026-03-27 10:43:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02753508-7a13-5340-8199-ecb2445c458c, identifier: AR05539
2026-03-27 10:43:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02753508-7a13-5340-8199-ecb2445c458c with identifier: AR05539
2026-03-27 10:43:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02753508-7a13-5340-8199-ecb2445c458c with identifier: AR05539
2026-03-27 10:43:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02753508-7a13-5340-8199-ecb2445c458c with identifier: AR05539 to the API
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:59:51Z',
'fuel_type': 'petrol',
'id': '02753508-7a13-5340-8199-ecb2445c458c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR05539',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 105365,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-14',
'seller_name': None,
'title': 'Dacia Duster 1.2 TCe Laureate 4x2',
'transmission': 'manual',
'trim': 'Laureate 4x2',
'year': 2015}
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR05539%27 HTTP/1.1" 200 None
2026-03-27 10:43:37 [auto1.de] INFO: Saving data for AR05539: {'auction_closing_time': 1774717191.0, 'created_time': 1773646299.143922, 'last_price_update_time': 1774608217.569294}
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR05539') HTTP/1.1" 204 0
2026-03-27 10:43:37 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF31302%27 HTTP/1.1" 200 None
2026-03-27 10:43:37 [auto1.de] INFO: Scrape type for WF31302: 2
2026-03-27 10:43:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3a1c824-b6c6-5859-ad64-3897eff2c470 with identifier: WF31302
2026-03-27 10:43:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3a1c824-b6c6-5859-ad64-3897eff2c470 with scrape type 2
2026-03-27 10:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3a1c824-b6c6-5859-ad64-3897eff2c470 with scrape type 2
2026-03-27 10:43:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3a1c824-b6c6-5859-ad64-3897eff2c470, identifier: WF31302
2026-03-27 10:43:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3a1c824-b6c6-5859-ad64-3897eff2c470 with identifier: WF31302
2026-03-27 10:43:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3a1c824-b6c6-5859-ad64-3897eff2c470 with identifier: WF31302
2026-03-27 10:43:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3a1c824-b6c6-5859-ad64-3897eff2c470 with identifier: WF31302 to the API
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 195,
'expiration_date': '2026-03-28T16:25:51Z',
'fuel_type': 'diesel',
'id': 'e3a1c824-b6c6-5859-ad64-3897eff2c470',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF31302',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 128456,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-28',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2016}
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF31302%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [auto1.de] INFO: Saving data for WF31302: {'auction_closing_time': 1774715151.0, 'created_time': 1773859696.763573, 'last_price_update_time': 1774608218.27736}
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF31302') HTTP/1.1" 204 0
2026-03-27 10:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP02747/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG04913/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF02739> (referer: https://www.auto1.com/v1/car-details-view/DF02739/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ93096> (referer: https://www.auto1.com/v1/car-details-view/WJ93096/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74871e20-678b-5caa-b1e5-ee87c8224f36 with identifier: HK54486
2026-03-27 10:43:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74871e20-678b-5caa-b1e5-ee87c8224f36 with scrape type 1
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74871e20-678b-5caa-b1e5-ee87c8224f36
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F30%252F25300e951a0116691eca879ec029c95e%252Fpa%252FHK54486_6afac2be330520ba8d4fbcb8d5431edc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_6afac2be330520ba8d4fbcb8d5431edc.jpg already downloaded
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F30%252F25300e951a0116691eca879ec029c95e%252Fpa%252FHK54486_e785d26131e7a977bb34648467ebd163.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_e785d26131e7a977bb34648467ebd163.jpg already downloaded
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F30%252F25300e951a0116691eca879ec029c95e%252Fpa%252FHK54486_b243704a4a26602be474a4c1d274d5d0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_b243704a4a26602be474a4c1d274d5d0.jpg already downloaded
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F30%252F25300e951a0116691eca879ec029c95e%252Fpa%252FHK54486_7c0c31f9a5c2b7fb654639d2528be010.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_7c0c31f9a5c2b7fb654639d2528be010.jpg already downloaded
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F30%252F25300e951a0116691eca879ec029c95e%252Fpa%252FHK54486_1cdb0d0db4c30632743f0079e8a5b55b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_1cdb0d0db4c30632743f0079e8a5b55b.jpg already downloaded
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F30%252F25300e951a0116691eca879ec029c95e%252Fpa%252FHK54486_b76b2937373ed0868602546f2700e3ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_b76b2937373ed0868602546f2700e3ed.jpg already downloaded
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F30%252F25300e951a0116691eca879ec029c95e%252Fpa%252FHK54486_eea52f4f610173f0646d2a97a11c5a26.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_eea52f4f610173f0646d2a97a11c5a26.jpg already downloaded
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F30%252F25300e951a0116691eca879ec029c95e%252Fpa%252FHK54486_3e2b5dee4c0c7fc2d804e0c4baeac3f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_3e2b5dee4c0c7fc2d804e0c4baeac3f0.jpg already downloaded
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F30%252F25300e951a0116691eca879ec029c95e%252Fpa%252FHK54486_126e3bfe9bbddeff5ce0bc95d141c5ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_126e3bfe9bbddeff5ce0bc95d141c5ae.jpg already downloaded
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F30%252F25300e951a0116691eca879ec029c95e%252Fpa%252FHK54486_0ef99f56a507dc46354bce7bc3820371.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_0ef99f56a507dc46354bce7bc3820371.jpg already downloaded
2026-03-27 10:43:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74871e20-678b-5caa-b1e5-ee87c8224f36, identifier: HK54486
2026-03-27 10:43:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74871e20-678b-5caa-b1e5-ee87c8224f36 with identifier: HK54486
2026-03-27 10:43:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74871e20-678b-5caa-b1e5-ee87c8224f36 with identifier: HK54486
2026-03-27 10:43:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74871e20-678b-5caa-b1e5-ee87c8224f36 with identifier: HK54486 to the API
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HK54486>
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:28:23Z',
'fuel_type': 'diesel',
'id': '74871e20-678b-5caa-b1e5-ee87c8224f36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK54486',
'listing': 'auction',
'location': 'DE, Germersheim',
'make': 'Peugeot',
'model': 'Rifter',
'odometer': 65045,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_6afac2be330520ba8d4fbcb8d5431edc.jpg',
'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_e785d26131e7a977bb34648467ebd163.jpg',
'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_b243704a4a26602be474a4c1d274d5d0.jpg',
'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_7c0c31f9a5c2b7fb654639d2528be010.jpg',
'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_1cdb0d0db4c30632743f0079e8a5b55b.jpg',
'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_b76b2937373ed0868602546f2700e3ed.jpg',
'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_eea52f4f610173f0646d2a97a11c5a26.jpg',
'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_3e2b5dee4c0c7fc2d804e0c4baeac3f0.jpg',
'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_126e3bfe9bbddeff5ce0bc95d141c5ae.jpg',
'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_0ef99f56a507dc46354bce7bc3820371.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74871e20-678b-5caa-b1e5-ee87c8224f36/74871e20-678b-5caa-b1e5-ee87c8224f36_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82686,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_6afac2be330520ba8d4fbcb8d5431edc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74871e20-678b-5caa-b1e5-ee87c8224f36/74871e20-678b-5caa-b1e5-ee87c8224f36_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_e785d26131e7a977bb34648467ebd163.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74871e20-678b-5caa-b1e5-ee87c8224f36/74871e20-678b-5caa-b1e5-ee87c8224f36_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67544,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_b243704a4a26602be474a4c1d274d5d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74871e20-678b-5caa-b1e5-ee87c8224f36/74871e20-678b-5caa-b1e5-ee87c8224f36_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_7c0c31f9a5c2b7fb654639d2528be010.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74871e20-678b-5caa-b1e5-ee87c8224f36/74871e20-678b-5caa-b1e5-ee87c8224f36_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68570,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_1cdb0d0db4c30632743f0079e8a5b55b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74871e20-678b-5caa-b1e5-ee87c8224f36/74871e20-678b-5caa-b1e5-ee87c8224f36_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70465,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_b76b2937373ed0868602546f2700e3ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74871e20-678b-5caa-b1e5-ee87c8224f36/74871e20-678b-5caa-b1e5-ee87c8224f36_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56959,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_eea52f4f610173f0646d2a97a11c5a26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74871e20-678b-5caa-b1e5-ee87c8224f36/74871e20-678b-5caa-b1e5-ee87c8224f36_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77325,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_3e2b5dee4c0c7fc2d804e0c4baeac3f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74871e20-678b-5caa-b1e5-ee87c8224f36/74871e20-678b-5caa-b1e5-ee87c8224f36_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_126e3bfe9bbddeff5ce0bc95d141c5ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74871e20-678b-5caa-b1e5-ee87c8224f36/74871e20-678b-5caa-b1e5-ee87c8224f36_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78706,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/30/25300e951a0116691eca879ec029c95e/pa/HK54486_0ef99f56a507dc46354bce7bc3820371.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-11-11',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot Rifter 1.5 Blue-HDi Allure L2',
'transmission': 'automatic',
'trim': 'Allure L2',
'year': 2020}
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK54486%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [auto1.de] INFO: Saving data for HK54486: {'created_time': 1774608219.004252, 'last_price_update_time': 1774608219.004265, 'auction_closing_time': 1774715303.0}
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK54486') HTTP/1.1" 204 0
2026-03-27 10:43:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03e7aab2-1b46-5b00-be64-a7c586119507 with identifier: DF02739
2026-03-27 10:43:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03e7aab2-1b46-5b00-be64-a7c586119507 with scrape type 1
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03e7aab2-1b46-5b00-be64-a7c586119507
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_4c5e7fd474f510882578a523a87157bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_4c5e7fd474f510882578a523a87157bd.jpg not downloaded yet
2026-03-27 10:43:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54ffe804-94e7-5d1d-a171-617d00f837cf with identifier: WJ93096
2026-03-27 10:43:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54ffe804-94e7-5d1d-a171-617d00f837cf with scrape type 1
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 54ffe804-94e7-5d1d-a171-617d00f837cf
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_3bf90b88004fd3fad4b8edac697f16b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_3bf90b88004fd3fad4b8edac697f16b1.jpg not downloaded yet
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_9094d1342fc5552a621c2cbbd3483817.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_9094d1342fc5552a621c2cbbd3483817.jpg not downloaded yet
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_dc4fe8a367808046946857919c14f142.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_dc4fe8a367808046946857919c14f142.jpg not downloaded yet
2026-03-27 10:43:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_5ecad74dd0c70c054df47b58ce70c8cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_5ecad74dd0c70c054df47b58ce70c8cc.jpg not downloaded yet
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_8ff050b8975a9ace7cbc5bdc556c7bd4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_8ff050b8975a9ace7cbc5bdc556c7bd4.jpg not downloaded yet
2026-03-27 10:43:39 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 10535 | hits on page: 40
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_1f76de9a6a1aeccfb3ecd59f0dbd8218.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_1f76de9a6a1aeccfb3ecd59f0dbd8218.jpg not downloaded yet
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_d7fdc888e237aa67a76c74b6c6dae8a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_d7fdc888e237aa67a76c74b6c6dae8a6.jpg not downloaded yet
2026-03-27 10:43:39 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-27 10:43:39 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM46431%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [auto1.de] INFO: Scrape type for YM46431: 2
2026-03-27 10:43:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7 with identifier: YM46431
2026-03-27 10:43:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7 with scrape type 2
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7 with scrape type 2
2026-03-27 10:43:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7, identifier: YM46431
2026-03-27 10:43:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_3bf90b88004fd3fad4b8edac697f16b1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_de99980bca5aca1dbc2682bfc2b0bfd5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_de99980bca5aca1dbc2682bfc2b0bfd5.jpg not downloaded yet
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_db2ac9e1cfb55b8f0b0d119b24822275.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_db2ac9e1cfb55b8f0b0d119b24822275.jpg not downloaded yet
2026-03-27 10:43:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7 with identifier: YM46431
2026-03-27 10:43:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7 with identifier: YM46431
2026-03-27 10:43:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9729b520-1d3e-5d9c-a5a3-3a73e6f381d7 with identifier: YM46431 to the API
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:37:21Z',
'fuel_type': 'diesel',
'id': '9729b520-1d3e-5d9c-a5a3-3a73e6f381d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM46431',
'listing': 'auction',
'make': 'Renault',
'model': 'Trafic',
'odometer': 97376,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-05',
'seller_name': None,
'title': 'Renault Trafic 2.0 dCi L2H1 3,0t (8/9 Sitze) Life',
'transmission': 'manual',
'trim': 'L2H1 3,0t (8/9 Sitze) Life',
'year': 2020}
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM46431%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [auto1.de] INFO: Saving data for YM46431: {'auction_closing_time': 1774715841.0, 'created_time': 1773467120.923954, 'last_price_update_time': 1774608219.768258}
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM46431') HTTP/1.1" 204 0
2026-03-27 10:43:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_4c5e7fd474f510882578a523a87157bd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:39 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN03307%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [auto1.de] INFO: Scrape type for RN03307: 2
2026-03-27 10:43:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e6c496e-90ed-5916-932d-74697b3d5865 with identifier: RN03307
2026-03-27 10:43:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e6c496e-90ed-5916-932d-74697b3d5865 with scrape type 2
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e6c496e-90ed-5916-932d-74697b3d5865 with scrape type 2
2026-03-27 10:43:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e6c496e-90ed-5916-932d-74697b3d5865, identifier: RN03307
2026-03-27 10:43:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_dc4fe8a367808046946857919c14f142.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_197ee5e01d87a2a70864e2722316e76f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_197ee5e01d87a2a70864e2722316e76f.jpg not downloaded yet
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_190c46da19471f089e5a07d281f20450.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_190c46da19471f089e5a07d281f20450.jpg not downloaded yet
2026-03-27 10:43:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e6c496e-90ed-5916-932d-74697b3d5865 with identifier: RN03307
2026-03-27 10:43:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e6c496e-90ed-5916-932d-74697b3d5865 with identifier: RN03307
2026-03-27 10:43:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e6c496e-90ed-5916-932d-74697b3d5865 with identifier: RN03307 to the API
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 389,
'expiration_date': '2026-03-28T16:48:42Z',
'fuel_type': 'petrol',
'id': '9e6c496e-90ed-5916-932d-74697b3d5865',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN03307',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 64737,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-22',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 450 Mild-Hybrid 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2020}
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN03307%27 HTTP/1.1" 200 None
2026-03-27 10:43:40 [auto1.de] INFO: Saving data for RN03307: {'auction_closing_time': 1774716522.0, 'created_time': 1774264913.648804, 'last_price_update_time': 1774608220.35646}
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN03307') HTTP/1.1" 204 0
2026-03-27 10:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_9094d1342fc5552a621c2cbbd3483817.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:40 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-27 10:43:40 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-27 10:43:40 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-27 10:43:40 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG30420%27 HTTP/1.1" 200 None
2026-03-27 10:43:40 [auto1.de] INFO: Scrape type for PG30420: 2
2026-03-27 10:43:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b69417ab-3c6b-5403-bb16-59fdad78d7da with identifier: PG30420
2026-03-27 10:43:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b69417ab-3c6b-5403-bb16-59fdad78d7da with scrape type 2
2026-03-27 10:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b69417ab-3c6b-5403-bb16-59fdad78d7da with scrape type 2
2026-03-27 10:43:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b69417ab-3c6b-5403-bb16-59fdad78d7da, identifier: PG30420
2026-03-27 10:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5362350>
2026-03-27 10:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_3bf90b88004fd3fad4b8edac697f16b1.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_3bf90b88004fd3fad4b8edac697f16b1.jpg saved to cache
2026-03-27 10:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54ffe804-94e7-5d1d-a171-617d00f837cf
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_636fec6a5bc55147bb63c434cedd7515.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_636fec6a5bc55147bb63c434cedd7515.jpg not downloaded yet
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_c6f5b79ec7fa0495966cab696254ca0c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_c6f5b79ec7fa0495966cab696254ca0c.jpg not downloaded yet
2026-03-27 10:43:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b69417ab-3c6b-5403-bb16-59fdad78d7da with identifier: PG30420
2026-03-27 10:43:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b69417ab-3c6b-5403-bb16-59fdad78d7da with identifier: PG30420
2026-03-27 10:43:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b69417ab-3c6b-5403-bb16-59fdad78d7da with identifier: PG30420 to the API
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:45:25Z',
'fuel_type': 'petrol',
'id': 'b69417ab-3c6b-5403-bb16-59fdad78d7da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG30420',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 163376,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-30',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2013}
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG30420%27 HTTP/1.1" 200 None
2026-03-27 10:43:40 [auto1.de] INFO: Saving data for PG30420: {'auction_closing_time': 1774716325.0, 'created_time': 1773400605.870425, 'last_price_update_time': 1774608220.972781}
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG30420') HTTP/1.1" 204 0
2026-03-27 10:43:40 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ32972%27 HTTP/1.1" 200 None
2026-03-27 10:43:41 [auto1.de] INFO: Scrape type for NZ32972: 2
2026-03-27 10:43:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d045e022-fae0-51ca-ac59-5b21aaa3acee with identifier: NZ32972
2026-03-27 10:43:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d045e022-fae0-51ca-ac59-5b21aaa3acee with scrape type 2
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d045e022-fae0-51ca-ac59-5b21aaa3acee with scrape type 2
2026-03-27 10:43:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d045e022-fae0-51ca-ac59-5b21aaa3acee, identifier: NZ32972
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3dd690>
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_4c5e7fd474f510882578a523a87157bd.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_4c5e7fd474f510882578a523a87157bd.jpg saved to cache
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03e7aab2-1b46-5b00-be64-a7c586119507
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4f8ed0>
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_dc4fe8a367808046946857919c14f142.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_dc4fe8a367808046946857919c14f142.jpg saved to cache
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54ffe804-94e7-5d1d-a171-617d00f837cf
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_3007448b3ee13835b4ed50b30bd18126.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_3007448b3ee13835b4ed50b30bd18126.jpg not downloaded yet
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_66de67a01fe9bedb5a617068947d6cc9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_66de67a01fe9bedb5a617068947d6cc9.jpg not downloaded yet
2026-03-27 10:43:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d045e022-fae0-51ca-ac59-5b21aaa3acee with identifier: NZ32972
2026-03-27 10:43:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d045e022-fae0-51ca-ac59-5b21aaa3acee with identifier: NZ32972
2026-03-27 10:43:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d045e022-fae0-51ca-ac59-5b21aaa3acee with identifier: NZ32972 to the API
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:51:48Z',
'fuel_type': 'petrol',
'id': 'd045e022-fae0-51ca-ac59-5b21aaa3acee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ32972',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 17377,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-10',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 180 Mild-Hybrid Progressive',
'transmission': 'automatic',
'trim': 'Progressive',
'year': 2024}
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ32972%27 HTTP/1.1" 200 None
2026-03-27 10:43:41 [auto1.de] INFO: Saving data for NZ32972: {'auction_closing_time': 1774716708.0, 'created_time': 1773136526.977073, 'last_price_update_time': 1774608221.68697}
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ32972') HTTP/1.1" 204 0
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2ed490>
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_9094d1342fc5552a621c2cbbd3483817.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_9094d1342fc5552a621c2cbbd3483817.jpg saved to cache
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03e7aab2-1b46-5b00-be64-a7c586119507
2026-03-27 10:43:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_db2ac9e1cfb55b8f0b0d119b24822275.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:41 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH91647%27 HTTP/1.1" 200 None
2026-03-27 10:43:41 [auto1.de] INFO: Scrape type for TH91647: 2
2026-03-27 10:43:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b16c36ef-11c6-5a37-9bae-dba3598991ec with identifier: TH91647
2026-03-27 10:43:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b16c36ef-11c6-5a37-9bae-dba3598991ec with scrape type 2
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b16c36ef-11c6-5a37-9bae-dba3598991ec with scrape type 2
2026-03-27 10:43:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b16c36ef-11c6-5a37-9bae-dba3598991ec, identifier: TH91647
2026-03-27 10:43:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_190c46da19471f089e5a07d281f20450.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_de99980bca5aca1dbc2682bfc2b0bfd5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_74d605a45b3b9575210ff905cc5d00a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_74d605a45b3b9575210ff905cc5d00a1.jpg not downloaded yet
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_5a9965db3920480f93b2d08e14e353b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_5a9965db3920480f93b2d08e14e353b6.jpg not downloaded yet
2026-03-27 10:43:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b16c36ef-11c6-5a37-9bae-dba3598991ec with identifier: TH91647
2026-03-27 10:43:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b16c36ef-11c6-5a37-9bae-dba3598991ec with identifier: TH91647
2026-03-27 10:43:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b16c36ef-11c6-5a37-9bae-dba3598991ec with identifier: TH91647 to the API
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-28T16:08:03Z',
'fuel_type': 'petrol',
'id': 'b16c36ef-11c6-5a37-9bae-dba3598991ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH91647',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 44119,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-23',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2015}
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH91647%27 HTTP/1.1" 200 None
2026-03-27 10:43:42 [auto1.de] INFO: Saving data for TH91647: {'auction_closing_time': 1774714083.0, 'created_time': 1774262980.476949, 'last_price_update_time': 1774608222.425702}
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH91647') HTTP/1.1" 204 0
2026-03-27 10:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_197ee5e01d87a2a70864e2722316e76f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:42 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF45027%27 HTTP/1.1" 200 None
2026-03-27 10:43:42 [auto1.de] INFO: Scrape type for MF45027: 2
2026-03-27 10:43:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c401126b-fee5-592a-863c-040d7aab7840 with identifier: MF45027
2026-03-27 10:43:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c401126b-fee5-592a-863c-040d7aab7840 with scrape type 2
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c401126b-fee5-592a-863c-040d7aab7840 with scrape type 2
2026-03-27 10:43:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c401126b-fee5-592a-863c-040d7aab7840, identifier: MF45027
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_32a94a6e3f06818549a3ca626742ad8f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_32a94a6e3f06818549a3ca626742ad8f.jpg not downloaded yet
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_fe3f105c0a7234db61f93f4a388a57bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_fe3f105c0a7234db61f93f4a388a57bb.jpg not downloaded yet
2026-03-27 10:43:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c401126b-fee5-592a-863c-040d7aab7840 with identifier: MF45027
2026-03-27 10:43:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c401126b-fee5-592a-863c-040d7aab7840 with identifier: MF45027
2026-03-27 10:43:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c401126b-fee5-592a-863c-040d7aab7840 with identifier: MF45027 to the API
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:09:16Z',
'fuel_type': 'diesel',
'id': 'c401126b-fee5-592a-863c-040d7aab7840',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF45027',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 193577,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-03',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI RS',
'transmission': 'automatic',
'trim': 'RS',
'year': 2015}
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF45027%27 HTTP/1.1" 200 None
2026-03-27 10:43:42 [auto1.de] INFO: Saving data for MF45027: {'auction_closing_time': 1774714156.0, 'created_time': 1773469059.546648, 'last_price_update_time': 1774608222.939218}
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF45027') HTTP/1.1" 204 0
2026-03-27 10:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5c18d0>
2026-03-27 10:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_db2ac9e1cfb55b8f0b0d119b24822275.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_db2ac9e1cfb55b8f0b0d119b24822275.jpg saved to cache
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54ffe804-94e7-5d1d-a171-617d00f837cf
2026-03-27 10:43:42 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY29921%27 HTTP/1.1" 200 None
2026-03-27 10:43:43 [auto1.de] INFO: Scrape type for MY29921: 2
2026-03-27 10:43:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32d5e899-fa8a-53c8-a15b-f7e8611c50b2 with identifier: MY29921
2026-03-27 10:43:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32d5e899-fa8a-53c8-a15b-f7e8611c50b2 with scrape type 2
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32d5e899-fa8a-53c8-a15b-f7e8611c50b2 with scrape type 2
2026-03-27 10:43:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32d5e899-fa8a-53c8-a15b-f7e8611c50b2, identifier: MY29921
2026-03-27 10:43:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_c6f5b79ec7fa0495966cab696254ca0c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32d5e899-fa8a-53c8-a15b-f7e8611c50b2 with identifier: MY29921
2026-03-27 10:43:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32d5e899-fa8a-53c8-a15b-f7e8611c50b2 with identifier: MY29921
2026-03-27 10:43:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32d5e899-fa8a-53c8-a15b-f7e8611c50b2 with identifier: MY29921 to the API
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:34:34Z',
'fuel_type': 'diesel',
'id': '32d5e899-fa8a-53c8-a15b-f7e8611c50b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY29921',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 197127,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-29',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2015}
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY29921%27 HTTP/1.1" 200 None
2026-03-27 10:43:43 [auto1.de] INFO: Saving data for MY29921: {'auction_closing_time': 1774715674.0, 'created_time': 1774293283.051733, 'last_price_update_time': 1774608223.442938}
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY29921') HTTP/1.1" 204 0
2026-03-27 10:43:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf58f10>
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_190c46da19471f089e5a07d281f20450.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_190c46da19471f089e5a07d281f20450.jpg saved to cache
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54ffe804-94e7-5d1d-a171-617d00f837cf
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f2ad0>
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_de99980bca5aca1dbc2682bfc2b0bfd5.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_de99980bca5aca1dbc2682bfc2b0bfd5.jpg saved to cache
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03e7aab2-1b46-5b00-be64-a7c586119507
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3a51d0>
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_197ee5e01d87a2a70864e2722316e76f.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_197ee5e01d87a2a70864e2722316e76f.jpg saved to cache
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 03e7aab2-1b46-5b00-be64-a7c586119507
2026-03-27 10:43:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_636fec6a5bc55147bb63c434cedd7515.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_66de67a01fe9bedb5a617068947d6cc9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_3007448b3ee13835b4ed50b30bd18126.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:43 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-27 10:43:43 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST57334%27 HTTP/1.1" 200 None
2026-03-27 10:43:43 [auto1.de] INFO: Scrape type for ST57334: 2
2026-03-27 10:43:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b112174-d592-554e-a407-4790f8c9a958 with identifier: ST57334
2026-03-27 10:43:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b112174-d592-554e-a407-4790f8c9a958 with scrape type 2
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b112174-d592-554e-a407-4790f8c9a958 with scrape type 2
2026-03-27 10:43:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b112174-d592-554e-a407-4790f8c9a958, identifier: ST57334
2026-03-27 10:43:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG04913> (referer: https://www.auto1.com/v1/car-details-view/GG04913/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b112174-d592-554e-a407-4790f8c9a958 with identifier: ST57334
2026-03-27 10:43:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b112174-d592-554e-a407-4790f8c9a958 with identifier: ST57334
2026-03-27 10:43:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b112174-d592-554e-a407-4790f8c9a958 with identifier: ST57334 to the API
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-28T16:40:26Z',
'fuel_type': 'diesel',
'id': '1b112174-d592-554e-a407-4790f8c9a958',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST57334',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 428121,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-02',
'seller_name': None,
'title': 'BMW 5er 530d',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST57334%27 HTTP/1.1" 200 None
2026-03-27 10:43:44 [auto1.de] INFO: Saving data for ST57334: {'auction_closing_time': 1774716026.0, 'created_time': 1773302038.931624, 'last_price_update_time': 1774608224.038397}
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST57334') HTTP/1.1" 204 0
2026-03-27 10:43:44 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-27 10:43:44 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-27 10:43:44 [auto1.de] INFO: Found listing with ID: YC77608
2026-03-27 10:43:44 [auto1.de] INFO: Found listing with ID: ZM90265
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM90265%27 HTTP/1.1" 200 None
2026-03-27 10:43:44 [auto1.de] INFO: Scrape type for ZM90265: 2
2026-03-27 10:43:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb9f406f-1672-5d49-ad7d-6a9d7761bfab with identifier: ZM90265
2026-03-27 10:43:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb9f406f-1672-5d49-ad7d-6a9d7761bfab with scrape type 2
2026-03-27 10:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb9f406f-1672-5d49-ad7d-6a9d7761bfab with scrape type 2
2026-03-27 10:43:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb9f406f-1672-5d49-ad7d-6a9d7761bfab, identifier: ZM90265
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3df290>
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_c6f5b79ec7fa0495966cab696254ca0c.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_c6f5b79ec7fa0495966cab696254ca0c.jpg saved to cache
2026-03-27 10:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54ffe804-94e7-5d1d-a171-617d00f837cf
2026-03-27 10:43:44 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 10536 | hits on page: 40
2026-03-27 10:43:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_5a9965db3920480f93b2d08e14e353b6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_fe3f105c0a7234db61f93f4a388a57bb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb9f406f-1672-5d49-ad7d-6a9d7761bfab with identifier: ZM90265
2026-03-27 10:43:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb9f406f-1672-5d49-ad7d-6a9d7761bfab with identifier: ZM90265
2026-03-27 10:43:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb9f406f-1672-5d49-ad7d-6a9d7761bfab with identifier: ZM90265 to the API
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:48:07Z',
'fuel_type': 'diesel',
'id': 'eb9f406f-1672-5d49-ad7d-6a9d7761bfab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM90265',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 270846,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-07',
'seller_name': None,
'title': 'BMW 5er 520d',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM90265%27 HTTP/1.1" 200 None
2026-03-27 10:43:44 [auto1.de] INFO: Saving data for ZM90265: {'auction_closing_time': 1774716487.0, 'created_time': 1773303624.698193, 'last_price_update_time': 1774608224.689615}
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM90265') HTTP/1.1" 204 0
2026-03-27 10:43:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_32a94a6e3f06818549a3ca626742ad8f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_74d605a45b3b9575210ff905cc5d00a1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:44 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-27 10:43:44 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM28187%27 HTTP/1.1" 200 None
2026-03-27 10:43:44 [auto1.de] INFO: Scrape type for YM28187: 2
2026-03-27 10:43:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abd055fb-d3ec-56d5-ae56-745aea36fed8 with identifier: YM28187
2026-03-27 10:43:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abd055fb-d3ec-56d5-ae56-745aea36fed8 with scrape type 2
2026-03-27 10:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abd055fb-d3ec-56d5-ae56-745aea36fed8 with scrape type 2
2026-03-27 10:43:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abd055fb-d3ec-56d5-ae56-745aea36fed8, identifier: YM28187
2026-03-27 10:43:44 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ50846%27 HTTP/1.1" 200 None
2026-03-27 10:43:44 [auto1.de] INFO: Scrape type for FZ50846: 2
2026-03-27 10:43:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43a4de99-3012-53c2-b8d4-49627de505f8 with identifier: FZ50846
2026-03-27 10:43:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a4de99-3012-53c2-b8d4-49627de505f8 with scrape type 2
2026-03-27 10:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43a4de99-3012-53c2-b8d4-49627de505f8 with scrape type 2
2026-03-27 10:43:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43a4de99-3012-53c2-b8d4-49627de505f8, identifier: FZ50846
2026-03-27 10:43:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abd055fb-d3ec-56d5-ae56-745aea36fed8 with identifier: YM28187
2026-03-27 10:43:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abd055fb-d3ec-56d5-ae56-745aea36fed8 with identifier: YM28187
2026-03-27 10:43:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abd055fb-d3ec-56d5-ae56-745aea36fed8 with identifier: YM28187 to the API
2026-03-27 10:43:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:19:04Z',
'fuel_type': 'diesel',
'id': 'abd055fb-d3ec-56d5-ae56-745aea36fed8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM28187',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 315309,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-22',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Trendline BlueMotion',
'transmission': 'automatic',
'trim': 'Trendline BlueMotion',
'year': 2012}
2026-03-27 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM28187%27 HTTP/1.1" 200 None
2026-03-27 10:43:45 [auto1.de] INFO: Saving data for YM28187: {'auction_closing_time': 1774714744.0, 'created_time': 1774032102.134897, 'last_price_update_time': 1774608225.977777}
2026-03-27 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM28187') HTTP/1.1" 204 0
2026-03-27 10:43:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43a4de99-3012-53c2-b8d4-49627de505f8 with identifier: FZ50846
2026-03-27 10:43:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43a4de99-3012-53c2-b8d4-49627de505f8 with identifier: FZ50846
2026-03-27 10:43:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43a4de99-3012-53c2-b8d4-49627de505f8 with identifier: FZ50846 to the API
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:58:43Z',
'fuel_type': 'diesel',
'id': '43a4de99-3012-53c2-b8d4-49627de505f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ50846',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Transporter',
'odometer': 370587,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-23',
'seller_name': None,
'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten BlueMotion',
'transmission': 'manual',
'trim': 'Kasten BlueMotion',
'year': 2014}
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ50846%27 HTTP/1.1" 200 None
2026-03-27 10:43:46 [auto1.de] INFO: Saving data for FZ50846: {'auction_closing_time': 1774717123.0, 'created_time': 1773138597.046821, 'last_price_update_time': 1774608226.884408}
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ50846') HTTP/1.1" 204 0
2026-03-27 10:43:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e7890>
2026-03-27 10:43:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_636fec6a5bc55147bb63c434cedd7515.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_636fec6a5bc55147bb63c434cedd7515.jpg saved to cache
2026-03-27 10:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 03e7aab2-1b46-5b00-be64-a7c586119507
2026-03-27 10:43:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be194290>
2026-03-27 10:43:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_66de67a01fe9bedb5a617068947d6cc9.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_66de67a01fe9bedb5a617068947d6cc9.jpg saved to cache
2026-03-27 10:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54ffe804-94e7-5d1d-a171-617d00f837cf
2026-03-27 10:43:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e6fd0>
2026-03-27 10:43:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_3007448b3ee13835b4ed50b30bd18126.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_3007448b3ee13835b4ed50b30bd18126.jpg saved to cache
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 03e7aab2-1b46-5b00-be64-a7c586119507
2026-03-27 10:43:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f641387c-fa4d-5f22-9253-6b27d0e51fff with identifier: GG04913
2026-03-27 10:43:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f641387c-fa4d-5f22-9253-6b27d0e51fff with scrape type 1
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f641387c-fa4d-5f22-9253-6b27d0e51fff
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F32%252Fc132f931924c1e107db260a7ece88613%252Fpa%252FGG04913_ee88a6ae11615c7aef0479ec3b496703.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_ee88a6ae11615c7aef0479ec3b496703.jpg already downloaded
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F32%252Fc132f931924c1e107db260a7ece88613%252Fpa%252FGG04913_e2fe5c1c6ce43cc6619a9aff1758787b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_e2fe5c1c6ce43cc6619a9aff1758787b.jpg already downloaded
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F32%252Fc132f931924c1e107db260a7ece88613%252Fpa%252FGG04913_f22f6d82744ebb6e8b2e7891c78487a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_f22f6d82744ebb6e8b2e7891c78487a7.jpg already downloaded
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F32%252Fc132f931924c1e107db260a7ece88613%252Fpa%252FGG04913_f39503c2612f31ca6bd99bae0b018505.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_f39503c2612f31ca6bd99bae0b018505.jpg already downloaded
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F32%252Fc132f931924c1e107db260a7ece88613%252Fpa%252FGG04913_49029dd849fc670c46b0b112f28d7941.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_49029dd849fc670c46b0b112f28d7941.jpg already downloaded
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F32%252Fc132f931924c1e107db260a7ece88613%252Fpa%252FGG04913_f5dda18c7e9545990a8c78392af72d5f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_f5dda18c7e9545990a8c78392af72d5f.jpg already downloaded
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F32%252Fc132f931924c1e107db260a7ece88613%252Fpa%252FGG04913_3f42395a617a7f8aa7bc53d9c52264d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_3f42395a617a7f8aa7bc53d9c52264d8.jpg already downloaded
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F32%252Fc132f931924c1e107db260a7ece88613%252Fpa%252FGG04913_9f1dc0974c0cf926fcb262639b5e687c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_9f1dc0974c0cf926fcb262639b5e687c.jpg already downloaded
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F32%252Fc132f931924c1e107db260a7ece88613%252Fpa%252FGG04913_3ca3252d295b21c3c2b4657617392f8e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_3ca3252d295b21c3c2b4657617392f8e.jpg already downloaded
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F32%252Fc132f931924c1e107db260a7ece88613%252Fpa%252FGG04913_09d8d567036acef6091011b24fa0040c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_09d8d567036acef6091011b24fa0040c.jpg already downloaded
2026-03-27 10:43:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f641387c-fa4d-5f22-9253-6b27d0e51fff, identifier: GG04913
2026-03-27 10:43:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:47 [auto1.de] INFO: Found listing with ID: XU02017
2026-03-27 10:43:47 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD14847%27 HTTP/1.1" 200 None
2026-03-27 10:43:47 [auto1.de] INFO: Scrape type for UD14847: 2
2026-03-27 10:43:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84f3d58e-c0bb-5e60-934b-ebe9742324a8 with identifier: UD14847
2026-03-27 10:43:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84f3d58e-c0bb-5e60-934b-ebe9742324a8 with scrape type 2
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84f3d58e-c0bb-5e60-934b-ebe9742324a8 with scrape type 2
2026-03-27 10:43:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84f3d58e-c0bb-5e60-934b-ebe9742324a8, identifier: UD14847
2026-03-27 10:43:47 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS04919%27 HTTP/1.1" 200 None
2026-03-27 10:43:47 [auto1.de] INFO: Scrape type for ZS04919: 1
2026-03-27 10:43:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f641387c-fa4d-5f22-9253-6b27d0e51fff with identifier: GG04913
2026-03-27 10:43:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f641387c-fa4d-5f22-9253-6b27d0e51fff with identifier: GG04913
2026-03-27 10:43:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f641387c-fa4d-5f22-9253-6b27d0e51fff with identifier: GG04913 to the API
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GG04913>
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:57:21Z',
'fuel_type': 'petrol',
'id': 'f641387c-fa4d-5f22-9253-6b27d0e51fff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG04913',
'listing': 'auction',
'location': 'DE, Kerpen',
'make': 'Opel',
'model': 'Cascada',
'odometer': 153142,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_ee88a6ae11615c7aef0479ec3b496703.jpg',
'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_e2fe5c1c6ce43cc6619a9aff1758787b.jpg',
'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_f22f6d82744ebb6e8b2e7891c78487a7.jpg',
'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_f39503c2612f31ca6bd99bae0b018505.jpg',
'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_49029dd849fc670c46b0b112f28d7941.jpg',
'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_f5dda18c7e9545990a8c78392af72d5f.jpg',
'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_3f42395a617a7f8aa7bc53d9c52264d8.jpg',
'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_9f1dc0974c0cf926fcb262639b5e687c.jpg',
'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_3ca3252d295b21c3c2b4657617392f8e.jpg',
'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_09d8d567036acef6091011b24fa0040c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f641387c-fa4d-5f22-9253-6b27d0e51fff/f641387c-fa4d-5f22-9253-6b27d0e51fff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117978,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_ee88a6ae11615c7aef0479ec3b496703.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f641387c-fa4d-5f22-9253-6b27d0e51fff/f641387c-fa4d-5f22-9253-6b27d0e51fff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673852,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_e2fe5c1c6ce43cc6619a9aff1758787b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f641387c-fa4d-5f22-9253-6b27d0e51fff/f641387c-fa4d-5f22-9253-6b27d0e51fff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98319,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_f22f6d82744ebb6e8b2e7891c78487a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f641387c-fa4d-5f22-9253-6b27d0e51fff/f641387c-fa4d-5f22-9253-6b27d0e51fff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 744014,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_f39503c2612f31ca6bd99bae0b018505.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f641387c-fa4d-5f22-9253-6b27d0e51fff/f641387c-fa4d-5f22-9253-6b27d0e51fff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584395,
'Height': 2048,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_49029dd849fc670c46b0b112f28d7941.jpg',
'Width': 1536},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f641387c-fa4d-5f22-9253-6b27d0e51fff/f641387c-fa4d-5f22-9253-6b27d0e51fff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132091,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_f5dda18c7e9545990a8c78392af72d5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f641387c-fa4d-5f22-9253-6b27d0e51fff/f641387c-fa4d-5f22-9253-6b27d0e51fff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123298,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_3f42395a617a7f8aa7bc53d9c52264d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f641387c-fa4d-5f22-9253-6b27d0e51fff/f641387c-fa4d-5f22-9253-6b27d0e51fff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644995,
'Height': 2048,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_9f1dc0974c0cf926fcb262639b5e687c.jpg',
'Width': 1536},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f641387c-fa4d-5f22-9253-6b27d0e51fff/f641387c-fa4d-5f22-9253-6b27d0e51fff_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_3ca3252d295b21c3c2b4657617392f8e.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f641387c-fa4d-5f22-9253-6b27d0e51fff/f641387c-fa4d-5f22-9253-6b27d0e51fff_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44477,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/32/c132f931924c1e107db260a7ece88613/pa/GG04913_09d8d567036acef6091011b24fa0040c.jpg',
'Width': 450}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-02-18',
'seats_number': 4,
'seller_name': None,
'title': 'Opel Cascada 1.4 Turbo Innovation ecoFlex',
'transmission': 'manual',
'trim': 'Innovation ecoFlex',
'year': 2015}
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG04913%27 HTTP/1.1" 200 None
2026-03-27 10:43:47 [auto1.de] INFO: Saving data for GG04913: {'created_time': 1774608227.912072, 'last_price_update_time': 1774608227.912083, 'auction_closing_time': 1774717041.0}
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG04913') HTTP/1.1" 204 0
2026-03-27 10:43:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84f3d58e-c0bb-5e60-934b-ebe9742324a8 with identifier: UD14847
2026-03-27 10:43:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84f3d58e-c0bb-5e60-934b-ebe9742324a8 with identifier: UD14847
2026-03-27 10:43:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84f3d58e-c0bb-5e60-934b-ebe9742324a8 with identifier: UD14847 to the API
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:51:49Z',
'fuel_type': 'petrol',
'id': '84f3d58e-c0bb-5e60-934b-ebe9742324a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD14847',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 81152,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-31',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD14847%27 HTTP/1.1" 200 None
2026-03-27 10:43:48 [auto1.de] INFO: Saving data for UD14847: {'auction_closing_time': 1774716709.0, 'created_time': 1773427501.291969, 'last_price_update_time': 1774608228.287024}
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD14847') HTTP/1.1" 204 0
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be139e10>
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_5a9965db3920480f93b2d08e14e353b6.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_5a9965db3920480f93b2d08e14e353b6.jpg saved to cache
2026-03-27 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 54ffe804-94e7-5d1d-a171-617d00f837cf
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf388f10>
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_fe3f105c0a7234db61f93f4a388a57bb.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_fe3f105c0a7234db61f93f4a388a57bb.jpg saved to cache
2026-03-27 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 54ffe804-94e7-5d1d-a171-617d00f837cf
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf36b750>
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_32a94a6e3f06818549a3ca626742ad8f.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_32a94a6e3f06818549a3ca626742ad8f.jpg saved to cache
2026-03-27 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 03e7aab2-1b46-5b00-be64-a7c586119507
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf35a350>
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_74d605a45b3b9575210ff905cc5d00a1.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_74d605a45b3b9575210ff905cc5d00a1.jpg saved to cache
2026-03-27 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 03e7aab2-1b46-5b00-be64-a7c586119507
2026-03-27 10:43:48 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA85998%27 HTTP/1.1" 200 None
2026-03-27 10:43:48 [auto1.de] INFO: Scrape type for PA85998: 1
2026-03-27 10:43:48 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM03411%27 HTTP/1.1" 200 None
2026-03-27 10:43:48 [auto1.de] INFO: Scrape type for RM03411: 1
2026-03-27 10:43:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:48 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06464%27 HTTP/1.1" 200 None
2026-03-27 10:43:48 [auto1.de] INFO: Scrape type for VX06464: 2
2026-03-27 10:43:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fbad728-be3a-5d7e-9e5c-c557b0dae75d with identifier: VX06464
2026-03-27 10:43:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fbad728-be3a-5d7e-9e5c-c557b0dae75d with scrape type 2
2026-03-27 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fbad728-be3a-5d7e-9e5c-c557b0dae75d with scrape type 2
2026-03-27 10:43:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fbad728-be3a-5d7e-9e5c-c557b0dae75d, identifier: VX06464
2026-03-27 10:43:48 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-27 10:43:48 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR34423%27 HTTP/1.1" 200 None
2026-03-27 10:43:48 [auto1.de] INFO: Scrape type for VR34423: 2
2026-03-27 10:43:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53439014-b8b9-5213-b2c2-2a1af04affbd with identifier: VR34423
2026-03-27 10:43:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53439014-b8b9-5213-b2c2-2a1af04affbd with scrape type 2
2026-03-27 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53439014-b8b9-5213-b2c2-2a1af04affbd with scrape type 2
2026-03-27 10:43:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53439014-b8b9-5213-b2c2-2a1af04affbd, identifier: VR34423
2026-03-27 10:43:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fbad728-be3a-5d7e-9e5c-c557b0dae75d with identifier: VX06464
2026-03-27 10:43:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fbad728-be3a-5d7e-9e5c-c557b0dae75d with identifier: VX06464
2026-03-27 10:43:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fbad728-be3a-5d7e-9e5c-c557b0dae75d with identifier: VX06464 to the API
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-28T16:02:47Z',
'fuel_type': 'diesel',
'id': '0fbad728-be3a-5d7e-9e5c-c557b0dae75d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX06464',
'listing': 'auction',
'make': 'Audi',
'model': 'A4 Allroad',
'odometer': 207928,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-30',
'seller_name': None,
'title': 'Audi A4 Allroad 3.0 V6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06464%27 HTTP/1.1" 200 None
2026-03-27 10:43:49 [auto1.de] INFO: Saving data for VX06464: {'auction_closing_time': 1774713767.0, 'created_time': 1773469108.653736, 'last_price_update_time': 1774608229.096909}
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX06464') HTTP/1.1" 204 0
2026-03-27 10:43:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53439014-b8b9-5213-b2c2-2a1af04affbd with identifier: VR34423
2026-03-27 10:43:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53439014-b8b9-5213-b2c2-2a1af04affbd with identifier: VR34423
2026-03-27 10:43:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53439014-b8b9-5213-b2c2-2a1af04affbd with identifier: VR34423 to the API
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:34:55Z',
'fuel_type': 'petrol',
'id': '53439014-b8b9-5213-b2c2-2a1af04affbd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR34423',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 95976,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-26',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 CGI T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2012}
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR34423%27 HTTP/1.1" 200 None
2026-03-27 10:43:49 [auto1.de] INFO: Saving data for VR34423: {'auction_closing_time': 1774715695.0, 'created_time': 1773429146.409993, 'last_price_update_time': 1774608229.569648}
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR34423') HTTP/1.1" 204 0
2026-03-27 10:43:49 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-27 10:43:49 [auto1.de] INFO: Found listing with ID: EC48687
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC48687%27 HTTP/1.1" 200 None
2026-03-27 10:43:49 [auto1.de] INFO: Scrape type for EC48687: 1
2026-03-27 10:43:49 [auto1.de] INFO: Found listing with ID: MN31316
2026-03-27 10:43:49 [auto1.de] INFO: Found listing with ID: BJ91996
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ91996%27 HTTP/1.1" 200 None
2026-03-27 10:43:49 [auto1.de] INFO: Scrape type for BJ91996: 1
2026-03-27 10:43:49 [auto1.de] INFO: Found listing with ID: VC27283
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC27283%27 HTTP/1.1" 200 None
2026-03-27 10:43:49 [auto1.de] INFO: Scrape type for VC27283: 1
2026-03-27 10:43:49 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-27 10:43:49 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB14083%27 HTTP/1.1" 200 None
2026-03-27 10:43:49 [auto1.de] INFO: Scrape type for AB14083: 2
2026-03-27 10:43:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7befd98-7c74-5aef-985d-5b661a3028ac with identifier: AB14083
2026-03-27 10:43:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7befd98-7c74-5aef-985d-5b661a3028ac with scrape type 2
2026-03-27 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7befd98-7c74-5aef-985d-5b661a3028ac with scrape type 2
2026-03-27 10:43:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7befd98-7c74-5aef-985d-5b661a3028ac, identifier: AB14083
2026-03-27 10:43:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7befd98-7c74-5aef-985d-5b661a3028ac with identifier: AB14083
2026-03-27 10:43:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7befd98-7c74-5aef-985d-5b661a3028ac with identifier: AB14083
2026-03-27 10:43:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7befd98-7c74-5aef-985d-5b661a3028ac with identifier: AB14083 to the API
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:28:51Z',
'fuel_type': 'petrol',
'id': 'f7befd98-7c74-5aef-985d-5b661a3028ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB14083',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 116246,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-04-21',
'seller_name': None,
'title': 'Volkswagen Golf V 1.6 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2005}
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB14083%27 HTTP/1.1" 200 None
2026-03-27 10:43:50 [auto1.de] INFO: Saving data for AB14083: {'auction_closing_time': 1774715331.0, 'created_time': 1774031485.470664, 'last_price_update_time': 1774608230.241684}
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB14083') HTTP/1.1" 204 0
2026-03-27 10:43:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:50 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR59987%27 HTTP/1.1" 200 None
2026-03-27 10:43:50 [auto1.de] INFO: Scrape type for KR59987: 2
2026-03-27 10:43:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b94ba28-32bf-5e16-b129-66d1a51e379c with identifier: KR59987
2026-03-27 10:43:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b94ba28-32bf-5e16-b129-66d1a51e379c with scrape type 2
2026-03-27 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b94ba28-32bf-5e16-b129-66d1a51e379c with scrape type 2
2026-03-27 10:43:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b94ba28-32bf-5e16-b129-66d1a51e379c, identifier: KR59987
2026-03-27 10:43:50 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71363%27 HTTP/1.1" 200 None
2026-03-27 10:43:50 [auto1.de] INFO: Scrape type for HL71363: 2
2026-03-27 10:43:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed3b527b-ba2e-5a21-947c-98087d16aa66 with identifier: HL71363
2026-03-27 10:43:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed3b527b-ba2e-5a21-947c-98087d16aa66 with scrape type 2
2026-03-27 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed3b527b-ba2e-5a21-947c-98087d16aa66 with scrape type 2
2026-03-27 10:43:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed3b527b-ba2e-5a21-947c-98087d16aa66, identifier: HL71363
2026-03-27 10:43:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b94ba28-32bf-5e16-b129-66d1a51e379c with identifier: KR59987
2026-03-27 10:43:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b94ba28-32bf-5e16-b129-66d1a51e379c with identifier: KR59987
2026-03-27 10:43:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b94ba28-32bf-5e16-b129-66d1a51e379c with identifier: KR59987 to the API
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:15:55Z',
'fuel_type': 'petrol',
'id': '2b94ba28-32bf-5e16-b129-66d1a51e379c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR59987',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 186064,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-16',
'seller_name': None,
'title': 'Hyundai i10 1.1 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2011}
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR59987%27 HTTP/1.1" 200 None
2026-03-27 10:43:50 [auto1.de] INFO: Saving data for KR59987: {'auction_closing_time': 1774714555.0, 'created_time': 1773660381.20251, 'last_price_update_time': 1774608230.940828}
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR59987') HTTP/1.1" 204 0
2026-03-27 10:43:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed3b527b-ba2e-5a21-947c-98087d16aa66 with identifier: HL71363
2026-03-27 10:43:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed3b527b-ba2e-5a21-947c-98087d16aa66 with identifier: HL71363
2026-03-27 10:43:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed3b527b-ba2e-5a21-947c-98087d16aa66 with identifier: HL71363 to the API
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:10:36Z',
'fuel_type': 'diesel',
'id': 'ed3b527b-ba2e-5a21-947c-98087d16aa66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL71363',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 137709,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-06',
'seller_name': None,
'title': 'Seat Ateca 2.0 TDI Xcellence 4Drive',
'transmission': 'automatic',
'trim': 'Xcellence 4Drive',
'year': 2018}
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71363%27 HTTP/1.1" 200 None
2026-03-27 10:43:51 [auto1.de] INFO: Saving data for HL71363: {'auction_closing_time': 1774714236.0, 'created_time': 1773137201.201656, 'last_price_update_time': 1774608231.292951}
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL71363') HTTP/1.1" 204 0
2026-03-27 10:43:51 [auto1.de] INFO: Found listing with ID: RN45636
2026-03-27 10:43:51 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX38798%27 HTTP/1.1" 200 None
2026-03-27 10:43:51 [auto1.de] INFO: Scrape type for BX38798: 2
2026-03-27 10:43:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bd4c0a3-c14e-5839-95e1-2832184b0c5e with identifier: BX38798
2026-03-27 10:43:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bd4c0a3-c14e-5839-95e1-2832184b0c5e with scrape type 2
2026-03-27 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bd4c0a3-c14e-5839-95e1-2832184b0c5e with scrape type 2
2026-03-27 10:43:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bd4c0a3-c14e-5839-95e1-2832184b0c5e, identifier: BX38798
2026-03-27 10:43:51 [auto1.de] INFO: Found listing with ID: ZZ67378
2026-03-27 10:43:51 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH57189%27 HTTP/1.1" 200 None
2026-03-27 10:43:51 [auto1.de] INFO: Scrape type for GH57189: 1
2026-03-27 10:43:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bd4c0a3-c14e-5839-95e1-2832184b0c5e with identifier: BX38798
2026-03-27 10:43:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bd4c0a3-c14e-5839-95e1-2832184b0c5e with identifier: BX38798
2026-03-27 10:43:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bd4c0a3-c14e-5839-95e1-2832184b0c5e with identifier: BX38798 to the API
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-28T16:17:11Z',
'fuel_type': 'diesel',
'id': '3bd4c0a3-c14e-5839-95e1-2832184b0c5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX38798',
'listing': 'auction',
'make': 'Audi',
'model': 'A4 Allroad',
'odometer': 320728,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-20',
'seller_name': None,
'title': 'Audi A4 Allroad 3.0 V6 TDI clean diesel',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX38798%27 HTTP/1.1" 200 None
2026-03-27 10:43:52 [auto1.de] INFO: Saving data for BX38798: {'auction_closing_time': 1774714631.0, 'created_time': 1774349907.772821, 'last_price_update_time': 1774608232.031656}
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX38798') HTTP/1.1" 204 0
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: RT05682
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT05682%27 HTTP/1.1" 200 None
2026-03-27 10:43:52 [auto1.de] INFO: Scrape type for RT05682: 1
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: NB18835
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB18835%27 HTTP/1.1" 200 None
2026-03-27 10:43:52 [auto1.de] INFO: Scrape type for NB18835: 1
2026-03-27 10:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP02747> (referer: https://www.auto1.com/v1/car-details-view/BP02747/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: ZK76499
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN46705%27 HTTP/1.1" 200 None
2026-03-27 10:43:52 [auto1.de] INFO: Scrape type for EN46705: 1
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR29385%27 HTTP/1.1" 200 None
2026-03-27 10:43:52 [auto1.de] INFO: Scrape type for CR29385: 1
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ50846%27 HTTP/1.1" 200 None
2026-03-27 10:43:52 [auto1.de] INFO: Scrape type for FZ50846: 0
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61504%27 HTTP/1.1" 200 None
2026-03-27 10:43:52 [auto1.de] INFO: Scrape type for GD61504: 1
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM89812%27 HTTP/1.1" 200 None
2026-03-27 10:43:52 [auto1.de] INFO: Scrape type for LM89812: 1
2026-03-27 10:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_8ff050b8975a9ace7cbc5bdc556c7bd4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_d7fdc888e237aa67a76c74b6c6dae8a6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC56654%27 HTTP/1.1" 200 None
2026-03-27 10:43:52 [auto1.de] INFO: Scrape type for MC56654: 2
2026-03-27 10:43:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf with identifier: MC56654
2026-03-27 10:43:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf with scrape type 2
2026-03-27 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf with scrape type 2
2026-03-27 10:43:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf, identifier: MC56654
2026-03-27 10:43:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf with identifier: MC56654
2026-03-27 10:43:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf with identifier: MC56654
2026-03-27 10:43:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14d0a9af-cc96-503d-9d3a-9fe700bd2ecf with identifier: MC56654 to the API
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:37:58Z',
'fuel_type': 'petrol',
'id': '14d0a9af-cc96-503d-9d3a-9fe700bd2ecf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC56654',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 49058,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-12',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.0 TSI Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2022}
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC56654%27 HTTP/1.1" 200 None
2026-03-27 10:43:52 [auto1.de] INFO: Saving data for MC56654: {'auction_closing_time': 1774715878.0, 'created_time': 1773775223.190521, 'last_price_update_time': 1774608232.692739}
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC56654') HTTP/1.1" 204 0
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE75344%27 HTTP/1.1" 200 None
2026-03-27 10:43:52 [auto1.de] INFO: Scrape type for ZE75344: 1
2026-03-27 10:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA85998/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7734d4b9-6b07-545e-a7ab-6e568f141601 with identifier: BP02747
2026-03-27 10:43:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7734d4b9-6b07-545e-a7ab-6e568f141601 with scrape type 1
2026-03-27 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7734d4b9-6b07-545e-a7ab-6e568f141601
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_c40f563f675c463a8375bbcc3612bd58.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_c40f563f675c463a8375bbcc3612bd58.jpg not downloaded yet
2026-03-27 10:43:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be176a90>
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_8ff050b8975a9ace7cbc5bdc556c7bd4.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_8ff050b8975a9ace7cbc5bdc556c7bd4.jpg saved to cache
2026-03-27 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54ffe804-94e7-5d1d-a171-617d00f837cf
2026-03-27 10:43:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be138590>
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F4c%252F0b4cfb0b15337ac7c79ad5d2e01584d8%252Fpa%252FWJ93096_d7fdc888e237aa67a76c74b6c6dae8a6.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_d7fdc888e237aa67a76c74b6c6dae8a6.jpg saved to cache
2026-03-27 10:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54ffe804-94e7-5d1d-a171-617d00f837cf
2026-03-27 10:43:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54ffe804-94e7-5d1d-a171-617d00f837cf, skipping ID generation
2026-03-27 10:43:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54ffe804-94e7-5d1d-a171-617d00f837cf with scrape type 1
2026-03-27 10:43:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54ffe804-94e7-5d1d-a171-617d00f837cf sending to next pipeline
2026-03-27 10:43:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54ffe804-94e7-5d1d-a171-617d00f837cf, identifier: WJ93096
2026-03-27 10:43:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_1f76de9a6a1aeccfb3ecd59f0dbd8218.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:53 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-27 10:43:53 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-27 10:43:53 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR97371%27 HTTP/1.1" 200 None
2026-03-27 10:43:53 [auto1.de] INFO: Scrape type for JR97371: 2
2026-03-27 10:43:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ee31247-563d-5d39-9604-3c7d8bea3d43 with identifier: JR97371
2026-03-27 10:43:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ee31247-563d-5d39-9604-3c7d8bea3d43 with scrape type 2
2026-03-27 10:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ee31247-563d-5d39-9604-3c7d8bea3d43 with scrape type 2
2026-03-27 10:43:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ee31247-563d-5d39-9604-3c7d8bea3d43, identifier: JR97371
2026-03-27 10:43:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54ffe804-94e7-5d1d-a171-617d00f837cf with identifier: WJ93096
2026-03-27 10:43:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54ffe804-94e7-5d1d-a171-617d00f837cf with identifier: WJ93096
2026-03-27 10:43:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54ffe804-94e7-5d1d-a171-617d00f837cf with identifier: WJ93096 to the API
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_d7fdc888e237aa67a76c74b6c6dae8a6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-03-28T16:32:57Z',
'fuel_type': 'hybrid',
'id': '54ffe804-94e7-5d1d-a171-617d00f837cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ93096',
'listing': 'auction',
'location': 'DE, Berlin',
'make': 'Suzuki',
'model': 'Vitara',
'odometer': 22119,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56627,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_3bf90b88004fd3fad4b8edac697f16b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_dc4fe8a367808046946857919c14f142.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2442666,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_8ff050b8975a9ace7cbc5bdc556c7bd4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2456469,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_d7fdc888e237aa67a76c74b6c6dae8a6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_db2ac9e1cfb55b8f0b0d119b24822275.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_190c46da19471f089e5a07d281f20450.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52748,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_c6f5b79ec7fa0495966cab696254ca0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71502,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_66de67a01fe9bedb5a617068947d6cc9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_5a9965db3920480f93b2d08e14e353b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54ffe804-94e7-5d1d-a171-617d00f837cf/54ffe804-94e7-5d1d-a171-617d00f837cf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49364,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/4c/0b4cfb0b15337ac7c79ad5d2e01584d8/pa/WJ93096_fe3f105c0a7234db61f93f4a388a57bb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'Suzuki Vitara 1.5 Dualjet Hybrid Comfort 4x2',
'transmission': 'automatic',
'trim': 'Comfort 4x2',
'year': 2023}
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ93096%27 HTTP/1.1" 200 None
2026-03-27 10:43:53 [auto1.de] INFO: Saving data for WJ93096: {'created_time': 1774608233.898749, 'last_price_update_time': 1774608233.89876, 'auction_closing_time': 1774715577.0}
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ93096') HTTP/1.1" 204 0
2026-03-27 10:43:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ee31247-563d-5d39-9604-3c7d8bea3d43 with identifier: JR97371
2026-03-27 10:43:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ee31247-563d-5d39-9604-3c7d8bea3d43 with identifier: JR97371
2026-03-27 10:43:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ee31247-563d-5d39-9604-3c7d8bea3d43 with identifier: JR97371 to the API
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:58:05Z',
'fuel_type': 'diesel',
'id': '3ee31247-563d-5d39-9604-3c7d8bea3d43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR97371',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 201428,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-31',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Scout 4x4',
'transmission': 'manual',
'trim': 'Scout 4x4',
'year': 2010}
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR97371%27 HTTP/1.1" 200 None
2026-03-27 10:43:54 [auto1.de] INFO: Saving data for JR97371: {'auction_closing_time': 1774717085.0, 'created_time': 1773905443.219309, 'last_price_update_time': 1774608234.472646}
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR97371') HTTP/1.1" 204 0
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_bb4ac50c39a3e61a8a2340a4d70e2a51.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_bb4ac50c39a3e61a8a2340a4d70e2a51.jpg not downloaded yet
2026-03-27 10:43:54 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-27 10:43:54 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ62576%27 HTTP/1.1" 200 None
2026-03-27 10:43:54 [auto1.de] INFO: Scrape type for XJ62576: 1
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_3f00b2b1a86d15043540cf45c9bb00e4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_3f00b2b1a86d15043540cf45c9bb00e4.jpg not downloaded yet
2026-03-27 10:43:54 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-27 10:43:54 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-27 10:43:54 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX83628%27 HTTP/1.1" 200 None
2026-03-27 10:43:54 [auto1.de] INFO: Scrape type for XX83628: 1
2026-03-27 10:43:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf557450>
2026-03-27 10:43:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_1f76de9a6a1aeccfb3ecd59f0dbd8218.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_1f76de9a6a1aeccfb3ecd59f0dbd8218.jpg saved to cache
2026-03-27 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03e7aab2-1b46-5b00-be64-a7c586119507
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_d5918ba8ac3a901cc61ba4908af85d07.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_d5918ba8ac3a901cc61ba4908af85d07.jpg not downloaded yet
2026-03-27 10:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_5ecad74dd0c70c054df47b58ce70c8cc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:54 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-27 10:43:54 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-27 10:43:54 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM13382%27 HTTP/1.1" 200 None
2026-03-27 10:43:54 [auto1.de] INFO: Scrape type for DM13382: 2
2026-03-27 10:43:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c10f829-a6be-5740-bd57-74517d6a4f59 with identifier: DM13382
2026-03-27 10:43:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c10f829-a6be-5740-bd57-74517d6a4f59 with scrape type 2
2026-03-27 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c10f829-a6be-5740-bd57-74517d6a4f59 with scrape type 2
2026-03-27 10:43:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c10f829-a6be-5740-bd57-74517d6a4f59, identifier: DM13382
2026-03-27 10:43:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c10f829-a6be-5740-bd57-74517d6a4f59 with identifier: DM13382
2026-03-27 10:43:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c10f829-a6be-5740-bd57-74517d6a4f59 with identifier: DM13382
2026-03-27 10:43:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c10f829-a6be-5740-bd57-74517d6a4f59 with identifier: DM13382 to the API
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:15:06Z',
'fuel_type': 'petrol',
'id': '8c10f829-a6be-5740-bd57-74517d6a4f59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM13382',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 90029,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-27',
'seller_name': None,
'title': 'Skoda Octavia 1.5 TSI ACT Clever',
'transmission': 'automatic',
'trim': 'Clever',
'year': 2018}
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM13382%27 HTTP/1.1" 200 None
2026-03-27 10:43:55 [auto1.de] INFO: Saving data for DM13382: {'auction_closing_time': 1774714506.0, 'created_time': 1773307254.364152, 'last_price_update_time': 1774608235.677332}
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM13382') HTTP/1.1" 204 0
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_d39c4f685e358f14e40816df61d0fa5d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_d39c4f685e358f14e40816df61d0fa5d.jpg not downloaded yet
2026-03-27 10:43:55 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-27 10:43:55 [auto1.de] INFO: Found listing with ID: CC90437
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC90437%27 HTTP/1.1" 200 None
2026-03-27 10:43:55 [auto1.de] INFO: Scrape type for CC90437: 1
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_6fadaae8c90dcbe790542d85bfbbe50a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_6fadaae8c90dcbe790542d85bfbbe50a.jpg not downloaded yet
2026-03-27 10:43:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f7b10>
2026-03-27 10:43:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fb6%252Fc5b669d2a9c8c3a3f2e4eca78801d562%252Fpa%252FDF02739_5ecad74dd0c70c054df47b58ce70c8cc.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_5ecad74dd0c70c054df47b58ce70c8cc.jpg saved to cache
2026-03-27 10:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03e7aab2-1b46-5b00-be64-a7c586119507
2026-03-27 10:43:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03e7aab2-1b46-5b00-be64-a7c586119507, skipping ID generation
2026-03-27 10:43:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03e7aab2-1b46-5b00-be64-a7c586119507 with scrape type 1
2026-03-27 10:43:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03e7aab2-1b46-5b00-be64-a7c586119507 sending to next pipeline
2026-03-27 10:43:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03e7aab2-1b46-5b00-be64-a7c586119507, identifier: DF02739
2026-03-27 10:43:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_bb4ac50c39a3e61a8a2340a4d70e2a51.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_3f00b2b1a86d15043540cf45c9bb00e4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:56 [auto1.de] INFO: Found listing with ID: SM08668
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM08668%27 HTTP/1.1" 200 None
2026-03-27 10:43:56 [auto1.de] INFO: Scrape type for SM08668: 1
2026-03-27 10:43:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03e7aab2-1b46-5b00-be64-a7c586119507 with identifier: DF02739
2026-03-27 10:43:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03e7aab2-1b46-5b00-be64-a7c586119507 with identifier: DF02739
2026-03-27 10:43:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03e7aab2-1b46-5b00-be64-a7c586119507 with identifier: DF02739 to the API
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_5ecad74dd0c70c054df47b58ce70c8cc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 199,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:47:55Z',
'fuel_type': 'petrol',
'id': '03e7aab2-1b46-5b00-be64-a7c586119507',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF02739',
'listing': 'auction',
'location': 'DE, Flensburg',
'make': 'Audi',
'model': 'A4',
'odometer': 123565,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93244,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_4c5e7fd474f510882578a523a87157bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80945,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_9094d1342fc5552a621c2cbbd3483817.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3202340,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_5ecad74dd0c70c054df47b58ce70c8cc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2736655,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_1f76de9a6a1aeccfb3ecd59f0dbd8218.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_de99980bca5aca1dbc2682bfc2b0bfd5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_197ee5e01d87a2a70864e2722316e76f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_636fec6a5bc55147bb63c434cedd7515.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_3007448b3ee13835b4ed50b30bd18126.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88516,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_74d605a45b3b9575210ff905cc5d00a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e7aab2-1b46-5b00-be64-a7c586119507/03e7aab2-1b46-5b00-be64-a7c586119507_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/b6/c5b669d2a9c8c3a3f2e4eca78801d562/pa/DF02739_32a94a6e3f06818549a3ca626742ad8f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-04-23',
'seats_number': 4,
'seller_name': None,
'title': 'Audi A4 2.0 TFSI',
'transmission': 'automatic',
'trim': '',
'year': 2007}
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF02739%27 HTTP/1.1" 200 None
2026-03-27 10:43:56 [auto1.de] INFO: Saving data for DF02739: {'created_time': 1774608236.569037, 'last_price_update_time': 1774608236.569048, 'auction_closing_time': 1774716475.0}
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF02739') HTTP/1.1" 204 0
2026-03-27 10:43:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_d5918ba8ac3a901cc61ba4908af85d07.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_79282d5e698d350bf1544f8ea05dd17e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_79282d5e698d350bf1544f8ea05dd17e.jpg not downloaded yet
2026-03-27 10:43:56 [auto1.de] INFO: Found listing with ID: ND31150
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND31150%27 HTTP/1.1" 200 None
2026-03-27 10:43:56 [auto1.de] INFO: Scrape type for ND31150: 2
2026-03-27 10:43:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 647873b0-8b19-5fc8-8d65-b4144ffff44c with identifier: ND31150
2026-03-27 10:43:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 647873b0-8b19-5fc8-8d65-b4144ffff44c with scrape type 2
2026-03-27 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 647873b0-8b19-5fc8-8d65-b4144ffff44c with scrape type 2
2026-03-27 10:43:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 647873b0-8b19-5fc8-8d65-b4144ffff44c, identifier: ND31150
2026-03-27 10:43:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 647873b0-8b19-5fc8-8d65-b4144ffff44c with identifier: ND31150
2026-03-27 10:43:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 647873b0-8b19-5fc8-8d65-b4144ffff44c with identifier: ND31150
2026-03-27 10:43:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 647873b0-8b19-5fc8-8d65-b4144ffff44c with identifier: ND31150 to the API
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:23:36Z',
'fuel_type': 'petrol',
'id': '647873b0-8b19-5fc8-8d65-b4144ffff44c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND31150',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 224153,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-03',
'seller_name': None,
'title': 'Suzuki Swift 1.2 Basic',
'transmission': 'manual',
'trim': 'Basic',
'year': 2014}
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND31150%27 HTTP/1.1" 200 None
2026-03-27 10:43:57 [auto1.de] INFO: Saving data for ND31150: {'auction_closing_time': 1774715016.0, 'created_time': 1773830252.512512, 'last_price_update_time': 1774608237.093108}
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND31150') HTTP/1.1" 204 0
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_b94f2930ece13327d1085574a080bee9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_b94f2930ece13327d1085574a080bee9.jpg not downloaded yet
2026-03-27 10:43:57 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-27 10:43:57 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB40017%27 HTTP/1.1" 200 None
2026-03-27 10:43:57 [auto1.de] INFO: Scrape type for YB40017: 1
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c53c5810>
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_bb4ac50c39a3e61a8a2340a4d70e2a51.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_bb4ac50c39a3e61a8a2340a4d70e2a51.jpg saved to cache
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7734d4b9-6b07-545e-a7ab-6e568f141601
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3826d0>
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_3f00b2b1a86d15043540cf45c9bb00e4.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_3f00b2b1a86d15043540cf45c9bb00e4.jpg saved to cache
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7734d4b9-6b07-545e-a7ab-6e568f141601
2026-03-27 10:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_d39c4f685e358f14e40816df61d0fa5d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_6a58068476afd3c249789912b8cb9109.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_6a58068476afd3c249789912b8cb9109.jpg not downloaded yet
2026-03-27 10:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_6fadaae8c90dcbe790542d85bfbbe50a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:57 [auto1.de] INFO: Found listing with ID: UZ74086
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1e4150>
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_d5918ba8ac3a901cc61ba4908af85d07.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_d5918ba8ac3a901cc61ba4908af85d07.jpg saved to cache
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7734d4b9-6b07-545e-a7ab-6e568f141601
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_66dc007d03458e77084446b3f20eae88.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_66dc007d03458e77084446b3f20eae88.jpg not downloaded yet
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c561eb50>
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_d39c4f685e358f14e40816df61d0fa5d.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_d39c4f685e358f14e40816df61d0fa5d.jpg saved to cache
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7734d4b9-6b07-545e-a7ab-6e568f141601
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf477bd0>
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_6fadaae8c90dcbe790542d85bfbbe50a.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_6fadaae8c90dcbe790542d85bfbbe50a.jpg saved to cache
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7734d4b9-6b07-545e-a7ab-6e568f141601
2026-03-27 10:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_b94f2930ece13327d1085574a080bee9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_66dc007d03458e77084446b3f20eae88.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c571c3d0>
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_b94f2930ece13327d1085574a080bee9.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_b94f2930ece13327d1085574a080bee9.jpg saved to cache
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7734d4b9-6b07-545e-a7ab-6e568f141601
2026-03-27 10:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_6a58068476afd3c249789912b8cb9109.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2dd050>
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_66dc007d03458e77084446b3f20eae88.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_66dc007d03458e77084446b3f20eae88.jpg saved to cache
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7734d4b9-6b07-545e-a7ab-6e568f141601
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be28aa10>
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_6a58068476afd3c249789912b8cb9109.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_6a58068476afd3c249789912b8cb9109.jpg saved to cache
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7734d4b9-6b07-545e-a7ab-6e568f141601
2026-03-27 10:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_79282d5e698d350bf1544f8ea05dd17e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be225c50>
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_79282d5e698d350bf1544f8ea05dd17e.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_79282d5e698d350bf1544f8ea05dd17e.jpg saved to cache
2026-03-27 10:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7734d4b9-6b07-545e-a7ab-6e568f141601
2026-03-27 10:43:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZS04919/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC48687/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB18835/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ91996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GD61504/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:07 [scrapy.extensions.logstats] INFO: Crawled 381 pages (at 23 pages/min), scraped 854 items (at 74 items/min)
2026-03-27 10:44:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-27 10:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM03411/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC90437/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT05682/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM08668/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA85998> (referer: https://www.auto1.com/v1/car-details-view/PA85998/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ae1811e-78e3-526d-8183-9a67084a9e5d with identifier: PA85998
2026-03-27 10:44:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ae1811e-78e3-526d-8183-9a67084a9e5d with scrape type 1
2026-03-27 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ae1811e-78e3-526d-8183-9a67084a9e5d
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_da2f5a2f194decbdaad59eacd81def56.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_da2f5a2f194decbdaad59eacd81def56.jpg not downloaded yet
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_b7be210d05600d4a74d6cd09427222a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_b7be210d05600d4a74d6cd09427222a5.jpg not downloaded yet
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_91c17a6117a56c74b71274335fc60f46.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_91c17a6117a56c74b71274335fc60f46.jpg not downloaded yet
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_3a8fa7889d27dff9e107adda45289f96.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_3a8fa7889d27dff9e107adda45289f96.jpg not downloaded yet
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_ef540fa5e7139302eb2e0d2b6e97e05d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_ef540fa5e7139302eb2e0d2b6e97e05d.jpg not downloaded yet
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_abe8e37a09209734931b74f38754aee1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_abe8e37a09209734931b74f38754aee1.jpg not downloaded yet
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_ca93fc9eaf210cc7b926f53af4d00fb8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_ca93fc9eaf210cc7b926f53af4d00fb8.jpg not downloaded yet
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_01e2ff17918506d49e13681fb0895c59.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_01e2ff17918506d49e13681fb0895c59.jpg not downloaded yet
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_aeeb7664af5e70df4a6b3b399586aa5c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_aeeb7664af5e70df4a6b3b399586aa5c.jpg not downloaded yet
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_c055e329750a14549ebc612d963de7b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_c055e329750a14549ebc612d963de7b3.jpg not downloaded yet
2026-03-27 10:44:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:23 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 10539 | hits on page: 40
2026-03-27 10:44:23 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-27 10:44:23 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-27 10:44:23 [auto1.de] INFO: Found listing with ID: UZ74086
2026-03-27 10:44:23 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-27 10:44:23 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-27 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB62347%27 HTTP/1.1" 200 None
2026-03-27 10:44:23 [auto1.de] INFO: Scrape type for YB62347: 2
2026-03-27 10:44:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10a7be19-c2b6-534e-a5df-66b929f96b56 with identifier: YB62347
2026-03-27 10:44:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10a7be19-c2b6-534e-a5df-66b929f96b56 with scrape type 2
2026-03-27 10:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10a7be19-c2b6-534e-a5df-66b929f96b56 with scrape type 2
2026-03-27 10:44:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10a7be19-c2b6-534e-a5df-66b929f96b56, identifier: YB62347
2026-03-27 10:44:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10a7be19-c2b6-534e-a5df-66b929f96b56 with identifier: YB62347
2026-03-27 10:44:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10a7be19-c2b6-534e-a5df-66b929f96b56 with identifier: YB62347
2026-03-27 10:44:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10a7be19-c2b6-534e-a5df-66b929f96b56 with identifier: YB62347 to the API
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:07:08Z',
'fuel_type': 'diesel',
'id': '10a7be19-c2b6-534e-a5df-66b929f96b56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB62347',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 172224,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-12',
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi EcoBlue Cool&Connect',
'transmission': 'automatic',
'trim': 'Cool&Connect',
'year': 2019}
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB62347%27 HTTP/1.1" 200 None
2026-03-27 10:44:24 [auto1.de] INFO: Saving data for YB62347: {'auction_closing_time': 1774714028.0, 'created_time': 1773131812.575725, 'last_price_update_time': 1774608264.256395}
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB62347') HTTP/1.1" 204 0
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY13477%27 HTTP/1.1" 200 None
2026-03-27 10:44:24 [auto1.de] INFO: Scrape type for UY13477: 1
2026-03-27 10:44:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_c055e329750a14549ebc612d963de7b3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: ML66978
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: CJ75930
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: XW49468
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR08314%27 HTTP/1.1" 200 None
2026-03-27 10:44:24 [auto1.de] INFO: Scrape type for SR08314: 2
2026-03-27 10:44:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8 with identifier: SR08314
2026-03-27 10:44:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8 with scrape type 2
2026-03-27 10:44:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8 with scrape type 2
2026-03-27 10:44:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8, identifier: SR08314
2026-03-27 10:44:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8 with identifier: SR08314
2026-03-27 10:44:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8 with identifier: SR08314
2026-03-27 10:44:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0abbd100-4ddd-588c-a609-5c7bb2c6a7e8 with identifier: SR08314 to the API
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:43:52Z',
'fuel_type': 'diesel',
'id': '0abbd100-4ddd-588c-a609-5c7bb2c6a7e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR08314',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 436322,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-15',
'seller_name': None,
'title': 'Audi A5 Sportback 2.7 V6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR08314%27 HTTP/1.1" 200 None
2026-03-27 10:44:24 [auto1.de] INFO: Saving data for SR08314: {'auction_closing_time': 1774716232.0, 'created_time': 1773136891.848533, 'last_price_update_time': 1774608264.861301}
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR08314') HTTP/1.1" 204 0
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: MX32750
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS15071%27 HTTP/1.1" 200 None
2026-03-27 10:44:24 [auto1.de] INFO: Scrape type for JS15071: 1
2026-03-27 10:44:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf457650>
2026-03-27 10:44:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_c055e329750a14549ebc612d963de7b3.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_c055e329750a14549ebc612d963de7b3.jpg saved to cache
2026-03-27 10:44:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1ae1811e-78e3-526d-8183-9a67084a9e5d
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13649%27 HTTP/1.1" 200 None
2026-03-27 10:44:24 [auto1.de] INFO: Scrape type for CD13649: 1
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: WF06816
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10791%27 HTTP/1.1" 200 None
2026-03-27 10:44:24 [auto1.de] INFO: Scrape type for HR10791: 2
2026-03-27 10:44:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c12cc02-5c90-503f-b86d-3517fb83850b with identifier: HR10791
2026-03-27 10:44:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c12cc02-5c90-503f-b86d-3517fb83850b with scrape type 2
2026-03-27 10:44:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c12cc02-5c90-503f-b86d-3517fb83850b with scrape type 2
2026-03-27 10:44:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c12cc02-5c90-503f-b86d-3517fb83850b, identifier: HR10791
2026-03-27 10:44:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c12cc02-5c90-503f-b86d-3517fb83850b with identifier: HR10791
2026-03-27 10:44:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c12cc02-5c90-503f-b86d-3517fb83850b with identifier: HR10791
2026-03-27 10:44:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c12cc02-5c90-503f-b86d-3517fb83850b with identifier: HR10791 to the API
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:43:33Z',
'fuel_type': 'diesel',
'id': '2c12cc02-5c90-503f-b86d-3517fb83850b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR10791',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 108952,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-18',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Center-Line 2WD',
'transmission': 'automatic',
'trim': 'Center-Line 2WD',
'year': 2012}
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10791%27 HTTP/1.1" 200 None
2026-03-27 10:44:25 [auto1.de] INFO: Saving data for HR10791: {'auction_closing_time': 1774716213.0, 'created_time': 1774032298.734091, 'last_price_update_time': 1774608265.481399}
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR10791') HTTP/1.1" 204 0
2026-03-27 10:44:25 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36326%27 HTTP/1.1" 200 None
2026-03-27 10:44:25 [auto1.de] INFO: Scrape type for GS36326: 1
2026-03-27 10:44:25 [auto1.de] INFO: Found listing with ID: XV66825
2026-03-27 10:44:25 [auto1.de] INFO: Found listing with ID: FR75488
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR75488%27 HTTP/1.1" 200 None
2026-03-27 10:44:25 [auto1.de] INFO: Scrape type for FR75488: 2
2026-03-27 10:44:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbe13bc0-dc06-5624-94cf-849fa19e3edc with identifier: FR75488
2026-03-27 10:44:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbe13bc0-dc06-5624-94cf-849fa19e3edc with scrape type 2
2026-03-27 10:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbe13bc0-dc06-5624-94cf-849fa19e3edc with scrape type 2
2026-03-27 10:44:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbe13bc0-dc06-5624-94cf-849fa19e3edc, identifier: FR75488
2026-03-27 10:44:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbe13bc0-dc06-5624-94cf-849fa19e3edc with identifier: FR75488
2026-03-27 10:44:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbe13bc0-dc06-5624-94cf-849fa19e3edc with identifier: FR75488
2026-03-27 10:44:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbe13bc0-dc06-5624-94cf-849fa19e3edc with identifier: FR75488 to the API
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:30:46Z',
'fuel_type': 'petrol',
'id': 'bbe13bc0-dc06-5624-94cf-849fa19e3edc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR75488',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 191110,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-11-24',
'seller_name': None,
'title': 'Mitsubishi Outlander 2.0 Invite',
'transmission': 'manual',
'trim': 'Invite',
'year': 2005}
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR75488%27 HTTP/1.1" 200 None
2026-03-27 10:44:26 [auto1.de] INFO: Saving data for FR75488: {'auction_closing_time': 1774715446.0, 'created_time': 1774379799.759491, 'last_price_update_time': 1774608266.156436}
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR75488') HTTP/1.1" 204 0
2026-03-27 10:44:26 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD11027%27 HTTP/1.1" 200 None
2026-03-27 10:44:26 [auto1.de] INFO: Scrape type for MD11027: 2
2026-03-27 10:44:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f509094e-1301-5c23-87ef-a32a3b69de00 with identifier: MD11027
2026-03-27 10:44:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f509094e-1301-5c23-87ef-a32a3b69de00 with scrape type 2
2026-03-27 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f509094e-1301-5c23-87ef-a32a3b69de00 with scrape type 2
2026-03-27 10:44:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f509094e-1301-5c23-87ef-a32a3b69de00, identifier: MD11027
2026-03-27 10:44:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f509094e-1301-5c23-87ef-a32a3b69de00 with identifier: MD11027
2026-03-27 10:44:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f509094e-1301-5c23-87ef-a32a3b69de00 with identifier: MD11027
2026-03-27 10:44:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f509094e-1301-5c23-87ef-a32a3b69de00 with identifier: MD11027 to the API
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:45:07Z',
'fuel_type': 'petrol',
'id': 'f509094e-1301-5c23-87ef-a32a3b69de00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD11027',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 117455,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-12-28',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.8 TSI Highline Aktionsmodell T',
'transmission': 'manual',
'trim': 'Highline Aktionsmodell T',
'year': 2009}
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD11027%27 HTTP/1.1" 200 None
2026-03-27 10:44:26 [auto1.de] INFO: Saving data for MD11027: {'auction_closing_time': 1774716307.0, 'created_time': 1773830356.094439, 'last_price_update_time': 1774608266.594953}
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD11027') HTTP/1.1" 204 0
2026-03-27 10:44:26 [auto1.de] INFO: Found listing with ID: VT63702
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT63702%27 HTTP/1.1" 200 None
2026-03-27 10:44:26 [auto1.de] INFO: Scrape type for VT63702: 2
2026-03-27 10:44:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1ceaa49-b35f-5cd1-ae68-8e8531cc1b00 with identifier: VT63702
2026-03-27 10:44:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ceaa49-b35f-5cd1-ae68-8e8531cc1b00 with scrape type 2
2026-03-27 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1ceaa49-b35f-5cd1-ae68-8e8531cc1b00 with scrape type 2
2026-03-27 10:44:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1ceaa49-b35f-5cd1-ae68-8e8531cc1b00, identifier: VT63702
2026-03-27 10:44:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1ceaa49-b35f-5cd1-ae68-8e8531cc1b00 with identifier: VT63702
2026-03-27 10:44:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1ceaa49-b35f-5cd1-ae68-8e8531cc1b00 with identifier: VT63702
2026-03-27 10:44:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1ceaa49-b35f-5cd1-ae68-8e8531cc1b00 with identifier: VT63702 to the API
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 160,
'expiration_date': '2026-03-28T16:20:21Z',
'fuel_type': 'petrol',
'id': 'a1ceaa49-b35f-5cd1-ae68-8e8531cc1b00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT63702',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 157260,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-13',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Team',
'transmission': 'manual',
'trim': 'Team',
'year': 2011}
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT63702%27 HTTP/1.1" 200 None
2026-03-27 10:44:27 [auto1.de] INFO: Saving data for VT63702: {'auction_closing_time': 1774714821.0, 'created_time': 1774379809.67208, 'last_price_update_time': 1774608267.071979}
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT63702') HTTP/1.1" 204 0
2026-03-27 10:44:27 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-27 10:44:27 [auto1.de] INFO: Found listing with ID: SU14933
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU14933%27 HTTP/1.1" 200 None
2026-03-27 10:44:27 [auto1.de] INFO: Scrape type for SU14933: 2
2026-03-27 10:44:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 377020e3-82f1-5202-81e0-f3132a469aac with identifier: SU14933
2026-03-27 10:44:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 377020e3-82f1-5202-81e0-f3132a469aac with scrape type 2
2026-03-27 10:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 377020e3-82f1-5202-81e0-f3132a469aac with scrape type 2
2026-03-27 10:44:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 377020e3-82f1-5202-81e0-f3132a469aac, identifier: SU14933
2026-03-27 10:44:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 377020e3-82f1-5202-81e0-f3132a469aac with identifier: SU14933
2026-03-27 10:44:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 377020e3-82f1-5202-81e0-f3132a469aac with identifier: SU14933
2026-03-27 10:44:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 377020e3-82f1-5202-81e0-f3132a469aac with identifier: SU14933 to the API
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 300,
'expiration_date': '2026-03-28T16:24:27Z',
'fuel_type': 'petrol',
'id': '377020e3-82f1-5202-81e0-f3132a469aac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU14933',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 213715,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-06',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2012}
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU14933%27 HTTP/1.1" 200 None
2026-03-27 10:44:27 [auto1.de] INFO: Saving data for SU14933: {'auction_closing_time': 1774715067.0, 'created_time': 1774379681.770233, 'last_price_update_time': 1774608267.594456}
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU14933') HTTP/1.1" 204 0
2026-03-27 10:44:27 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG62730%27 HTTP/1.1" 200 None
2026-03-27 10:44:27 [auto1.de] INFO: Scrape type for LG62730: 1
2026-03-27 10:44:27 [auto1.de] INFO: Found listing with ID: RT88012
2026-03-27 10:44:27 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH21308%27 HTTP/1.1" 200 None
2026-03-27 10:44:27 [auto1.de] INFO: Scrape type for JH21308: 2
2026-03-27 10:44:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23b91a1-eda2-53eb-b8ac-64b47f7760bc with identifier: JH21308
2026-03-27 10:44:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23b91a1-eda2-53eb-b8ac-64b47f7760bc with scrape type 2
2026-03-27 10:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f23b91a1-eda2-53eb-b8ac-64b47f7760bc with scrape type 2
2026-03-27 10:44:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f23b91a1-eda2-53eb-b8ac-64b47f7760bc, identifier: JH21308
2026-03-27 10:44:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC27283/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f23b91a1-eda2-53eb-b8ac-64b47f7760bc with identifier: JH21308
2026-03-27 10:44:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f23b91a1-eda2-53eb-b8ac-64b47f7760bc with identifier: JH21308
2026-03-27 10:44:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f23b91a1-eda2-53eb-b8ac-64b47f7760bc with identifier: JH21308 to the API
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:56:46Z',
'fuel_type': 'petrol',
'id': 'f23b91a1-eda2-53eb-b8ac-64b47f7760bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH21308',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLC-Klasse',
'odometer': 25372,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-31',
'seller_name': None,
'title': 'Mercedes-Benz SLC-Klasse SLC 200 CGI',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH21308%27 HTTP/1.1" 200 None
2026-03-27 10:44:28 [auto1.de] INFO: Saving data for JH21308: {'auction_closing_time': 1774717006.0, 'created_time': 1774034477.494268, 'last_price_update_time': 1774608268.132943}
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH21308') HTTP/1.1" 204 0
2026-03-27 10:44:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:28 [auto1.de] INFO: Found listing with ID: EU73133
2026-03-27 10:44:28 [auto1.de] INFO: Found listing with ID: HB31061
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB31061%27 HTTP/1.1" 200 None
2026-03-27 10:44:28 [auto1.de] INFO: Scrape type for HB31061: 1
2026-03-27 10:44:28 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-27 10:44:28 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-27 10:44:28 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB88110%27 HTTP/1.1" 200 None
2026-03-27 10:44:28 [auto1.de] INFO: Scrape type for AB88110: 1
2026-03-27 10:44:28 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-27 10:44:28 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-27 10:44:28 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP68218%27 HTTP/1.1" 200 None
2026-03-27 10:44:28 [auto1.de] INFO: Scrape type for GP68218: 1
2026-03-27 10:44:28 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ51755%27 HTTP/1.1" 200 None
2026-03-27 10:44:28 [auto1.de] INFO: Scrape type for WZ51755: 1
2026-03-27 10:44:28 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-27 10:44:28 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE42693%27 HTTP/1.1" 200 None
2026-03-27 10:44:28 [auto1.de] INFO: Scrape type for AE42693: 2
2026-03-27 10:44:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38a77704-a115-57a5-8d8e-81e4c93c25b3 with identifier: AE42693
2026-03-27 10:44:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38a77704-a115-57a5-8d8e-81e4c93c25b3 with scrape type 2
2026-03-27 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38a77704-a115-57a5-8d8e-81e4c93c25b3 with scrape type 2
2026-03-27 10:44:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38a77704-a115-57a5-8d8e-81e4c93c25b3, identifier: AE42693
2026-03-27 10:44:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38a77704-a115-57a5-8d8e-81e4c93c25b3 with identifier: AE42693
2026-03-27 10:44:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38a77704-a115-57a5-8d8e-81e4c93c25b3 with identifier: AE42693
2026-03-27 10:44:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38a77704-a115-57a5-8d8e-81e4c93c25b3 with identifier: AE42693 to the API
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:54:09Z',
'fuel_type': 'diesel',
'id': '38a77704-a115-57a5-8d8e-81e4c93c25b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE42693',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40',
'odometer': 86474,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-04',
'seller_name': None,
'title': 'Volvo V40 2.0 D2 R-Design',
'transmission': 'manual',
'trim': 'R-Design',
'year': 2018}
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE42693%27 HTTP/1.1" 200 None
2026-03-27 10:44:28 [auto1.de] INFO: Saving data for AE42693: {'auction_closing_time': 1774716849.0, 'created_time': 1773138906.562178, 'last_price_update_time': 1774608268.683473}
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE42693') HTTP/1.1" 204 0
2026-03-27 10:44:28 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK89074%27 HTTP/1.1" 200 None
2026-03-27 10:44:28 [auto1.de] INFO: Scrape type for DK89074: 2
2026-03-27 10:44:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23de73ab-f3f2-5907-acaa-45b867a47b4b with identifier: DK89074
2026-03-27 10:44:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23de73ab-f3f2-5907-acaa-45b867a47b4b with scrape type 2
2026-03-27 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23de73ab-f3f2-5907-acaa-45b867a47b4b with scrape type 2
2026-03-27 10:44:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23de73ab-f3f2-5907-acaa-45b867a47b4b, identifier: DK89074
2026-03-27 10:44:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23de73ab-f3f2-5907-acaa-45b867a47b4b with identifier: DK89074
2026-03-27 10:44:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23de73ab-f3f2-5907-acaa-45b867a47b4b with identifier: DK89074
2026-03-27 10:44:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23de73ab-f3f2-5907-acaa-45b867a47b4b with identifier: DK89074 to the API
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:10:51Z',
'fuel_type': 'petrol',
'id': '23de73ab-f3f2-5907-acaa-45b867a47b4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK89074',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 197846,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-14',
'seller_name': None,
'title': 'Renault Clio 1.2 Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2010}
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK89074%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [auto1.de] INFO: Saving data for DK89074: {'auction_closing_time': 1774714251.0, 'created_time': 1773132202.410904, 'last_price_update_time': 1774608269.24591}
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK89074') HTTP/1.1" 204 0
2026-03-27 10:44:29 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-27 10:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC48687> (referer: https://www.auto1.com/v1/car-details-view/EC48687/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 587d2463-16dd-5ce4-9511-ad98f4accfc3 with identifier: EC48687
2026-03-27 10:44:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 587d2463-16dd-5ce4-9511-ad98f4accfc3 with scrape type 1
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 587d2463-16dd-5ce4-9511-ad98f4accfc3
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_956306838f59c3608961bbf69373863e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_956306838f59c3608961bbf69373863e.jpg not downloaded yet
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_62102e090db79f206101036a3924e1af.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_62102e090db79f206101036a3924e1af.jpg not downloaded yet
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_58dc41ff398a258d4efb9a457e61b26d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_58dc41ff398a258d4efb9a457e61b26d.jpg not downloaded yet
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_504da5549f312a29832a7cb4e8cf1abc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_504da5549f312a29832a7cb4e8cf1abc.jpg not downloaded yet
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_02691297c56b422ccdd8aa2305801732.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_02691297c56b422ccdd8aa2305801732.jpg not downloaded yet
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_3f185a591d56d9e33d64984b37e1cfb5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_3f185a591d56d9e33d64984b37e1cfb5.jpg not downloaded yet
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_02b94fbe0d3a39740aef8b82462e94e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_02b94fbe0d3a39740aef8b82462e94e1.jpg not downloaded yet
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_70d70b7ab990efcb61d1c37d85858ef6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_70d70b7ab990efcb61d1c37d85858ef6.jpg not downloaded yet
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_5ea2185a7b20719f34cac2b66e146844.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_5ea2185a7b20719f34cac2b66e146844.jpg not downloaded yet
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_c8c15df10b694d943fc06283aee8309d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_c8c15df10b694d943fc06283aee8309d.jpg not downloaded yet
2026-03-27 10:44:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB18835> (referer: https://www.auto1.com/v1/car-details-view/NB18835/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 301d0d97-cfe5-54fa-bad8-2e8164c9b338 with identifier: NB18835
2026-03-27 10:44:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 301d0d97-cfe5-54fa-bad8-2e8164c9b338 with scrape type 1
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 301d0d97-cfe5-54fa-bad8-2e8164c9b338
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_a5d7532e5a7c66cd297af19780c8dd06.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_a5d7532e5a7c66cd297af19780c8dd06.jpg not downloaded yet
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_3a66630ea5500f897445aad3c76f1fa7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_3a66630ea5500f897445aad3c76f1fa7.jpg not downloaded yet
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_3274e5b35014251c0522155226f93cb1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_3274e5b35014251c0522155226f93cb1.jpg not downloaded yet
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_951abf9fa5b45c25e0caa7ff7ac82e7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_951abf9fa5b45c25e0caa7ff7ac82e7a.jpg not downloaded yet
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_dae5911348e038a94f8660e81b2d2ba7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_dae5911348e038a94f8660e81b2d2ba7.jpg not downloaded yet
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_87d55d8b5b6a5f4dc56013f024271f93.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_87d55d8b5b6a5f4dc56013f024271f93.jpg not downloaded yet
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_7ab993c482ad109ecd6e83fc24574802.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_7ab993c482ad109ecd6e83fc24574802.jpg not downloaded yet
2026-03-27 10:44:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_c8c15df10b694d943fc06283aee8309d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_6790d0ae7862b38c07d40ed89d1614bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_6790d0ae7862b38c07d40ed89d1614bb.jpg not downloaded yet
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_0df719ad1295669800817150decb7850.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_0df719ad1295669800817150decb7850.jpg not downloaded yet
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_de31871a4afff0ef747af1819bf783eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_de31871a4afff0ef747af1819bf783eb.jpg not downloaded yet
2026-03-27 10:44:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be24b7d0>
2026-03-27 10:44:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_c8c15df10b694d943fc06283aee8309d.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_c8c15df10b694d943fc06283aee8309d.jpg saved to cache
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 587d2463-16dd-5ce4-9511-ad98f4accfc3
2026-03-27 10:44:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_7ab993c482ad109ecd6e83fc24574802.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_de31871a4afff0ef747af1819bf783eb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1c7a90>
2026-03-27 10:44:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_7ab993c482ad109ecd6e83fc24574802.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_7ab993c482ad109ecd6e83fc24574802.jpg saved to cache
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 301d0d97-cfe5-54fa-bad8-2e8164c9b338
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2928d0>
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_de31871a4afff0ef747af1819bf783eb.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_de31871a4afff0ef747af1819bf783eb.jpg saved to cache
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 301d0d97-cfe5-54fa-bad8-2e8164c9b338
2026-03-27 10:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_0df719ad1295669800817150decb7850.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1bbc10>
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_0df719ad1295669800817150decb7850.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_0df719ad1295669800817150decb7850.jpg saved to cache
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 301d0d97-cfe5-54fa-bad8-2e8164c9b338
2026-03-27 10:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_6790d0ae7862b38c07d40ed89d1614bb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b0150>
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_6790d0ae7862b38c07d40ed89d1614bb.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_6790d0ae7862b38c07d40ed89d1614bb.jpg saved to cache
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 301d0d97-cfe5-54fa-bad8-2e8164c9b338
2026-03-27 10:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_87d55d8b5b6a5f4dc56013f024271f93.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_dae5911348e038a94f8660e81b2d2ba7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be03b050>
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_87d55d8b5b6a5f4dc56013f024271f93.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_87d55d8b5b6a5f4dc56013f024271f93.jpg saved to cache
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 301d0d97-cfe5-54fa-bad8-2e8164c9b338
2026-03-27 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_951abf9fa5b45c25e0caa7ff7ac82e7a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB40017/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b3850>
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_dae5911348e038a94f8660e81b2d2ba7.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_dae5911348e038a94f8660e81b2d2ba7.jpg saved to cache
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 301d0d97-cfe5-54fa-bad8-2e8164c9b338
2026-03-27 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_3274e5b35014251c0522155226f93cb1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf31fd0>
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_951abf9fa5b45c25e0caa7ff7ac82e7a.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_951abf9fa5b45c25e0caa7ff7ac82e7a.jpg saved to cache
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 301d0d97-cfe5-54fa-bad8-2e8164c9b338
2026-03-27 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_a5d7532e5a7c66cd297af19780c8dd06.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be260610>
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_3274e5b35014251c0522155226f93cb1.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_3274e5b35014251c0522155226f93cb1.jpg saved to cache
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 301d0d97-cfe5-54fa-bad8-2e8164c9b338
2026-03-27 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_5ea2185a7b20719f34cac2b66e146844.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1c4750>
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_a5d7532e5a7c66cd297af19780c8dd06.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_a5d7532e5a7c66cd297af19780c8dd06.jpg saved to cache
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 301d0d97-cfe5-54fa-bad8-2e8164c9b338
2026-03-27 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_3a66630ea5500f897445aad3c76f1fa7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_70d70b7ab990efcb61d1c37d85858ef6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1ba510>
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_5ea2185a7b20719f34cac2b66e146844.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_5ea2185a7b20719f34cac2b66e146844.jpg saved to cache
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 587d2463-16dd-5ce4-9511-ad98f4accfc3
2026-03-27 10:44:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf377d0>
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe6%252F71e65ebd95f2992bf90da48d1836c735%252Fpa%252FNB18835_3a66630ea5500f897445aad3c76f1fa7.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_3a66630ea5500f897445aad3c76f1fa7.jpg saved to cache
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 301d0d97-cfe5-54fa-bad8-2e8164c9b338
2026-03-27 10:44:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 301d0d97-cfe5-54fa-bad8-2e8164c9b338, skipping ID generation
2026-03-27 10:44:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 301d0d97-cfe5-54fa-bad8-2e8164c9b338 with scrape type 1
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 301d0d97-cfe5-54fa-bad8-2e8164c9b338 sending to next pipeline
2026-03-27 10:44:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 301d0d97-cfe5-54fa-bad8-2e8164c9b338, identifier: NB18835
2026-03-27 10:44:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 301d0d97-cfe5-54fa-bad8-2e8164c9b338 with identifier: NB18835
2026-03-27 10:44:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 301d0d97-cfe5-54fa-bad8-2e8164c9b338 with identifier: NB18835
2026-03-27 10:44:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 301d0d97-cfe5-54fa-bad8-2e8164c9b338 with identifier: NB18835 to the API
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_3a66630ea5500f897445aad3c76f1fa7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-03-28T16:08:28Z',
'fuel_type': 'diesel',
'id': '301d0d97-cfe5-54fa-bad8-2e8164c9b338',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB18835',
'listing': 'auction',
'location': 'DE, Mannheim',
'make': 'BMW',
'model': '1er',
'odometer': 168751,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90698,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_a5d7532e5a7c66cd297af19780c8dd06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3057710,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_3a66630ea5500f897445aad3c76f1fa7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87057,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_3274e5b35014251c0522155226f93cb1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74414,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_951abf9fa5b45c25e0caa7ff7ac82e7a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_dae5911348e038a94f8660e81b2d2ba7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2957034,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_87d55d8b5b6a5f4dc56013f024271f93.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2655174,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_7ab993c482ad109ecd6e83fc24574802.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3043223,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_6790d0ae7862b38c07d40ed89d1614bb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3040293,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_0df719ad1295669800817150decb7850.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301d0d97-cfe5-54fa-bad8-2e8164c9b338/301d0d97-cfe5-54fa-bad8-2e8164c9b338_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80337,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/e6/71e65ebd95f2992bf90da48d1836c735/pa/NB18835_de31871a4afff0ef747af1819bf783eb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-12-08',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB18835%27 HTTP/1.1" 200 None
2026-03-27 10:44:33 [auto1.de] INFO: Saving data for NB18835: {'created_time': 1774608273.974255, 'last_price_update_time': 1774608273.974272, 'auction_closing_time': 1774714108.0}
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB18835') HTTP/1.1" 204 0
2026-03-27 10:44:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_02b94fbe0d3a39740aef8b82462e94e1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf35090>
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_70d70b7ab990efcb61d1c37d85858ef6.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_70d70b7ab990efcb61d1c37d85858ef6.jpg saved to cache
2026-03-27 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 587d2463-16dd-5ce4-9511-ad98f4accfc3
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf339d0>
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_02b94fbe0d3a39740aef8b82462e94e1.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_02b94fbe0d3a39740aef8b82462e94e1.jpg saved to cache
2026-03-27 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 587d2463-16dd-5ce4-9511-ad98f4accfc3
2026-03-27 10:44:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_3f185a591d56d9e33d64984b37e1cfb5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2923d0>
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_3f185a591d56d9e33d64984b37e1cfb5.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_3f185a591d56d9e33d64984b37e1cfb5.jpg saved to cache
2026-03-27 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 587d2463-16dd-5ce4-9511-ad98f4accfc3
2026-03-27 10:44:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_02691297c56b422ccdd8aa2305801732.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2f89d0>
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_02691297c56b422ccdd8aa2305801732.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_02691297c56b422ccdd8aa2305801732.jpg saved to cache
2026-03-27 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 587d2463-16dd-5ce4-9511-ad98f4accfc3
2026-03-27 10:44:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_504da5549f312a29832a7cb4e8cf1abc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be291590>
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_504da5549f312a29832a7cb4e8cf1abc.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_504da5549f312a29832a7cb4e8cf1abc.jpg saved to cache
2026-03-27 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 587d2463-16dd-5ce4-9511-ad98f4accfc3
2026-03-27 10:44:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_58dc41ff398a258d4efb9a457e61b26d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be225150>
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_58dc41ff398a258d4efb9a457e61b26d.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_58dc41ff398a258d4efb9a457e61b26d.jpg saved to cache
2026-03-27 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 587d2463-16dd-5ce4-9511-ad98f4accfc3
2026-03-27 10:44:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_62102e090db79f206101036a3924e1af.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1761d0>
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_62102e090db79f206101036a3924e1af.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_62102e090db79f206101036a3924e1af.jpg saved to cache
2026-03-27 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 587d2463-16dd-5ce4-9511-ad98f4accfc3
2026-03-27 10:44:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_956306838f59c3608961bbf69373863e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 10:44:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00\xd8\x00\x00\x00\x01'
2026-03-27 10:44:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00\xd8\x00\x00\x00\x01'
2026-03-27 10:44:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 10:44:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf32810>
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F38%252F273873b2b900d66396887c307b7a6e76%252Fpa%252FEC48687_956306838f59c3608961bbf69373863e.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_956306838f59c3608961bbf69373863e.jpg saved to cache
2026-03-27 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 587d2463-16dd-5ce4-9511-ad98f4accfc3
2026-03-27 10:44:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 587d2463-16dd-5ce4-9511-ad98f4accfc3, skipping ID generation
2026-03-27 10:44:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 587d2463-16dd-5ce4-9511-ad98f4accfc3 with scrape type 1
2026-03-27 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 587d2463-16dd-5ce4-9511-ad98f4accfc3 sending to next pipeline
2026-03-27 10:44:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 587d2463-16dd-5ce4-9511-ad98f4accfc3, identifier: EC48687
2026-03-27 10:44:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 587d2463-16dd-5ce4-9511-ad98f4accfc3 with identifier: EC48687
2026-03-27 10:44:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 587d2463-16dd-5ce4-9511-ad98f4accfc3 with identifier: EC48687
2026-03-27 10:44:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 587d2463-16dd-5ce4-9511-ad98f4accfc3 with identifier: EC48687 to the API
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_956306838f59c3608961bbf69373863e.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:40:43Z',
'fuel_type': 'diesel',
'id': '587d2463-16dd-5ce4-9511-ad98f4accfc3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC48687',
'listing': 'auction',
'location': 'DE',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 180092,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1334872,
'Height': 878,
'OriginUrl': 'https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_956306838f59c3608961bbf69373863e.jpg',
'Width': 1170},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_62102e090db79f206101036a3924e1af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107465,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_58dc41ff398a258d4efb9a457e61b26d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119533,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_504da5549f312a29832a7cb4e8cf1abc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_02691297c56b422ccdd8aa2305801732.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_3f185a591d56d9e33d64984b37e1cfb5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116401,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_02b94fbe0d3a39740aef8b82462e94e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_70d70b7ab990efcb61d1c37d85858ef6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84499,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_5ea2185a7b20719f34cac2b66e146844.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587d2463-16dd-5ce4-9511-ad98f4accfc3/587d2463-16dd-5ce4-9511-ad98f4accfc3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/38/273873b2b900d66396887c307b7a6e76/pa/EC48687_c8c15df10b694d943fc06283aee8309d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-11',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Zafira Tourer 2.0 CDTI Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2017}
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC48687%27 HTTP/1.1" 200 None
2026-03-27 10:44:37 [auto1.de] INFO: Saving data for EC48687: {'created_time': 1774608277.146232, 'last_price_update_time': 1774608277.146245, 'auction_closing_time': 1774716043.0}
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC48687') HTTP/1.1" 204 0
2026-03-27 10:44:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM03411> (referer: https://www.auto1.com/v1/car-details-view/RM03411/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f71a3a4-afe0-50b4-9484-c3763ef3d681 with identifier: RM03411
2026-03-27 10:44:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f71a3a4-afe0-50b4-9484-c3763ef3d681 with scrape type 1
2026-03-27 10:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f71a3a4-afe0-50b4-9484-c3763ef3d681
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_a732d08d4e4f0acd3e4ff24f43b2ee2d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_a732d08d4e4f0acd3e4ff24f43b2ee2d.jpg not downloaded yet
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_60b2b0ceaa3c57b67e8c6170104fa654.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_60b2b0ceaa3c57b67e8c6170104fa654.jpg not downloaded yet
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_728e728944dbd53e21b4d94a0ffd1a4f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_728e728944dbd53e21b4d94a0ffd1a4f.jpg not downloaded yet
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_7fd827b5169082deeb6d10ffe3f99bb7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_7fd827b5169082deeb6d10ffe3f99bb7.jpg not downloaded yet
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_509abbf0410f88395039b54ab196a0b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_509abbf0410f88395039b54ab196a0b2.jpg not downloaded yet
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_32041bfed471d5b1c8fd16860d3799af.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_32041bfed471d5b1c8fd16860d3799af.jpg not downloaded yet
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_3778e826149af27d485a92caf8bbaf02.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_3778e826149af27d485a92caf8bbaf02.jpg not downloaded yet
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_bf1cc2a2e72d0e847ff55e0da11f3246.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_bf1cc2a2e72d0e847ff55e0da11f3246.jpg not downloaded yet
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_03059a5840502b94f3572ef64c679566.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_03059a5840502b94f3572ef64c679566.jpg not downloaded yet
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_69bdfebc10dafe0ba87a46ac4cf8a7d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_69bdfebc10dafe0ba87a46ac4cf8a7d4.jpg not downloaded yet
2026-03-27 10:44:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ91996> (referer: https://www.auto1.com/v1/car-details-view/BJ91996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZS04919> (referer: https://www.auto1.com/v1/car-details-view/ZS04919/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_69bdfebc10dafe0ba87a46ac4cf8a7d4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:38 [crawlers.middlewares.id_gen_middleware] INFO: Duplicate ID generated for item: b34e2845-5567-540c-9e19-1356d8ef5629 with identifier: BJ91996, dropping item
2026-03-27 10:44:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_03059a5840502b94f3572ef64c679566.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2a5b396-8d7a-5214-9a29-2b008151704c with identifier: ZS04919
2026-03-27 10:44:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2a5b396-8d7a-5214-9a29-2b008151704c with scrape type 1
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2a5b396-8d7a-5214-9a29-2b008151704c
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_57a37facaa32487fb22f8ab84f80bdbe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_57a37facaa32487fb22f8ab84f80bdbe.jpg not downloaded yet
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_c2ccd0540e964b095f64c5833f79351e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_c2ccd0540e964b095f64c5833f79351e.jpg not downloaded yet
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_fd599edbc96965fdfc844d84c6d0ef4b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_fd599edbc96965fdfc844d84c6d0ef4b.jpg not downloaded yet
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be290d10>
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_69bdfebc10dafe0ba87a46ac4cf8a7d4.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_69bdfebc10dafe0ba87a46ac4cf8a7d4.jpg saved to cache
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f71a3a4-afe0-50b4-9484-c3763ef3d681
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_2a4c936cd4f50ba0e690bcebbcdaad6f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_2a4c936cd4f50ba0e690bcebbcdaad6f.jpg not downloaded yet
2026-03-27 10:44:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_bf1cc2a2e72d0e847ff55e0da11f3246.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_56c428e481ce03d6e82496a63a691cda.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_56c428e481ce03d6e82496a63a691cda.jpg not downloaded yet
2026-03-27 10:44:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_3778e826149af27d485a92caf8bbaf02.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_53fcc50674661f8800ad1cd2ddaa66e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_53fcc50674661f8800ad1cd2ddaa66e2.jpg not downloaded yet
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf39eb10>
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_03059a5840502b94f3572ef64c679566.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_03059a5840502b94f3572ef64c679566.jpg saved to cache
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f71a3a4-afe0-50b4-9484-c3763ef3d681
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_45898b5f80167eb25df02c7fb038a84c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_45898b5f80167eb25df02c7fb038a84c.jpg not downloaded yet
2026-03-27 10:44:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_fd599edbc96965fdfc844d84c6d0ef4b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_0bb05d2ea3941612a70a4862fb1d7012.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_0bb05d2ea3941612a70a4862fb1d7012.jpg not downloaded yet
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_c98d137006fcad61c053f0f80260c942.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_c98d137006fcad61c053f0f80260c942.jpg not downloaded yet
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_5eccae3b591baacc8914d6ff272fa5eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_5eccae3b591baacc8914d6ff272fa5eb.jpg not downloaded yet
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf47add0>
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_bf1cc2a2e72d0e847ff55e0da11f3246.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_bf1cc2a2e72d0e847ff55e0da11f3246.jpg saved to cache
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f71a3a4-afe0-50b4-9484-c3763ef3d681
2026-03-27 10:44:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_56c428e481ce03d6e82496a63a691cda.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be023b50>
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_3778e826149af27d485a92caf8bbaf02.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_3778e826149af27d485a92caf8bbaf02.jpg saved to cache
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f71a3a4-afe0-50b4-9484-c3763ef3d681
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1b8f10>
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_fd599edbc96965fdfc844d84c6d0ef4b.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_fd599edbc96965fdfc844d84c6d0ef4b.jpg saved to cache
2026-03-27 10:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2a5b396-8d7a-5214-9a29-2b008151704c
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be098790>
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_56c428e481ce03d6e82496a63a691cda.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_56c428e481ce03d6e82496a63a691cda.jpg saved to cache
2026-03-27 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2a5b396-8d7a-5214-9a29-2b008151704c
2026-03-27 10:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_53fcc50674661f8800ad1cd2ddaa66e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_5eccae3b591baacc8914d6ff272fa5eb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf81ed0>
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_53fcc50674661f8800ad1cd2ddaa66e2.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_53fcc50674661f8800ad1cd2ddaa66e2.jpg saved to cache
2026-03-27 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2a5b396-8d7a-5214-9a29-2b008151704c
2026-03-27 10:44:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be292090>
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_5eccae3b591baacc8914d6ff272fa5eb.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_5eccae3b591baacc8914d6ff272fa5eb.jpg saved to cache
2026-03-27 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2a5b396-8d7a-5214-9a29-2b008151704c
2026-03-27 10:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_c98d137006fcad61c053f0f80260c942.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_45898b5f80167eb25df02c7fb038a84c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf81790>
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_c98d137006fcad61c053f0f80260c942.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_c98d137006fcad61c053f0f80260c942.jpg saved to cache
2026-03-27 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2a5b396-8d7a-5214-9a29-2b008151704c
2026-03-27 10:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_2a4c936cd4f50ba0e690bcebbcdaad6f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be25c5d0>
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_45898b5f80167eb25df02c7fb038a84c.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_45898b5f80167eb25df02c7fb038a84c.jpg saved to cache
2026-03-27 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2a5b396-8d7a-5214-9a29-2b008151704c
2026-03-27 10:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_0bb05d2ea3941612a70a4862fb1d7012.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_c2ccd0540e964b095f64c5833f79351e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be09a510>
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_2a4c936cd4f50ba0e690bcebbcdaad6f.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_2a4c936cd4f50ba0e690bcebbcdaad6f.jpg saved to cache
2026-03-27 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2a5b396-8d7a-5214-9a29-2b008151704c
2026-03-27 10:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_57a37facaa32487fb22f8ab84f80bdbe.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_32041bfed471d5b1c8fd16860d3799af.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3053d0>
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_0bb05d2ea3941612a70a4862fb1d7012.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_0bb05d2ea3941612a70a4862fb1d7012.jpg saved to cache
2026-03-27 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2a5b396-8d7a-5214-9a29-2b008151704c
2026-03-27 10:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_7fd827b5169082deeb6d10ffe3f99bb7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_509abbf0410f88395039b54ab196a0b2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4555d0>
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_c2ccd0540e964b095f64c5833f79351e.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_c2ccd0540e964b095f64c5833f79351e.jpg saved to cache
2026-03-27 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2a5b396-8d7a-5214-9a29-2b008151704c
2026-03-27 10:44:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be196d90>
2026-03-27 10:44:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F69%252F2c699e4506dc05445ba36294220a8c67%252Fpa%252FZS04919_57a37facaa32487fb22f8ab84f80bdbe.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_57a37facaa32487fb22f8ab84f80bdbe.jpg saved to cache
2026-03-27 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2a5b396-8d7a-5214-9a29-2b008151704c
2026-03-27 10:44:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2a5b396-8d7a-5214-9a29-2b008151704c, skipping ID generation
2026-03-27 10:44:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2a5b396-8d7a-5214-9a29-2b008151704c with scrape type 1
2026-03-27 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2a5b396-8d7a-5214-9a29-2b008151704c sending to next pipeline
2026-03-27 10:44:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2a5b396-8d7a-5214-9a29-2b008151704c, identifier: ZS04919
2026-03-27 10:44:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf358690>
2026-03-27 10:44:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_32041bfed471d5b1c8fd16860d3799af.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_32041bfed471d5b1c8fd16860d3799af.jpg saved to cache
2026-03-27 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f71a3a4-afe0-50b4-9484-c3763ef3d681
2026-03-27 10:44:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2a5b396-8d7a-5214-9a29-2b008151704c with identifier: ZS04919
2026-03-27 10:44:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2a5b396-8d7a-5214-9a29-2b008151704c with identifier: ZS04919
2026-03-27 10:44:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2a5b396-8d7a-5214-9a29-2b008151704c with identifier: ZS04919 to the API
2026-03-27 10:44:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_57a37facaa32487fb22f8ab84f80bdbe.jpg>
{'auction_title': '',
'c_o_2_emission_value': 75,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 101,
'expiration_date': '2026-03-28T16:06:38Z',
'fuel_type': 'hybrid',
'id': 'e2a5b396-8d7a-5214-9a29-2b008151704c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS04919',
'listing': 'auction',
'location': 'DE, Laatzen',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 135599,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67818,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_57a37facaa32487fb22f8ab84f80bdbe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_c2ccd0540e964b095f64c5833f79351e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67183,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_fd599edbc96965fdfc844d84c6d0ef4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_2a4c936cd4f50ba0e690bcebbcdaad6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_56c428e481ce03d6e82496a63a691cda.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2724088,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_53fcc50674661f8800ad1cd2ddaa66e2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56548,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_45898b5f80167eb25df02c7fb038a84c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2741736,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_0bb05d2ea3941612a70a4862fb1d7012.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2655777,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_c98d137006fcad61c053f0f80260c942.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a5b396-8d7a-5214-9a29-2b008151704c/e2a5b396-8d7a-5214-9a29-2b008151704c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3170136,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2c/69/2c699e4506dc05445ba36294220a8c67/pa/ZS04919_5eccae3b591baacc8914d6ff272fa5eb.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-06-03',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.5 Hybrid Comfort',
'transmission': 'automatic',
'trim': 'Comfort',
'year': 2015}
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS04919%27 HTTP/1.1" 200 None
2026-03-27 10:44:41 [auto1.de] INFO: Saving data for ZS04919: {'created_time': 1774608281.583698, 'last_price_update_time': 1774608281.583711, 'auction_closing_time': 1774713998.0}
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS04919') HTTP/1.1" 204 0
2026-03-27 10:44:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_728e728944dbd53e21b4d94a0ffd1a4f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_60b2b0ceaa3c57b67e8c6170104fa654.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM08668> (referer: https://www.auto1.com/v1/car-details-view/SM08668/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be107f50>
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_7fd827b5169082deeb6d10ffe3f99bb7.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_7fd827b5169082deeb6d10ffe3f99bb7.jpg saved to cache
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f71a3a4-afe0-50b4-9484-c3763ef3d681
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf497390>
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_509abbf0410f88395039b54ab196a0b2.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_509abbf0410f88395039b54ab196a0b2.jpg saved to cache
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f71a3a4-afe0-50b4-9484-c3763ef3d681
2026-03-27 10:44:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5be8d0>
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_728e728944dbd53e21b4d94a0ffd1a4f.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_728e728944dbd53e21b4d94a0ffd1a4f.jpg saved to cache
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f71a3a4-afe0-50b4-9484-c3763ef3d681
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5c6f150>
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_60b2b0ceaa3c57b67e8c6170104fa654.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_60b2b0ceaa3c57b67e8c6170104fa654.jpg saved to cache
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f71a3a4-afe0-50b4-9484-c3763ef3d681
2026-03-27 10:44:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d87c6f58-a769-523f-aec0-bcf43d0b5d86 with identifier: SM08668
2026-03-27 10:44:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d87c6f58-a769-523f-aec0-bcf43d0b5d86 with scrape type 1
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d87c6f58-a769-523f-aec0-bcf43d0b5d86
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_df9feca094254bfe862a603df5c02c38.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_df9feca094254bfe862a603df5c02c38.jpg not downloaded yet
2026-03-27 10:44:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_a732d08d4e4f0acd3e4ff24f43b2ee2d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_89618b11ffc446070070b28f79e6865e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_89618b11ffc446070070b28f79e6865e.jpg not downloaded yet
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_e6e2ff8d08230ac233127412f669a9ee.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_e6e2ff8d08230ac233127412f669a9ee.jpg not downloaded yet
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_16703010cbaade0b8c9c695b9944910c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_16703010cbaade0b8c9c695b9944910c.jpg not downloaded yet
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_91a43a6f9a4fd82902ab8e40a460f351.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_91a43a6f9a4fd82902ab8e40a460f351.jpg not downloaded yet
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_0201bc59b3dd30d4818a4bd6c3add15d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_0201bc59b3dd30d4818a4bd6c3add15d.jpg not downloaded yet
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_2ac079e4896968e2e073766a976cca51.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_2ac079e4896968e2e073766a976cca51.jpg not downloaded yet
2026-03-27 10:44:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_df9feca094254bfe862a603df5c02c38.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_454ffb82dfc8ba62969356c49dbb7d14.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_454ffb82dfc8ba62969356c49dbb7d14.jpg not downloaded yet
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_de33d4e6298d0ebaa8ddb2ca6d29e9c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_de33d4e6298d0ebaa8ddb2ca6d29e9c5.jpg not downloaded yet
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_68748c80e3c80a0144ec7500ec8d4b8d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_68748c80e3c80a0144ec7500ec8d4b8d.jpg not downloaded yet
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be24a310>
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F8b%252F618b62289c4dea80918e1ed83e7891de%252Fpa%252FRM03411_a732d08d4e4f0acd3e4ff24f43b2ee2d.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_a732d08d4e4f0acd3e4ff24f43b2ee2d.jpg saved to cache
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f71a3a4-afe0-50b4-9484-c3763ef3d681
2026-03-27 10:44:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f71a3a4-afe0-50b4-9484-c3763ef3d681, skipping ID generation
2026-03-27 10:44:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f71a3a4-afe0-50b4-9484-c3763ef3d681 with scrape type 1
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f71a3a4-afe0-50b4-9484-c3763ef3d681 sending to next pipeline
2026-03-27 10:44:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f71a3a4-afe0-50b4-9484-c3763ef3d681, identifier: RM03411
2026-03-27 10:44:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f71a3a4-afe0-50b4-9484-c3763ef3d681 with identifier: RM03411
2026-03-27 10:44:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f71a3a4-afe0-50b4-9484-c3763ef3d681 with identifier: RM03411
2026-03-27 10:44:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f71a3a4-afe0-50b4-9484-c3763ef3d681 with identifier: RM03411 to the API
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_a732d08d4e4f0acd3e4ff24f43b2ee2d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:42:39Z',
'fuel_type': 'diesel',
'id': '0f71a3a4-afe0-50b4-9484-c3763ef3d681',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM03411',
'listing': 'auction',
'location': 'DE, Schkopau (OT Rassnitz)',
'make': 'Audi',
'model': 'A4',
'odometer': 157444,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79062,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_a732d08d4e4f0acd3e4ff24f43b2ee2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_60b2b0ceaa3c57b67e8c6170104fa654.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_728e728944dbd53e21b4d94a0ffd1a4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_7fd827b5169082deeb6d10ffe3f99bb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77260,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_509abbf0410f88395039b54ab196a0b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_32041bfed471d5b1c8fd16860d3799af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63966,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_3778e826149af27d485a92caf8bbaf02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64378,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_bf1cc2a2e72d0e847ff55e0da11f3246.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_03059a5840502b94f3572ef64c679566.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f71a3a4-afe0-50b4-9484-c3763ef3d681/0f71a3a4-afe0-50b4-9484-c3763ef3d681_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/8b/618b62289c4dea80918e1ed83e7891de/pa/RM03411_69bdfebc10dafe0ba87a46ac4cf8a7d4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-10-17',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 2.0 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2017}
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM03411%27 HTTP/1.1" 200 None
2026-03-27 10:44:42 [auto1.de] INFO: Saving data for RM03411: {'created_time': 1774608282.501107, 'last_price_update_time': 1774608282.50112, 'auction_closing_time': 1774716159.0}
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM03411') HTTP/1.1" 204 0
2026-03-27 10:44:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_2ac079e4896968e2e073766a976cca51.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0ce690>
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_df9feca094254bfe862a603df5c02c38.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_df9feca094254bfe862a603df5c02c38.jpg saved to cache
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d87c6f58-a769-523f-aec0-bcf43d0b5d86
2026-03-27 10:44:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_68748c80e3c80a0144ec7500ec8d4b8d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be224910>
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_2ac079e4896968e2e073766a976cca51.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_2ac079e4896968e2e073766a976cca51.jpg saved to cache
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d87c6f58-a769-523f-aec0-bcf43d0b5d86
2026-03-27 10:44:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_de33d4e6298d0ebaa8ddb2ca6d29e9c5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GD61504> (referer: https://www.auto1.com/v1/car-details-view/GD61504/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf389790>
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_68748c80e3c80a0144ec7500ec8d4b8d.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_68748c80e3c80a0144ec7500ec8d4b8d.jpg saved to cache
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d87c6f58-a769-523f-aec0-bcf43d0b5d86
2026-03-27 10:44:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_454ffb82dfc8ba62969356c49dbb7d14.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be225f50>
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_de33d4e6298d0ebaa8ddb2ca6d29e9c5.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_de33d4e6298d0ebaa8ddb2ca6d29e9c5.jpg saved to cache
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d87c6f58-a769-523f-aec0-bcf43d0b5d86
2026-03-27 10:44:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 with identifier: GD61504
2026-03-27 10:44:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 with scrape type 1
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fb6%252F4cb646709b9d80e0884eb23ddf2d7c96%252Fpa%252FGD61504_bd7d1d1199f8be10a5c6577d5672a99a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_bd7d1d1199f8be10a5c6577d5672a99a.jpg not downloaded yet
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fb6%252F4cb646709b9d80e0884eb23ddf2d7c96%252Fpa%252FGD61504_817cdf62b6c6e52bdba202ed5132a300.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_817cdf62b6c6e52bdba202ed5132a300.jpg not downloaded yet
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fb6%252F4cb646709b9d80e0884eb23ddf2d7c96%252Fpa%252FGD61504_b27bb0bf9a75601aad4276c1d2c00573.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_b27bb0bf9a75601aad4276c1d2c00573.jpg not downloaded yet
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5b2150>
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_454ffb82dfc8ba62969356c49dbb7d14.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_454ffb82dfc8ba62969356c49dbb7d14.jpg saved to cache
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d87c6f58-a769-523f-aec0-bcf43d0b5d86
2026-03-27 10:44:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_0201bc59b3dd30d4818a4bd6c3add15d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fb6%252F4cb646709b9d80e0884eb23ddf2d7c96%252Fpa%252FGD61504_63117effe6acf49127db6853a03bf3a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_63117effe6acf49127db6853a03bf3a0.jpg not downloaded yet
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fb6%252F4cb646709b9d80e0884eb23ddf2d7c96%252Fpa%252FGD61504_f6777f45139b8ce06516d0c0514aed8a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_f6777f45139b8ce06516d0c0514aed8a.jpg not downloaded yet
2026-03-27 10:44:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_91a43a6f9a4fd82902ab8e40a460f351.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5b32d0>
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_0201bc59b3dd30d4818a4bd6c3add15d.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_0201bc59b3dd30d4818a4bd6c3add15d.jpg saved to cache
2026-03-27 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d87c6f58-a769-523f-aec0-bcf43d0b5d86
2026-03-27 10:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_f6777f45139b8ce06516d0c0514aed8a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_b27bb0bf9a75601aad4276c1d2c00573.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3839d0>
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_91a43a6f9a4fd82902ab8e40a460f351.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_91a43a6f9a4fd82902ab8e40a460f351.jpg saved to cache
2026-03-27 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d87c6f58-a769-523f-aec0-bcf43d0b5d86
2026-03-27 10:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_63117effe6acf49127db6853a03bf3a0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf382a10>
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58/6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fb6%252F4cb646709b9d80e0884eb23ddf2d7c96%252Fpa%252FGD61504_f6777f45139b8ce06516d0c0514aed8a.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_f6777f45139b8ce06516d0c0514aed8a.jpg saved to cache
2026-03-27 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58
2026-03-27 10:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_bd7d1d1199f8be10a5c6577d5672a99a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf359950>
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58/6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fb6%252F4cb646709b9d80e0884eb23ddf2d7c96%252Fpa%252FGD61504_b27bb0bf9a75601aad4276c1d2c00573.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_b27bb0bf9a75601aad4276c1d2c00573.jpg saved to cache
2026-03-27 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58
2026-03-27 10:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_817cdf62b6c6e52bdba202ed5132a300.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf31d10>
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58/6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fb6%252F4cb646709b9d80e0884eb23ddf2d7c96%252Fpa%252FGD61504_63117effe6acf49127db6853a03bf3a0.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_63117effe6acf49127db6853a03bf3a0.jpg saved to cache
2026-03-27 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be28bc10>
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58/6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fb6%252F4cb646709b9d80e0884eb23ddf2d7c96%252Fpa%252FGD61504_bd7d1d1199f8be10a5c6577d5672a99a.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_bd7d1d1199f8be10a5c6577d5672a99a.jpg saved to cache
2026-03-27 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58
2026-03-27 10:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_16703010cbaade0b8c9c695b9944910c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5e1290>
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58/6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fb6%252F4cb646709b9d80e0884eb23ddf2d7c96%252Fpa%252FGD61504_817cdf62b6c6e52bdba202ed5132a300.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_817cdf62b6c6e52bdba202ed5132a300.jpg saved to cache
2026-03-27 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58
2026-03-27 10:44:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58, skipping ID generation
2026-03-27 10:44:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 with scrape type 1
2026-03-27 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 sending to next pipeline
2026-03-27 10:44:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58, identifier: GD61504
2026-03-27 10:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_e6e2ff8d08230ac233127412f669a9ee.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 with identifier: GD61504
2026-03-27 10:44:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 with identifier: GD61504
2026-03-27 10:44:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58 with identifier: GD61504 to the API
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_817cdf62b6c6e52bdba202ed5132a300.jpg>
{'auction_title': '',
'c_o_2_emission_value': 205,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 3',
'engine': '1.9L',
'engine_horse_power': 82,
'expiration_date': '2026-03-28T16:34:30Z',
'fuel_type': 'diesel',
'id': '6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD61504',
'listing': 'auction',
'location': 'DE, Berlin',
'make': 'Renault',
'model': 'Trafic',
'odometer': 202964,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58/6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_bd7d1d1199f8be10a5c6577d5672a99a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58/6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_817cdf62b6c6e52bdba202ed5132a300.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58/6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90741,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_b27bb0bf9a75601aad4276c1d2c00573.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58/6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_63117effe6acf49127db6853a03bf3a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58/6ce0a3ee-90bc-5dcc-a3a2-d4b6ec91ec58_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125954,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/b6/4cb646709b9d80e0884eb23ddf2d7c96/pa/GD61504_f6777f45139b8ce06516d0c0514aed8a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-05-29',
'seats_number': 6,
'seller_name': None,
'title': 'Renault Trafic 1.9 Diesel L1H1 2,7t verglast',
'transmission': 'manual',
'trim': 'L1H1 2,7t verglast',
'year': 2006}
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61504%27 HTTP/1.1" 200 None
2026-03-27 10:44:44 [auto1.de] INFO: Saving data for GD61504: {'created_time': 1774608284.094619, 'last_price_update_time': 1774608284.094634, 'auction_closing_time': 1774715670.0}
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD61504') HTTP/1.1" 204 0
2026-03-27 10:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_89618b11ffc446070070b28f79e6865e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be09b790>
2026-03-27 10:44:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_16703010cbaade0b8c9c695b9944910c.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_16703010cbaade0b8c9c695b9944910c.jpg saved to cache
2026-03-27 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d87c6f58-a769-523f-aec0-bcf43d0b5d86
2026-03-27 10:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG62730/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0f8750>
2026-03-27 10:44:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_e6e2ff8d08230ac233127412f669a9ee.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_e6e2ff8d08230ac233127412f669a9ee.jpg saved to cache
2026-03-27 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d87c6f58-a769-523f-aec0-bcf43d0b5d86
2026-03-27 10:44:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0cdc10>
2026-03-27 10:44:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F8f%252F1e8f48d724e0b8bb51a745b420225aba%252Fpa%252FSM08668_89618b11ffc446070070b28f79e6865e.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_89618b11ffc446070070b28f79e6865e.jpg saved to cache
2026-03-27 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d87c6f58-a769-523f-aec0-bcf43d0b5d86
2026-03-27 10:44:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d87c6f58-a769-523f-aec0-bcf43d0b5d86, skipping ID generation
2026-03-27 10:44:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d87c6f58-a769-523f-aec0-bcf43d0b5d86 with scrape type 1
2026-03-27 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d87c6f58-a769-523f-aec0-bcf43d0b5d86 sending to next pipeline
2026-03-27 10:44:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d87c6f58-a769-523f-aec0-bcf43d0b5d86, identifier: SM08668
2026-03-27 10:44:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d87c6f58-a769-523f-aec0-bcf43d0b5d86 with identifier: SM08668
2026-03-27 10:44:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d87c6f58-a769-523f-aec0-bcf43d0b5d86 with identifier: SM08668
2026-03-27 10:44:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d87c6f58-a769-523f-aec0-bcf43d0b5d86 with identifier: SM08668 to the API
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_89618b11ffc446070070b28f79e6865e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:43:27Z',
'fuel_type': 'diesel',
'id': 'd87c6f58-a769-523f-aec0-bcf43d0b5d86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM08668',
'listing': 'auction',
'location': 'Gera',
'make': 'Volkswagen',
'model': 'Jetta',
'odometer': 271191,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68713,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_df9feca094254bfe862a603df5c02c38.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_89618b11ffc446070070b28f79e6865e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_e6e2ff8d08230ac233127412f669a9ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59805,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_16703010cbaade0b8c9c695b9944910c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64651,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_91a43a6f9a4fd82902ab8e40a460f351.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_0201bc59b3dd30d4818a4bd6c3add15d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57429,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_2ac079e4896968e2e073766a976cca51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72135,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_454ffb82dfc8ba62969356c49dbb7d14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65854,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_de33d4e6298d0ebaa8ddb2ca6d29e9c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d87c6f58-a769-523f-aec0-bcf43d0b5d86/d87c6f58-a769-523f-aec0-bcf43d0b5d86_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78091,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/8f/1e8f48d724e0b8bb51a745b420225aba/pa/SM08668_68748c80e3c80a0144ec7500ec8d4b8d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Jetta 2.0 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2011}
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM08668%27 HTTP/1.1" 200 None
2026-03-27 10:44:44 [auto1.de] INFO: Saving data for SM08668: {'created_time': 1774608284.772688, 'last_price_update_time': 1774608284.7727, 'auction_closing_time': 1774716207.0}
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM08668') HTTP/1.1" 204 0
2026-03-27 10:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY58726/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WZ51755/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC90437> (referer: https://www.auto1.com/v1/car-details-view/CC90437/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2ef1a69-26e0-5da2-8f15-15a8e19856da with identifier: CC90437
2026-03-27 10:44:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2ef1a69-26e0-5da2-8f15-15a8e19856da with scrape type 1
2026-03-27 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d2ef1a69-26e0-5da2-8f15-15a8e19856da
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3a%252Fc33ad9b8e76f5ceb1d1dba3225d58bfb%252Fpa%252FCC90437_9a7245da94d8c80f60299a588a736541.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_9a7245da94d8c80f60299a588a736541.jpg not downloaded yet
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3a%252Fc33ad9b8e76f5ceb1d1dba3225d58bfb%252Fpa%252FCC90437_30357589b485fb833d709bc9a36ffb84.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_30357589b485fb833d709bc9a36ffb84.jpg not downloaded yet
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3a%252Fc33ad9b8e76f5ceb1d1dba3225d58bfb%252Fpa%252FCC90437_07959ce3a86b35874c89e1edf98a5aca.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_07959ce3a86b35874c89e1edf98a5aca.jpg not downloaded yet
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3a%252Fc33ad9b8e76f5ceb1d1dba3225d58bfb%252Fpa%252FCC90437_1e14e22541f36b82a66bbcb05006b472.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_1e14e22541f36b82a66bbcb05006b472.jpg not downloaded yet
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3a%252Fc33ad9b8e76f5ceb1d1dba3225d58bfb%252Fpa%252FCC90437_bf891470c7778e74127b968014a3893c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_bf891470c7778e74127b968014a3893c.jpg not downloaded yet
2026-03-27 10:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT05682> (referer: https://www.auto1.com/v1/car-details-view/RT05682/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbc6dbdf-847a-5680-8619-92b0c7391726 with identifier: RT05682
2026-03-27 10:44:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbc6dbdf-847a-5680-8619-92b0c7391726 with scrape type 1
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fbc6dbdf-847a-5680-8619-92b0c7391726
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_bd5bdc79883c61d00c1535be8ce4775c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_bd5bdc79883c61d00c1535be8ce4775c.jpg not downloaded yet
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_714720f9d50548e36f035fe39f577750.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_714720f9d50548e36f035fe39f577750.jpg not downloaded yet
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_6245934d2017db61638765704bc0ad2c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_6245934d2017db61638765704bc0ad2c.jpg not downloaded yet
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_57f99f1dfd536f5e5f873678f2ad9b30.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_57f99f1dfd536f5e5f873678f2ad9b30.jpg not downloaded yet
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_ef741713853959e7979f5d110aa67f52.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_ef741713853959e7979f5d110aa67f52.jpg not downloaded yet
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_b058b84be2b04d45463ab9b7f6dc3893.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_b058b84be2b04d45463ab9b7f6dc3893.jpg not downloaded yet
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_e4aa2094d7f2df1c6ad4f13252606a15.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_e4aa2094d7f2df1c6ad4f13252606a15.jpg not downloaded yet
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_8c9fb4cc818105b909fc0f25d4e44c14.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_8c9fb4cc818105b909fc0f25d4e44c14.jpg not downloaded yet
2026-03-27 10:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_bf891470c7778e74127b968014a3893c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_26a3e8a6a5ed37a90fabd9b0b82c9fea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_26a3e8a6a5ed37a90fabd9b0b82c9fea.jpg not downloaded yet
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_df944fe87646c9b2c7c3951b8bd4a919.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_df944fe87646c9b2c7c3951b8bd4a919.jpg not downloaded yet
2026-03-27 10:44:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3f5e90>
2026-03-27 10:44:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2ef1a69-26e0-5da2-8f15-15a8e19856da/d2ef1a69-26e0-5da2-8f15-15a8e19856da_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3a%252Fc33ad9b8e76f5ceb1d1dba3225d58bfb%252Fpa%252FCC90437_bf891470c7778e74127b968014a3893c.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_bf891470c7778e74127b968014a3893c.jpg saved to cache
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2ef1a69-26e0-5da2-8f15-15a8e19856da
2026-03-27 10:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_8c9fb4cc818105b909fc0f25d4e44c14.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf38aa50>
2026-03-27 10:44:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_8c9fb4cc818105b909fc0f25d4e44c14.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_8c9fb4cc818105b909fc0f25d4e44c14.jpg saved to cache
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fbc6dbdf-847a-5680-8619-92b0c7391726
2026-03-27 10:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_df944fe87646c9b2c7c3951b8bd4a919.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB40017> (referer: https://www.auto1.com/v1/car-details-view/YB40017/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP68218/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf359990>
2026-03-27 10:44:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_df944fe87646c9b2c7c3951b8bd4a919.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_df944fe87646c9b2c7c3951b8bd4a919.jpg saved to cache
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fbc6dbdf-847a-5680-8619-92b0c7391726
2026-03-27 10:44:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62335a8b-68e1-5bb9-af11-29207488c39c with identifier: YB40017
2026-03-27 10:44:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62335a8b-68e1-5bb9-af11-29207488c39c with scrape type 1
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 62335a8b-68e1-5bb9-af11-29207488c39c
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff3%252F78f376318741174a9d95cb1da6ed7c2a%252Fpa%252FYB40017_05d127590668e098aa903df2a6607fb2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_05d127590668e098aa903df2a6607fb2.jpg already downloaded
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff3%252F78f376318741174a9d95cb1da6ed7c2a%252Fpa%252FYB40017_e9f1e012d6c2f053816fabf38d9773e4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_e9f1e012d6c2f053816fabf38d9773e4.jpg already downloaded
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff3%252F78f376318741174a9d95cb1da6ed7c2a%252Fpa%252FYB40017_a6ee184ae0d690221c4ef90e1d6c123a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_a6ee184ae0d690221c4ef90e1d6c123a.jpg already downloaded
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff3%252F78f376318741174a9d95cb1da6ed7c2a%252Fpa%252FYB40017_9523c4f3697dabdbf3d650b44a50154e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_9523c4f3697dabdbf3d650b44a50154e.jpg already downloaded
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff3%252F78f376318741174a9d95cb1da6ed7c2a%252Fpa%252FYB40017_086a67ea924666158a890015fa0cd5e9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_086a67ea924666158a890015fa0cd5e9.jpg already downloaded
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff3%252F78f376318741174a9d95cb1da6ed7c2a%252Fpa%252FYB40017_92f87a339a59d2193e3992d2f16e9132.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_92f87a339a59d2193e3992d2f16e9132.jpg already downloaded
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff3%252F78f376318741174a9d95cb1da6ed7c2a%252Fpa%252FYB40017_cfe0a8fd25545fc6d6c8156c53a48459.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_cfe0a8fd25545fc6d6c8156c53a48459.jpg already downloaded
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff3%252F78f376318741174a9d95cb1da6ed7c2a%252Fpa%252FYB40017_1be7ede6f4a0021e40e3de3233fa0c80.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_1be7ede6f4a0021e40e3de3233fa0c80.jpg already downloaded
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff3%252F78f376318741174a9d95cb1da6ed7c2a%252Fpa%252FYB40017_d607e0e4be3b2da2ffb7ee1fadb245fb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_d607e0e4be3b2da2ffb7ee1fadb245fb.jpg already downloaded
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff3%252F78f376318741174a9d95cb1da6ed7c2a%252Fpa%252FYB40017_aa04a981416850837400685730311511.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_aa04a981416850837400685730311511.jpg already downloaded
2026-03-27 10:44:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62335a8b-68e1-5bb9-af11-29207488c39c, identifier: YB40017
2026-03-27 10:44:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62335a8b-68e1-5bb9-af11-29207488c39c with identifier: YB40017
2026-03-27 10:44:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62335a8b-68e1-5bb9-af11-29207488c39c with identifier: YB40017
2026-03-27 10:44:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62335a8b-68e1-5bb9-af11-29207488c39c with identifier: YB40017 to the API
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YB40017>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:10:35Z',
'fuel_type': 'petrol',
'id': '62335a8b-68e1-5bb9-af11-29207488c39c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB40017',
'listing': 'auction',
'location': 'DE, Schkopau (OT Rassnitz)',
'make': 'Ford',
'model': 'Focus',
'odometer': 124323,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_05d127590668e098aa903df2a6607fb2.jpg',
'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_e9f1e012d6c2f053816fabf38d9773e4.jpg',
'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_a6ee184ae0d690221c4ef90e1d6c123a.jpg',
'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_9523c4f3697dabdbf3d650b44a50154e.jpg',
'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_086a67ea924666158a890015fa0cd5e9.jpg',
'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_92f87a339a59d2193e3992d2f16e9132.jpg',
'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_cfe0a8fd25545fc6d6c8156c53a48459.jpg',
'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_1be7ede6f4a0021e40e3de3233fa0c80.jpg',
'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_d607e0e4be3b2da2ffb7ee1fadb245fb.jpg',
'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_aa04a981416850837400685730311511.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62335a8b-68e1-5bb9-af11-29207488c39c/62335a8b-68e1-5bb9-af11-29207488c39c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82726,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_05d127590668e098aa903df2a6607fb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62335a8b-68e1-5bb9-af11-29207488c39c/62335a8b-68e1-5bb9-af11-29207488c39c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_e9f1e012d6c2f053816fabf38d9773e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62335a8b-68e1-5bb9-af11-29207488c39c/62335a8b-68e1-5bb9-af11-29207488c39c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78063,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_a6ee184ae0d690221c4ef90e1d6c123a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62335a8b-68e1-5bb9-af11-29207488c39c/62335a8b-68e1-5bb9-af11-29207488c39c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72409,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_9523c4f3697dabdbf3d650b44a50154e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62335a8b-68e1-5bb9-af11-29207488c39c/62335a8b-68e1-5bb9-af11-29207488c39c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79176,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_086a67ea924666158a890015fa0cd5e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62335a8b-68e1-5bb9-af11-29207488c39c/62335a8b-68e1-5bb9-af11-29207488c39c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72226,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_92f87a339a59d2193e3992d2f16e9132.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62335a8b-68e1-5bb9-af11-29207488c39c/62335a8b-68e1-5bb9-af11-29207488c39c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_cfe0a8fd25545fc6d6c8156c53a48459.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62335a8b-68e1-5bb9-af11-29207488c39c/62335a8b-68e1-5bb9-af11-29207488c39c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88180,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_1be7ede6f4a0021e40e3de3233fa0c80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62335a8b-68e1-5bb9-af11-29207488c39c/62335a8b-68e1-5bb9-af11-29207488c39c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79277,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_d607e0e4be3b2da2ffb7ee1fadb245fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62335a8b-68e1-5bb9-af11-29207488c39c/62335a8b-68e1-5bb9-af11-29207488c39c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77547,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/f3/78f376318741174a9d95cb1da6ed7c2a/pa/YB40017_aa04a981416850837400685730311511.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-11-18',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2015}
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB40017%27 HTTP/1.1" 200 None
2026-03-27 10:44:47 [auto1.de] INFO: Saving data for YB40017: {'created_time': 1774608287.495337, 'last_price_update_time': 1774608287.495349, 'auction_closing_time': 1774714235.0}
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB40017') HTTP/1.1" 204 0
2026-03-27 10:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC27283> (referer: https://www.auto1.com/v1/car-details-view/VC27283/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_e4aa2094d7f2df1c6ad4f13252606a15.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_b058b84be2b04d45463ab9b7f6dc3893.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_26a3e8a6a5ed37a90fabd9b0b82c9fea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35 with identifier: VC27283
2026-03-27 10:44:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35 with scrape type 1
2026-03-27 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_22b7f7270418d77f9ac641de1b99e572.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_22b7f7270418d77f9ac641de1b99e572.jpg not downloaded yet
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_80b614fc5a22d73addd3f1c8dd66252c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_80b614fc5a22d73addd3f1c8dd66252c.jpg not downloaded yet
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_781e64d49dec3f359b5aa98b3678b412.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_781e64d49dec3f359b5aa98b3678b412.jpg not downloaded yet
2026-03-27 10:44:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be13b850>
2026-03-27 10:44:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_e4aa2094d7f2df1c6ad4f13252606a15.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_e4aa2094d7f2df1c6ad4f13252606a15.jpg saved to cache
2026-03-27 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fbc6dbdf-847a-5680-8619-92b0c7391726
2026-03-27 10:44:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be254f90>
2026-03-27 10:44:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_b058b84be2b04d45463ab9b7f6dc3893.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_b058b84be2b04d45463ab9b7f6dc3893.jpg saved to cache
2026-03-27 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fbc6dbdf-847a-5680-8619-92b0c7391726
2026-03-27 10:44:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1d6ed0>
2026-03-27 10:44:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_26a3e8a6a5ed37a90fabd9b0b82c9fea.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_26a3e8a6a5ed37a90fabd9b0b82c9fea.jpg saved to cache
2026-03-27 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fbc6dbdf-847a-5680-8619-92b0c7391726
2026-03-27 10:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_ef741713853959e7979f5d110aa67f52.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_7140f4e40826850bd3eade32239c8351.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_7140f4e40826850bd3eade32239c8351.jpg not downloaded yet
2026-03-27 10:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_57f99f1dfd536f5e5f873678f2ad9b30.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_5555db4115b6ec0ef8939b1b7ac1d248.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_5555db4115b6ec0ef8939b1b7ac1d248.jpg not downloaded yet
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_43b002d66696e9f95906ceb43b02e289.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_43b002d66696e9f95906ceb43b02e289.jpg not downloaded yet
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_f4786a4b917d9868e56cfac4e4a95fb8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_f4786a4b917d9868e56cfac4e4a95fb8.jpg not downloaded yet
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_7df769feb2203b53891cdcd60d89810d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_7df769feb2203b53891cdcd60d89810d.jpg not downloaded yet
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be095350>
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_ef741713853959e7979f5d110aa67f52.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_ef741713853959e7979f5d110aa67f52.jpg saved to cache
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fbc6dbdf-847a-5680-8619-92b0c7391726
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_1abba17eb9344894f7477156a5d54b1e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_1abba17eb9344894f7477156a5d54b1e.jpg not downloaded yet
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_98d6eb0fd07eb5306427e6698fec0f1d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_98d6eb0fd07eb5306427e6698fec0f1d.jpg not downloaded yet
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf304710>
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_57f99f1dfd536f5e5f873678f2ad9b30.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_57f99f1dfd536f5e5f873678f2ad9b30.jpg saved to cache
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fbc6dbdf-847a-5680-8619-92b0c7391726
2026-03-27 10:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_7140f4e40826850bd3eade32239c8351.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_80b614fc5a22d73addd3f1c8dd66252c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_781e64d49dec3f359b5aa98b3678b412.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf1ab90>
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_7140f4e40826850bd3eade32239c8351.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_7140f4e40826850bd3eade32239c8351.jpg saved to cache
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1c7150>
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_80b614fc5a22d73addd3f1c8dd66252c.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_80b614fc5a22d73addd3f1c8dd66252c.jpg saved to cache
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35
2026-03-27 10:44:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5bcd10>
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_781e64d49dec3f359b5aa98b3678b412.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_781e64d49dec3f359b5aa98b3678b412.jpg saved to cache
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35
2026-03-27 10:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GS36326/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_7df769feb2203b53891cdcd60d89810d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_1abba17eb9344894f7477156a5d54b1e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_98d6eb0fd07eb5306427e6698fec0f1d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3867d0>
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_7df769feb2203b53891cdcd60d89810d.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_7df769feb2203b53891cdcd60d89810d.jpg saved to cache
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35
2026-03-27 10:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CD13649/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf359a90>
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_1abba17eb9344894f7477156a5d54b1e.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_1abba17eb9344894f7477156a5d54b1e.jpg saved to cache
2026-03-27 10:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35
2026-03-27 10:44:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be25f310>
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_98d6eb0fd07eb5306427e6698fec0f1d.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_98d6eb0fd07eb5306427e6698fec0f1d.jpg saved to cache
2026-03-27 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35
2026-03-27 10:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_f4786a4b917d9868e56cfac4e4a95fb8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_43b002d66696e9f95906ceb43b02e289.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_5555db4115b6ec0ef8939b1b7ac1d248.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_22b7f7270418d77f9ac641de1b99e572.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1f0850>
2026-03-27 10:44:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_f4786a4b917d9868e56cfac4e4a95fb8.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_f4786a4b917d9868e56cfac4e4a95fb8.jpg saved to cache
2026-03-27 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35
2026-03-27 10:44:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf44f990>
2026-03-27 10:44:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_43b002d66696e9f95906ceb43b02e289.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_43b002d66696e9f95906ceb43b02e289.jpg saved to cache
2026-03-27 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35
2026-03-27 10:44:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf572ed0>
2026-03-27 10:44:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_5555db4115b6ec0ef8939b1b7ac1d248.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_5555db4115b6ec0ef8939b1b7ac1d248.jpg saved to cache
2026-03-27 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35
2026-03-27 10:44:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c53b1510>
2026-03-27 10:44:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F3b%252Ffd3b61c610d74943de2ab5e8c9c80a0c%252Fpa%252FVC27283_22b7f7270418d77f9ac641de1b99e572.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_22b7f7270418d77f9ac641de1b99e572.jpg saved to cache
2026-03-27 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35
2026-03-27 10:44:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35, skipping ID generation
2026-03-27 10:44:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35 with scrape type 1
2026-03-27 10:44:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35 sending to next pipeline
2026-03-27 10:44:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35, identifier: VC27283
2026-03-27 10:44:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35 with identifier: VC27283
2026-03-27 10:44:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35 with identifier: VC27283
2026-03-27 10:44:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56c069a6-f7b9-51ee-9bdc-a390d4ed5b35 with identifier: VC27283 to the API
2026-03-27 10:44:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_22b7f7270418d77f9ac641de1b99e572.jpg>
{'auction_title': '',
'c_o_2_emission_value': 191,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 147,
'expiration_date': '2026-03-28T16:28:22Z',
'fuel_type': 'petrol',
'id': '56c069a6-f7b9-51ee-9bdc-a390d4ed5b35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC27283',
'listing': 'auction',
'location': 'DE, Reinbek',
'make': 'Mazda',
'model': '6',
'odometer': 61070,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72128,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_22b7f7270418d77f9ac641de1b99e572.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_80b614fc5a22d73addd3f1c8dd66252c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2821356,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_781e64d49dec3f359b5aa98b3678b412.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_7140f4e40826850bd3eade32239c8351.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_5555db4115b6ec0ef8939b1b7ac1d248.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_43b002d66696e9f95906ceb43b02e289.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_f4786a4b917d9868e56cfac4e4a95fb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2195647,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_7df769feb2203b53891cdcd60d89810d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2777953,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_1abba17eb9344894f7477156a5d54b1e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c069a6-f7b9-51ee-9bdc-a390d4ed5b35/56c069a6-f7b9-51ee-9bdc-a390d4ed5b35_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2973501,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/3b/fd3b61c610d74943de2ab5e8c9c80a0c/pa/VC27283_98d6eb0fd07eb5306427e6698fec0f1d.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-06-26',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda 6 2.0 Sport Active',
'transmission': 'manual',
'trim': 'Sport Active',
'year': 2007}
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC27283%27 HTTP/1.1" 200 None
2026-03-27 10:44:50 [auto1.de] INFO: Saving data for VC27283: {'created_time': 1774608290.12719, 'last_price_update_time': 1774608290.127202, 'auction_closing_time': 1774715302.0}
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC27283') HTTP/1.1" 204 0
2026-03-27 10:44:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG62730> (referer: https://www.auto1.com/v1/car-details-view/LG62730/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB88110/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS15071/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_714720f9d50548e36f035fe39f577750.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_bd5bdc79883c61d00c1535be8ce4775c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_6245934d2017db61638765704bc0ad2c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_9a7245da94d8c80f60299a588a736541.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with identifier: LG62730
2026-03-27 10:44:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with scrape type 1
2026-03-27 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_d4c418c96471e4f02446924d2452ede1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_d4c418c96471e4f02446924d2452ede1.jpg not downloaded yet
2026-03-27 10:44:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_1e14e22541f36b82a66bbcb05006b472.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_ad8516e5ab7ea4982260672f7f80e3ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_ad8516e5ab7ea4982260672f7f80e3ef.jpg not downloaded yet
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_354b8609d0672429990bf08fa6518722.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_354b8609d0672429990bf08fa6518722.jpg not downloaded yet
2026-03-27 10:44:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf51ed10>
2026-03-27 10:44:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_714720f9d50548e36f035fe39f577750.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_714720f9d50548e36f035fe39f577750.jpg saved to cache
2026-03-27 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fbc6dbdf-847a-5680-8619-92b0c7391726
2026-03-27 10:44:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3248d0>
2026-03-27 10:44:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_bd5bdc79883c61d00c1535be8ce4775c.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_bd5bdc79883c61d00c1535be8ce4775c.jpg saved to cache
2026-03-27 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fbc6dbdf-847a-5680-8619-92b0c7391726
2026-03-27 10:44:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5f8310>
2026-03-27 10:44:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fa4%252F23a46d69f07a7c41a65daca2c78b48e9%252Fpa%252FRT05682_6245934d2017db61638765704bc0ad2c.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_6245934d2017db61638765704bc0ad2c.jpg saved to cache
2026-03-27 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fbc6dbdf-847a-5680-8619-92b0c7391726
2026-03-27 10:44:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fbc6dbdf-847a-5680-8619-92b0c7391726, skipping ID generation
2026-03-27 10:44:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbc6dbdf-847a-5680-8619-92b0c7391726 with scrape type 1
2026-03-27 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fbc6dbdf-847a-5680-8619-92b0c7391726 sending to next pipeline
2026-03-27 10:44:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbc6dbdf-847a-5680-8619-92b0c7391726, identifier: RT05682
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_37ca088bd0b1076d6e38a2fa5610ac04.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_37ca088bd0b1076d6e38a2fa5610ac04.jpg not downloaded yet
2026-03-27 10:44:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbc6dbdf-847a-5680-8619-92b0c7391726 with identifier: RT05682
2026-03-27 10:44:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbc6dbdf-847a-5680-8619-92b0c7391726 with identifier: RT05682
2026-03-27 10:44:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbc6dbdf-847a-5680-8619-92b0c7391726 with identifier: RT05682 to the API
2026-03-27 10:44:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_6245934d2017db61638765704bc0ad2c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:19:00Z',
'fuel_type': 'diesel',
'id': 'fbc6dbdf-847a-5680-8619-92b0c7391726',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT05682',
'listing': 'auction',
'location': 'DE, Dortmund',
'make': 'Audi',
'model': 'A4',
'odometer': 265381,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2656678,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_bd5bdc79883c61d00c1535be8ce4775c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2659444,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_714720f9d50548e36f035fe39f577750.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2357350,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_6245934d2017db61638765704bc0ad2c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56965,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_57f99f1dfd536f5e5f873678f2ad9b30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55051,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_ef741713853959e7979f5d110aa67f52.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2057934,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_b058b84be2b04d45463ab9b7f6dc3893.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1840346,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_e4aa2094d7f2df1c6ad4f13252606a15.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2171990,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_8c9fb4cc818105b909fc0f25d4e44c14.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2539358,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_26a3e8a6a5ed37a90fabd9b0b82c9fea.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc6dbdf-847a-5680-8619-92b0c7391726/fbc6dbdf-847a-5680-8619-92b0c7391726_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/a4/23a46d69f07a7c41a65daca2c78b48e9/pa/RT05682_df944fe87646c9b2c7c3951b8bd4a919.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-09-17',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 2.0 TDI quattro Ambition',
'transmission': 'manual',
'trim': 'quattro Ambition',
'year': 2013}
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT05682%27 HTTP/1.1" 200 None
2026-03-27 10:44:51 [auto1.de] INFO: Saving data for RT05682: {'created_time': 1774608291.353218, 'last_price_update_time': 1774608291.353228, 'auction_closing_time': 1774714740.0}
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT05682') HTTP/1.1" 204 0
2026-03-27 10:44:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_07959ce3a86b35874c89e1edf98a5aca.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_30357589b485fb833d709bc9a36ffb84.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_30a8fcfb534774e34bfa39e4e2adc45a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_30a8fcfb534774e34bfa39e4e2adc45a.jpg not downloaded yet
2026-03-27 10:44:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB31061/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf5aad0>
2026-03-27 10:44:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2ef1a69-26e0-5da2-8f15-15a8e19856da/d2ef1a69-26e0-5da2-8f15-15a8e19856da_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3a%252Fc33ad9b8e76f5ceb1d1dba3225d58bfb%252Fpa%252FCC90437_9a7245da94d8c80f60299a588a736541.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_9a7245da94d8c80f60299a588a736541.jpg saved to cache
2026-03-27 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2ef1a69-26e0-5da2-8f15-15a8e19856da
2026-03-27 10:44:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0ac150>
2026-03-27 10:44:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2ef1a69-26e0-5da2-8f15-15a8e19856da/d2ef1a69-26e0-5da2-8f15-15a8e19856da_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3a%252Fc33ad9b8e76f5ceb1d1dba3225d58bfb%252Fpa%252FCC90437_1e14e22541f36b82a66bbcb05006b472.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_1e14e22541f36b82a66bbcb05006b472.jpg saved to cache
2026-03-27 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2ef1a69-26e0-5da2-8f15-15a8e19856da
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_d7bba09459c03170d7082a2ce92c1633.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_d7bba09459c03170d7082a2ce92c1633.jpg not downloaded yet
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_aaa6b3244c8c10f48568d3cc75b6e83c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_aaa6b3244c8c10f48568d3cc75b6e83c.jpg not downloaded yet
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_b5e200642590fb861f33182279915387.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_b5e200642590fb861f33182279915387.jpg not downloaded yet
2026-03-27 10:44:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1d2c90>
2026-03-27 10:44:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2ef1a69-26e0-5da2-8f15-15a8e19856da/d2ef1a69-26e0-5da2-8f15-15a8e19856da_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3a%252Fc33ad9b8e76f5ceb1d1dba3225d58bfb%252Fpa%252FCC90437_07959ce3a86b35874c89e1edf98a5aca.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_07959ce3a86b35874c89e1edf98a5aca.jpg saved to cache
2026-03-27 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2ef1a69-26e0-5da2-8f15-15a8e19856da
2026-03-27 10:44:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf36e750>
2026-03-27 10:44:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2ef1a69-26e0-5da2-8f15-15a8e19856da/d2ef1a69-26e0-5da2-8f15-15a8e19856da_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3a%252Fc33ad9b8e76f5ceb1d1dba3225d58bfb%252Fpa%252FCC90437_30357589b485fb833d709bc9a36ffb84.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_30357589b485fb833d709bc9a36ffb84.jpg saved to cache
2026-03-27 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2ef1a69-26e0-5da2-8f15-15a8e19856da
2026-03-27 10:44:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2ef1a69-26e0-5da2-8f15-15a8e19856da, skipping ID generation
2026-03-27 10:44:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2ef1a69-26e0-5da2-8f15-15a8e19856da with scrape type 1
2026-03-27 10:44:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2ef1a69-26e0-5da2-8f15-15a8e19856da sending to next pipeline
2026-03-27 10:44:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2ef1a69-26e0-5da2-8f15-15a8e19856da, identifier: CC90437
2026-03-27 10:44:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2ef1a69-26e0-5da2-8f15-15a8e19856da with identifier: CC90437
2026-03-27 10:44:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2ef1a69-26e0-5da2-8f15-15a8e19856da with identifier: CC90437
2026-03-27 10:44:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2ef1a69-26e0-5da2-8f15-15a8e19856da with identifier: CC90437 to the API
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_30357589b485fb833d709bc9a36ffb84.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:49:49Z',
'fuel_type': 'petrol',
'id': 'd2ef1a69-26e0-5da2-8f15-15a8e19856da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC90437',
'listing': 'auction',
'location': 'DE, Sinzheim',
'make': 'Peugeot',
'model': '2008',
'odometer': 157404,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2ef1a69-26e0-5da2-8f15-15a8e19856da/d2ef1a69-26e0-5da2-8f15-15a8e19856da_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_9a7245da94d8c80f60299a588a736541.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2ef1a69-26e0-5da2-8f15-15a8e19856da/d2ef1a69-26e0-5da2-8f15-15a8e19856da_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_30357589b485fb833d709bc9a36ffb84.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2ef1a69-26e0-5da2-8f15-15a8e19856da/d2ef1a69-26e0-5da2-8f15-15a8e19856da_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_07959ce3a86b35874c89e1edf98a5aca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2ef1a69-26e0-5da2-8f15-15a8e19856da/d2ef1a69-26e0-5da2-8f15-15a8e19856da_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_1e14e22541f36b82a66bbcb05006b472.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2ef1a69-26e0-5da2-8f15-15a8e19856da/d2ef1a69-26e0-5da2-8f15-15a8e19856da_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/3a/c33ad9b8e76f5ceb1d1dba3225d58bfb/pa/CC90437_bf891470c7778e74127b968014a3893c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-07-12',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2017}
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC90437%27 HTTP/1.1" 200 None
2026-03-27 10:44:52 [auto1.de] INFO: Saving data for CC90437: {'created_time': 1774608292.10542, 'last_price_update_time': 1774608292.105433, 'auction_closing_time': 1774716589.0}
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC90437') HTTP/1.1" 204 0
2026-03-27 10:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_37ca088bd0b1076d6e38a2fa5610ac04.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_1f6b3228e338fb207d4bcc33896462d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_1f6b3228e338fb207d4bcc33896462d5.jpg not downloaded yet
2026-03-27 10:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_d4c418c96471e4f02446924d2452ede1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_354b8609d0672429990bf08fa6518722.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_ad8516e5ab7ea4982260672f7f80e3ef.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_8194ac84a9e334340cdcc75d7792a638.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_8194ac84a9e334340cdcc75d7792a638.jpg not downloaded yet
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5fa690>
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_37ca088bd0b1076d6e38a2fa5610ac04.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_37ca088bd0b1076d6e38a2fa5610ac04.jpg saved to cache
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5fa510>
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_d4c418c96471e4f02446924d2452ede1.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_d4c418c96471e4f02446924d2452ede1.jpg saved to cache
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5f9610>
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_354b8609d0672429990bf08fa6518722.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_354b8609d0672429990bf08fa6518722.jpg saved to cache
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1f45d0>
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_ad8516e5ab7ea4982260672f7f80e3ef.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_ad8516e5ab7ea4982260672f7f80e3ef.jpg saved to cache
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-03-27 10:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_aaa6b3244c8c10f48568d3cc75b6e83c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_1f6b3228e338fb207d4bcc33896462d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_d7bba09459c03170d7082a2ce92c1633.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_b5e200642590fb861f33182279915387.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1f5250>
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_aaa6b3244c8c10f48568d3cc75b6e83c.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_aaa6b3244c8c10f48568d3cc75b6e83c.jpg saved to cache
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3d4550>
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_1f6b3228e338fb207d4bcc33896462d5.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_1f6b3228e338fb207d4bcc33896462d5.jpg saved to cache
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf56b9d0>
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_d7bba09459c03170d7082a2ce92c1633.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_d7bba09459c03170d7082a2ce92c1633.jpg saved to cache
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf27dd0>
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_b5e200642590fb861f33182279915387.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_b5e200642590fb861f33182279915387.jpg saved to cache
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-03-27 10:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_30a8fcfb534774e34bfa39e4e2adc45a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_8194ac84a9e334340cdcc75d7792a638.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_aeeb7664af5e70df4a6b3b399586aa5c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1f1410>
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_30a8fcfb534774e34bfa39e4e2adc45a.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_30a8fcfb534774e34bfa39e4e2adc45a.jpg saved to cache
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0a4750>
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F29%252F0b29b07a9fa5b3cfdd6aca052195b76c%252Fpa%252FLG62730_8194ac84a9e334340cdcc75d7792a638.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_8194ac84a9e334340cdcc75d7792a638.jpg saved to cache
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73
2026-03-27 10:44:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73, skipping ID generation
2026-03-27 10:44:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with scrape type 1
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 sending to next pipeline
2026-03-27 10:44:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73, identifier: LG62730
2026-03-27 10:44:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with identifier: LG62730
2026-03-27 10:44:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with identifier: LG62730
2026-03-27 10:44:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c51b62c-b60d-5b31-ab3f-a150e7de0a73 with identifier: LG62730 to the API
2026-03-27 10:44:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_8194ac84a9e334340cdcc75d7792a638.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:02:18Z',
'fuel_type': 'diesel',
'id': '7c51b62c-b60d-5b31-ab3f-a150e7de0a73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG62730',
'listing': 'auction',
'location': 'DE, Mülheim an der Ruhr',
'make': 'Mazda',
'model': 'CX-3',
'odometer': 146872,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_d4c418c96471e4f02446924d2452ede1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_ad8516e5ab7ea4982260672f7f80e3ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80922,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_354b8609d0672429990bf08fa6518722.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61826,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_37ca088bd0b1076d6e38a2fa5610ac04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89204,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_30a8fcfb534774e34bfa39e4e2adc45a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_d7bba09459c03170d7082a2ce92c1633.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64117,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_aaa6b3244c8c10f48568d3cc75b6e83c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_b5e200642590fb861f33182279915387.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_1f6b3228e338fb207d4bcc33896462d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c51b62c-b60d-5b31-ab3f-a150e7de0a73/7c51b62c-b60d-5b31-ab3f-a150e7de0a73_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89299,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/29/0b29b07a9fa5b3cfdd6aca052195b76c/pa/LG62730_8194ac84a9e334340cdcc75d7792a638.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-01-29',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda CX-3 1.5 Diesel Sports-Line AWD',
'transmission': 'manual',
'trim': 'Sports-Line AWD',
'year': 2018}
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG62730%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [auto1.de] INFO: Saving data for LG62730: {'created_time': 1774608294.151967, 'last_price_update_time': 1774608294.151981, 'auction_closing_time': 1774713738.0}
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG62730') HTTP/1.1" 204 0
2026-03-27 10:44:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_abe8e37a09209734931b74f38754aee1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY58726> (referer: https://www.auto1.com/v1/car-details-view/AY58726/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1f0410>
2026-03-27 10:44:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_aeeb7664af5e70df4a6b3b399586aa5c.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_aeeb7664af5e70df4a6b3b399586aa5c.jpg saved to cache
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1ae1811e-78e3-526d-8183-9a67084a9e5d
2026-03-27 10:44:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf24510>
2026-03-27 10:44:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_abe8e37a09209734931b74f38754aee1.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_abe8e37a09209734931b74f38754aee1.jpg saved to cache
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1ae1811e-78e3-526d-8183-9a67084a9e5d
2026-03-27 10:44:54 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 10540 | hits on page: 40
2026-03-27 10:44:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e56ec74c-edd3-5067-9052-15471b85c8a8 with identifier: AY58726
2026-03-27 10:44:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e56ec74c-edd3-5067-9052-15471b85c8a8 with scrape type 1
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e56ec74c-edd3-5067-9052-15471b85c8a8
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe1%252F03e10d1c4aaea43223fd6504067e1865%252Fpa%252FAY58726_7415cf2702925c0f1f3c2648573744cb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_7415cf2702925c0f1f3c2648573744cb.jpg already downloaded
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe1%252F03e10d1c4aaea43223fd6504067e1865%252Fpa%252FAY58726_8c6fee1a1596c7d39ae7fd67a700cdff.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_8c6fee1a1596c7d39ae7fd67a700cdff.jpg already downloaded
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe1%252F03e10d1c4aaea43223fd6504067e1865%252Fpa%252FAY58726_4d55d08a08621993237d48c1a0f9a031.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_4d55d08a08621993237d48c1a0f9a031.jpg already downloaded
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe1%252F03e10d1c4aaea43223fd6504067e1865%252Fpa%252FAY58726_09f5226ec9fa3aca53d86e630c5870e0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_09f5226ec9fa3aca53d86e630c5870e0.jpg already downloaded
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe1%252F03e10d1c4aaea43223fd6504067e1865%252Fpa%252FAY58726_eff1ab7bd1274169ea2f0db52ba8f571.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_eff1ab7bd1274169ea2f0db52ba8f571.jpg already downloaded
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe1%252F03e10d1c4aaea43223fd6504067e1865%252Fpa%252FAY58726_f715f6ad78ee43f77faaaeefbeb97a73.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_f715f6ad78ee43f77faaaeefbeb97a73.jpg already downloaded
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe1%252F03e10d1c4aaea43223fd6504067e1865%252Fpa%252FAY58726_dacb15e72f73ea58db41fd081de6ef0e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_dacb15e72f73ea58db41fd081de6ef0e.jpg already downloaded
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe1%252F03e10d1c4aaea43223fd6504067e1865%252Fpa%252FAY58726_94580cfff271d6460f7618bc17fb4fcd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_94580cfff271d6460f7618bc17fb4fcd.jpg already downloaded
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe1%252F03e10d1c4aaea43223fd6504067e1865%252Fpa%252FAY58726_7fc67b77ba38bff8d51de652e353c750.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_7fc67b77ba38bff8d51de652e353c750.jpg already downloaded
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe1%252F03e10d1c4aaea43223fd6504067e1865%252Fpa%252FAY58726_962d3f81bbfb914d779423a1b59f2cdd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_962d3f81bbfb914d779423a1b59f2cdd.jpg already downloaded
2026-03-27 10:44:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e56ec74c-edd3-5067-9052-15471b85c8a8, identifier: AY58726
2026-03-27 10:44:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e56ec74c-edd3-5067-9052-15471b85c8a8 with identifier: AY58726
2026-03-27 10:44:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e56ec74c-edd3-5067-9052-15471b85c8a8 with identifier: AY58726
2026-03-27 10:44:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e56ec74c-edd3-5067-9052-15471b85c8a8 with identifier: AY58726 to the API
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AY58726>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'engine_horse_power': 476,
'expiration_date': '2026-03-28T16:29:16Z',
'fuel_type': 'electro',
'id': 'e56ec74c-edd3-5067-9052-15471b85c8a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'license_plate': 'HRS69L',
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY58726',
'listing': 'auction',
'location': 'DE, Ketzin',
'make': 'Porsche',
'model': 'Taycan Cross Turismo',
'odometer': 41855,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 14,
'photo_urls': ['https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_7415cf2702925c0f1f3c2648573744cb.jpg',
'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_8c6fee1a1596c7d39ae7fd67a700cdff.jpg',
'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_4d55d08a08621993237d48c1a0f9a031.jpg',
'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_09f5226ec9fa3aca53d86e630c5870e0.jpg',
'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_eff1ab7bd1274169ea2f0db52ba8f571.jpg',
'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_f715f6ad78ee43f77faaaeefbeb97a73.jpg',
'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_dacb15e72f73ea58db41fd081de6ef0e.jpg',
'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_94580cfff271d6460f7618bc17fb4fcd.jpg',
'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_7fc67b77ba38bff8d51de652e353c750.jpg',
'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_962d3f81bbfb914d779423a1b59f2cdd.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56ec74c-edd3-5067-9052-15471b85c8a8/e56ec74c-edd3-5067-9052-15471b85c8a8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_7415cf2702925c0f1f3c2648573744cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56ec74c-edd3-5067-9052-15471b85c8a8/e56ec74c-edd3-5067-9052-15471b85c8a8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52888,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_8c6fee1a1596c7d39ae7fd67a700cdff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56ec74c-edd3-5067-9052-15471b85c8a8/e56ec74c-edd3-5067-9052-15471b85c8a8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_4d55d08a08621993237d48c1a0f9a031.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56ec74c-edd3-5067-9052-15471b85c8a8/e56ec74c-edd3-5067-9052-15471b85c8a8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_09f5226ec9fa3aca53d86e630c5870e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56ec74c-edd3-5067-9052-15471b85c8a8/e56ec74c-edd3-5067-9052-15471b85c8a8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_eff1ab7bd1274169ea2f0db52ba8f571.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56ec74c-edd3-5067-9052-15471b85c8a8/e56ec74c-edd3-5067-9052-15471b85c8a8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_f715f6ad78ee43f77faaaeefbeb97a73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56ec74c-edd3-5067-9052-15471b85c8a8/e56ec74c-edd3-5067-9052-15471b85c8a8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35673,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_dacb15e72f73ea58db41fd081de6ef0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56ec74c-edd3-5067-9052-15471b85c8a8/e56ec74c-edd3-5067-9052-15471b85c8a8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_94580cfff271d6460f7618bc17fb4fcd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56ec74c-edd3-5067-9052-15471b85c8a8/e56ec74c-edd3-5067-9052-15471b85c8a8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_7fc67b77ba38bff8d51de652e353c750.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56ec74c-edd3-5067-9052-15471b85c8a8/e56ec74c-edd3-5067-9052-15471b85c8a8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/e1/03e10d1c4aaea43223fd6504067e1865/pa/AY58726_962d3f81bbfb914d779423a1b59f2cdd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-08',
'seats_number': 5,
'seller_name': None,
'title': 'Porsche Taycan Cross Turismo 4',
'transmission': 'automatic',
'trim': '',
'vin': 'WP0ZZZY1ZNSA62738',
'year': 2021}
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY58726%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [auto1.de] INFO: Saving data for AY58726: {'created_time': 1774608294.972456, 'last_price_update_time': 1774608294.972467, 'auction_closing_time': 1774715356.0}
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY58726') HTTP/1.1" 204 0
2026-03-27 10:44:54 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-27 10:44:54 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-27 10:44:54 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ96114%27 HTTP/1.1" 200 None
2026-03-27 10:44:55 [auto1.de] INFO: Scrape type for RJ96114: 2
2026-03-27 10:44:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c783bb02-14be-539e-91af-d66b874db7ea with identifier: RJ96114
2026-03-27 10:44:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c783bb02-14be-539e-91af-d66b874db7ea with scrape type 2
2026-03-27 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c783bb02-14be-539e-91af-d66b874db7ea with scrape type 2
2026-03-27 10:44:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c783bb02-14be-539e-91af-d66b874db7ea, identifier: RJ96114
2026-03-27 10:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_ef540fa5e7139302eb2e0d2b6e97e05d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_3a8fa7889d27dff9e107adda45289f96.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c783bb02-14be-539e-91af-d66b874db7ea with identifier: RJ96114
2026-03-27 10:44:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c783bb02-14be-539e-91af-d66b874db7ea with identifier: RJ96114
2026-03-27 10:44:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c783bb02-14be-539e-91af-d66b874db7ea with identifier: RJ96114 to the API
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-28T16:39:27Z',
'fuel_type': 'diesel',
'id': 'c783bb02-14be-539e-91af-d66b874db7ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ96114',
'listing': 'auction',
'make': 'Kia',
'model': 'Optima',
'odometer': 97249,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-17',
'seller_name': None,
'title': 'Kia Optima 1.6 CRDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2019}
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ96114%27 HTTP/1.1" 200 None
2026-03-27 10:44:55 [auto1.de] INFO: Saving data for RJ96114: {'auction_closing_time': 1774715967.0, 'created_time': 1774348870.351697, 'last_price_update_time': 1774608295.436783}
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ96114') HTTP/1.1" 204 0
2026-03-27 10:44:55 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-27 10:44:55 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-27 10:44:55 [auto1.de] INFO: Found listing with ID: NP68778
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP68778%27 HTTP/1.1" 200 None
2026-03-27 10:44:55 [auto1.de] INFO: Scrape type for NP68778: 1
2026-03-27 10:44:55 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-27 10:44:55 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-27 10:44:55 [auto1.de] INFO: Found listing with ID: XS17240
2026-03-27 10:44:55 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46012%27 HTTP/1.1" 200 None
2026-03-27 10:44:55 [auto1.de] INFO: Scrape type for MV46012: 2
2026-03-27 10:44:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1427a2ab-7707-55ac-a7ab-d428e7d19a39 with identifier: MV46012
2026-03-27 10:44:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1427a2ab-7707-55ac-a7ab-d428e7d19a39 with scrape type 2
2026-03-27 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1427a2ab-7707-55ac-a7ab-d428e7d19a39 with scrape type 2
2026-03-27 10:44:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1427a2ab-7707-55ac-a7ab-d428e7d19a39, identifier: MV46012
2026-03-27 10:44:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1427a2ab-7707-55ac-a7ab-d428e7d19a39 with identifier: MV46012
2026-03-27 10:44:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1427a2ab-7707-55ac-a7ab-d428e7d19a39 with identifier: MV46012
2026-03-27 10:44:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1427a2ab-7707-55ac-a7ab-d428e7d19a39 with identifier: MV46012 to the API
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:26:01Z',
'fuel_type': 'petrol',
'id': '1427a2ab-7707-55ac-a7ab-d428e7d19a39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV46012',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 30528,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-07',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT United',
'transmission': 'manual',
'trim': 'United',
'year': 2020}
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46012%27 HTTP/1.1" 200 None
2026-03-27 10:44:55 [auto1.de] INFO: Saving data for MV46012: {'auction_closing_time': 1774715161.0, 'created_time': 1774002392.822044, 'last_price_update_time': 1774608295.931696}
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV46012') HTTP/1.1" 204 0
2026-03-27 10:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf31250>
2026-03-27 10:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_ef540fa5e7139302eb2e0d2b6e97e05d.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_ef540fa5e7139302eb2e0d2b6e97e05d.jpg saved to cache
2026-03-27 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ae1811e-78e3-526d-8183-9a67084a9e5d
2026-03-27 10:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4851d0>
2026-03-27 10:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_3a8fa7889d27dff9e107adda45289f96.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_3a8fa7889d27dff9e107adda45289f96.jpg saved to cache
2026-03-27 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ae1811e-78e3-526d-8183-9a67084a9e5d
2026-03-27 10:44:56 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL91815%27 HTTP/1.1" 200 None
2026-03-27 10:44:56 [auto1.de] INFO: Scrape type for JL91815: 1
2026-03-27 10:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_b7be210d05600d4a74d6cd09427222a5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:56 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-27 10:44:56 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC18756%27 HTTP/1.1" 200 None
2026-03-27 10:44:56 [auto1.de] INFO: Scrape type for PC18756: 2
2026-03-27 10:44:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80df274c-a93f-54c8-adef-645a79f63b7f with identifier: PC18756
2026-03-27 10:44:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80df274c-a93f-54c8-adef-645a79f63b7f with scrape type 2
2026-03-27 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80df274c-a93f-54c8-adef-645a79f63b7f with scrape type 2
2026-03-27 10:44:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80df274c-a93f-54c8-adef-645a79f63b7f, identifier: PC18756
2026-03-27 10:44:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80df274c-a93f-54c8-adef-645a79f63b7f with identifier: PC18756
2026-03-27 10:44:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80df274c-a93f-54c8-adef-645a79f63b7f with identifier: PC18756
2026-03-27 10:44:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80df274c-a93f-54c8-adef-645a79f63b7f with identifier: PC18756 to the API
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 159,
'expiration_date': '2026-03-28T16:30:33Z',
'fuel_type': 'petrol',
'id': '80df274c-a93f-54c8-adef-645a79f63b7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC18756',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 172830,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-22',
'seller_name': None,
'title': 'Nissan Qashqai 1.3 DIG-T N-Connecta',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2019}
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC18756%27 HTTP/1.1" 200 None
2026-03-27 10:44:56 [auto1.de] INFO: Saving data for PC18756: {'auction_closing_time': 1774715433.0, 'created_time': 1774349703.429225, 'last_price_update_time': 1774608296.66196}
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC18756') HTTP/1.1" 204 0
2026-03-27 10:44:56 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY57435%27 HTTP/1.1" 200 None
2026-03-27 10:44:56 [auto1.de] INFO: Scrape type for AY57435: 1
2026-03-27 10:44:56 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-27 10:44:56 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-27 10:44:56 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-27 10:44:56 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-27 10:44:56 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ38214%27 HTTP/1.1" 200 None
2026-03-27 10:44:56 [auto1.de] INFO: Scrape type for PJ38214: 2
2026-03-27 10:44:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 340ab20a-3fa7-56b0-9fac-6293aaedc5ad with identifier: PJ38214
2026-03-27 10:44:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340ab20a-3fa7-56b0-9fac-6293aaedc5ad with scrape type 2
2026-03-27 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 340ab20a-3fa7-56b0-9fac-6293aaedc5ad with scrape type 2
2026-03-27 10:44:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 340ab20a-3fa7-56b0-9fac-6293aaedc5ad, identifier: PJ38214
2026-03-27 10:44:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 340ab20a-3fa7-56b0-9fac-6293aaedc5ad with identifier: PJ38214
2026-03-27 10:44:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 340ab20a-3fa7-56b0-9fac-6293aaedc5ad with identifier: PJ38214
2026-03-27 10:44:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 340ab20a-3fa7-56b0-9fac-6293aaedc5ad with identifier: PJ38214 to the API
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-28T16:26:45Z',
'fuel_type': 'petrol',
'id': '340ab20a-3fa7-56b0-9fac-6293aaedc5ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ38214',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 38851,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-04',
'seller_name': None,
'title': 'BMW 1er M135i xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2023}
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ38214%27 HTTP/1.1" 200 None
2026-03-27 10:44:57 [auto1.de] INFO: Saving data for PJ38214: {'auction_closing_time': 1774715205.0, 'created_time': 1773917486.400141, 'last_price_update_time': 1774608297.188128}
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ38214') HTTP/1.1" 204 0
2026-03-27 10:44:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c561e350>
2026-03-27 10:44:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_b7be210d05600d4a74d6cd09427222a5.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_b7be210d05600d4a74d6cd09427222a5.jpg saved to cache
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ae1811e-78e3-526d-8183-9a67084a9e5d
2026-03-27 10:44:57 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-27 10:44:57 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA14554%27 HTTP/1.1" 200 None
2026-03-27 10:44:57 [auto1.de] INFO: Scrape type for TA14554: 2
2026-03-27 10:44:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca6367a3-acf5-5416-98e1-5bb9e61bada7 with identifier: TA14554
2026-03-27 10:44:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca6367a3-acf5-5416-98e1-5bb9e61bada7 with scrape type 2
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca6367a3-acf5-5416-98e1-5bb9e61bada7 with scrape type 2
2026-03-27 10:44:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca6367a3-acf5-5416-98e1-5bb9e61bada7, identifier: TA14554
2026-03-27 10:44:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca6367a3-acf5-5416-98e1-5bb9e61bada7 with identifier: TA14554
2026-03-27 10:44:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca6367a3-acf5-5416-98e1-5bb9e61bada7 with identifier: TA14554
2026-03-27 10:44:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca6367a3-acf5-5416-98e1-5bb9e61bada7 with identifier: TA14554 to the API
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:45:27Z',
'fuel_type': 'diesel',
'id': 'ca6367a3-acf5-5416-98e1-5bb9e61bada7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA14554',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 152714,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-25',
'seller_name': None,
'title': 'Nissan Qashqai 1.6 dCi Tekna',
'transmission': 'automatic',
'trim': 'Tekna',
'year': 2015}
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA14554%27 HTTP/1.1" 200 None
2026-03-27 10:44:57 [auto1.de] INFO: Saving data for TA14554: {'auction_closing_time': 1774716327.0, 'created_time': 1774034070.955445, 'last_price_update_time': 1774608297.735994}
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA14554') HTTP/1.1" 204 0
2026-03-27 10:44:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CD13649> (referer: https://www.auto1.com/v1/car-details-view/CD13649/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:57 [auto1.de] INFO: Found listing with ID: GN45872
2026-03-27 10:44:57 [auto1.de] INFO: Found listing with ID: NS35673
2026-03-27 10:44:57 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-27 10:44:57 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-27 10:44:57 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-27 10:44:57 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV14674%27 HTTP/1.1" 200 None
2026-03-27 10:44:57 [auto1.de] INFO: Scrape type for HV14674: 2
2026-03-27 10:44:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b6065a7-f2e8-517f-9ebf-b3a66b65262b with identifier: HV14674
2026-03-27 10:44:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b6065a7-f2e8-517f-9ebf-b3a66b65262b with scrape type 2
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b6065a7-f2e8-517f-9ebf-b3a66b65262b with scrape type 2
2026-03-27 10:44:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b6065a7-f2e8-517f-9ebf-b3a66b65262b, identifier: HV14674
2026-03-27 10:44:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b6065a7-f2e8-517f-9ebf-b3a66b65262b with identifier: HV14674
2026-03-27 10:44:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b6065a7-f2e8-517f-9ebf-b3a66b65262b with identifier: HV14674
2026-03-27 10:44:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b6065a7-f2e8-517f-9ebf-b3a66b65262b with identifier: HV14674 to the API
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:54:13Z',
'fuel_type': 'petrol',
'id': '5b6065a7-f2e8-517f-9ebf-b3a66b65262b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV14674',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 71275,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-17',
'seller_name': None,
'title': 'Ford Kuga 1.5 EcoBoost ST-Line X',
'transmission': 'manual',
'trim': 'ST-Line X',
'year': 2021}
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV14674%27 HTTP/1.1" 200 None
2026-03-27 10:44:58 [auto1.de] INFO: Saving data for HV14674: {'auction_closing_time': 1774716853.0, 'created_time': 1773344940.750079, 'last_price_update_time': 1774608298.327337}
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV14674') HTTP/1.1" 204 0
2026-03-27 10:44:58 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-27 10:44:58 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28576%27 HTTP/1.1" 200 None
2026-03-27 10:44:58 [auto1.de] INFO: Scrape type for ZD28576: 1
2026-03-27 10:44:58 [auto1.de] INFO: Found listing with ID: GD02806
2026-03-27 10:44:58 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27977%27 HTTP/1.1" 200 None
2026-03-27 10:44:58 [auto1.de] INFO: Scrape type for GB27977: 2
2026-03-27 10:44:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b8e4afb-8d96-5a04-a092-38428b049634 with identifier: GB27977
2026-03-27 10:44:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b8e4afb-8d96-5a04-a092-38428b049634 with scrape type 2
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b8e4afb-8d96-5a04-a092-38428b049634 with scrape type 2
2026-03-27 10:44:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b8e4afb-8d96-5a04-a092-38428b049634, identifier: GB27977
2026-03-27 10:44:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b8e4afb-8d96-5a04-a092-38428b049634 with identifier: GB27977
2026-03-27 10:44:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b8e4afb-8d96-5a04-a092-38428b049634 with identifier: GB27977
2026-03-27 10:44:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b8e4afb-8d96-5a04-a092-38428b049634 with identifier: GB27977 to the API
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:15:07Z',
'fuel_type': 'diesel',
'id': '6b8e4afb-8d96-5a04-a092-38428b049634',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB27977',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 81671,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-28',
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Allure L2',
'transmission': 'automatic',
'trim': 'Allure L2',
'year': 2018}
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27977%27 HTTP/1.1" 200 None
2026-03-27 10:44:58 [auto1.de] INFO: Saving data for GB27977: {'auction_closing_time': 1774714507.0, 'created_time': 1774032130.796188, 'last_price_update_time': 1774608298.842113}
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB27977') HTTP/1.1" 204 0
2026-03-27 10:44:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8878daf-9971-5dc8-a305-139ef2024c2d with identifier: CD13649
2026-03-27 10:44:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8878daf-9971-5dc8-a305-139ef2024c2d with scrape type 1
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8878daf-9971-5dc8-a305-139ef2024c2d
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_e93a72365058cb59f21af0b248b18076.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_e93a72365058cb59f21af0b248b18076.jpg not downloaded yet
2026-03-27 10:44:58 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH74073%27 HTTP/1.1" 200 None
2026-03-27 10:44:58 [auto1.de] INFO: Scrape type for GH74073: 1
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_22c7835a6bcb887eb786a5f4ced88713.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_22c7835a6bcb887eb786a5f4ced88713.jpg not downloaded yet
2026-03-27 10:44:58 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL27608%27 HTTP/1.1" 200 None
2026-03-27 10:44:58 [auto1.de] INFO: Scrape type for SL27608: 1
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_d4ec611e3ed344bea7cb5d9b726e12b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_d4ec611e3ed344bea7cb5d9b726e12b9.jpg not downloaded yet
2026-03-27 10:44:58 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-27 10:44:58 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-27 10:44:58 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-27 10:44:58 [auto1.de] INFO: Found listing with ID: UR56671
2026-03-27 10:44:58 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-27 10:44:58 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-27 10:44:58 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-27 10:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_ca93fc9eaf210cc7b926f53af4d00fb8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_ba31aac82ba6c8ed8ad2834895d0cd4a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_ba31aac82ba6c8ed8ad2834895d0cd4a.jpg not downloaded yet
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_f2826859d1d4d9962332dd6b3e12e454.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_f2826859d1d4d9962332dd6b3e12e454.jpg not downloaded yet
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_cc8e2fb5b525b6a2ec377f56b0d0a5f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_cc8e2fb5b525b6a2ec377f56b0d0a5f7.jpg not downloaded yet
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_01e2ff17918506d49e13681fb0895c59.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_82e5f950376d0266b43a37ad41dc0bef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_82e5f950376d0266b43a37ad41dc0bef.jpg not downloaded yet
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_311df0739e060e6d1024f47cea566576.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_311df0739e060e6d1024f47cea566576.jpg not downloaded yet
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_1009f809fa1d58844b29577be6d07b13.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_1009f809fa1d58844b29577be6d07b13.jpg not downloaded yet
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_49f210882ab651704e05f1c2ab8b2e93.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_49f210882ab651704e05f1c2ab8b2e93.jpg not downloaded yet
2026-03-27 10:44:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c4254190>
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_ca93fc9eaf210cc7b926f53af4d00fb8.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_ca93fc9eaf210cc7b926f53af4d00fb8.jpg saved to cache
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1ae1811e-78e3-526d-8183-9a67084a9e5d
2026-03-27 10:44:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0cda50>
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_01e2ff17918506d49e13681fb0895c59.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_01e2ff17918506d49e13681fb0895c59.jpg saved to cache
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ae1811e-78e3-526d-8183-9a67084a9e5d
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_91c17a6117a56c74b71274335fc60f46.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_d4ec611e3ed344bea7cb5d9b726e12b9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c57ec950>
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_91c17a6117a56c74b71274335fc60f46.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_91c17a6117a56c74b71274335fc60f46.jpg saved to cache
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ae1811e-78e3-526d-8183-9a67084a9e5d
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_1009f809fa1d58844b29577be6d07b13.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3d4a50>
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_d4ec611e3ed344bea7cb5d9b726e12b9.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_d4ec611e3ed344bea7cb5d9b726e12b9.jpg saved to cache
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8878daf-9971-5dc8-a305-139ef2024c2d
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_49f210882ab651704e05f1c2ab8b2e93.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be162210>
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_1009f809fa1d58844b29577be6d07b13.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_1009f809fa1d58844b29577be6d07b13.jpg saved to cache
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8878daf-9971-5dc8-a305-139ef2024c2d
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2c6ad0>
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_49f210882ab651704e05f1c2ab8b2e93.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_49f210882ab651704e05f1c2ab8b2e93.jpg saved to cache
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b8878daf-9971-5dc8-a305-139ef2024c2d
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_82e5f950376d0266b43a37ad41dc0bef.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_311df0739e060e6d1024f47cea566576.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS15071> (referer: https://www.auto1.com/v1/car-details-view/JS15071/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1b3050>
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_82e5f950376d0266b43a37ad41dc0bef.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_82e5f950376d0266b43a37ad41dc0bef.jpg saved to cache
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8878daf-9971-5dc8-a305-139ef2024c2d
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be039910>
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_311df0739e060e6d1024f47cea566576.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_311df0739e060e6d1024f47cea566576.jpg saved to cache
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8878daf-9971-5dc8-a305-139ef2024c2d
2026-03-27 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_cc8e2fb5b525b6a2ec377f56b0d0a5f7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b83dec2-b487-594e-97d3-b14e6d0ff478 with identifier: JS15071
2026-03-27 10:45:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b83dec2-b487-594e-97d3-b14e6d0ff478 with scrape type 1
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5b83dec2-b487-594e-97d3-b14e6d0ff478
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F94%252Fb6940352859c2a3c1b4aa6d7e132da68%252Fpa%252FJS15071_b12384f22ab97a4c936280d78816cfd0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/94/b6940352859c2a3c1b4aa6d7e132da68/pa/JS15071_b12384f22ab97a4c936280d78816cfd0.jpg already downloaded
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F94%252Fb6940352859c2a3c1b4aa6d7e132da68%252Fpa%252FJS15071_1341d2ef09f2e959bfe1cac0dba980d9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/94/b6940352859c2a3c1b4aa6d7e132da68/pa/JS15071_1341d2ef09f2e959bfe1cac0dba980d9.jpg already downloaded
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F94%252Fb6940352859c2a3c1b4aa6d7e132da68%252Fpa%252FJS15071_67e3b17d861e1864db8aff7a448460e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/94/b6940352859c2a3c1b4aa6d7e132da68/pa/JS15071_67e3b17d861e1864db8aff7a448460e6.jpg already downloaded
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F94%252Fb6940352859c2a3c1b4aa6d7e132da68%252Fpa%252FJS15071_d3e37eff249c298030c5b0541d53915b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/94/b6940352859c2a3c1b4aa6d7e132da68/pa/JS15071_d3e37eff249c298030c5b0541d53915b.jpg already downloaded
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F94%252Fb6940352859c2a3c1b4aa6d7e132da68%252Fpa%252FJS15071_910d048ca599c30225587f0eb41e7dcd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/94/b6940352859c2a3c1b4aa6d7e132da68/pa/JS15071_910d048ca599c30225587f0eb41e7dcd.jpg already downloaded
2026-03-27 10:45:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b83dec2-b487-594e-97d3-b14e6d0ff478, identifier: JS15071
2026-03-27 10:45:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b83dec2-b487-594e-97d3-b14e6d0ff478 with identifier: JS15071
2026-03-27 10:45:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b83dec2-b487-594e-97d3-b14e6d0ff478 with identifier: JS15071
2026-03-27 10:45:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b83dec2-b487-594e-97d3-b14e6d0ff478 with identifier: JS15071 to the API
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JS15071>
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:03:18Z',
'fuel_type': 'diesel',
'id': '5b83dec2-b487-594e-97d3-b14e6d0ff478',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS15071',
'listing': 'auction',
'location': 'DE, Germersheim',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 319345,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgb6/94/b6940352859c2a3c1b4aa6d7e132da68/pa/JS15071_b12384f22ab97a4c936280d78816cfd0.jpg',
'https://img-pa.auto1.com/imgb6/94/b6940352859c2a3c1b4aa6d7e132da68/pa/JS15071_1341d2ef09f2e959bfe1cac0dba980d9.jpg',
'https://img-pa.auto1.com/imgb6/94/b6940352859c2a3c1b4aa6d7e132da68/pa/JS15071_67e3b17d861e1864db8aff7a448460e6.jpg',
'https://img-pa.auto1.com/imgb6/94/b6940352859c2a3c1b4aa6d7e132da68/pa/JS15071_d3e37eff249c298030c5b0541d53915b.jpg',
'https://img-pa.auto1.com/imgb6/94/b6940352859c2a3c1b4aa6d7e132da68/pa/JS15071_910d048ca599c30225587f0eb41e7dcd.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b83dec2-b487-594e-97d3-b14e6d0ff478/5b83dec2-b487-594e-97d3-b14e6d0ff478_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96937,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/94/b6940352859c2a3c1b4aa6d7e132da68/pa/JS15071_b12384f22ab97a4c936280d78816cfd0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b83dec2-b487-594e-97d3-b14e6d0ff478/5b83dec2-b487-594e-97d3-b14e6d0ff478_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93163,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/94/b6940352859c2a3c1b4aa6d7e132da68/pa/JS15071_1341d2ef09f2e959bfe1cac0dba980d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b83dec2-b487-594e-97d3-b14e6d0ff478/5b83dec2-b487-594e-97d3-b14e6d0ff478_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/94/b6940352859c2a3c1b4aa6d7e132da68/pa/JS15071_67e3b17d861e1864db8aff7a448460e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b83dec2-b487-594e-97d3-b14e6d0ff478/5b83dec2-b487-594e-97d3-b14e6d0ff478_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85230,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/94/b6940352859c2a3c1b4aa6d7e132da68/pa/JS15071_d3e37eff249c298030c5b0541d53915b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b83dec2-b487-594e-97d3-b14e6d0ff478/5b83dec2-b487-594e-97d3-b14e6d0ff478_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101130,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/94/b6940352859c2a3c1b4aa6d7e132da68/pa/JS15071_910d048ca599c30225587f0eb41e7dcd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Laurin & Klement',
'transmission': 'manual',
'trim': 'Laurin & Klement',
'year': 2009}
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS15071%27 HTTP/1.1" 200 None
2026-03-27 10:45:00 [auto1.de] INFO: Saving data for JS15071: {'created_time': 1774608300.700682, 'last_price_update_time': 1774608300.700698, 'auction_closing_time': 1774713798.0}
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS15071') HTTP/1.1" 204 0
2026-03-27 10:45:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be16af90>
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_cc8e2fb5b525b6a2ec377f56b0d0a5f7.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_cc8e2fb5b525b6a2ec377f56b0d0a5f7.jpg saved to cache
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8878daf-9971-5dc8-a305-139ef2024c2d
2026-03-27 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB88110> (referer: https://www.auto1.com/v1/car-details-view/AB88110/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_ba31aac82ba6c8ed8ad2834895d0cd4a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_f2826859d1d4d9962332dd6b3e12e454.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_22c7835a6bcb887eb786a5f4ced88713.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_e93a72365058cb59f21af0b248b18076.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a with identifier: AB88110
2026-03-27 10:45:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a with scrape type 1
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_821fbcb1b62d6ff6b96bb7365a22e53b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_821fbcb1b62d6ff6b96bb7365a22e53b.jpg not downloaded yet
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_16989278b4d2f4b86b2a436a67214c4a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_16989278b4d2f4b86b2a436a67214c4a.jpg not downloaded yet
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_7ec8420daea5b4266e45609b86dab926.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_7ec8420daea5b4266e45609b86dab926.jpg not downloaded yet
2026-03-27 10:45:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1d5e90>
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_ba31aac82ba6c8ed8ad2834895d0cd4a.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_ba31aac82ba6c8ed8ad2834895d0cd4a.jpg saved to cache
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8878daf-9971-5dc8-a305-139ef2024c2d
2026-03-27 10:45:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf19490>
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_f2826859d1d4d9962332dd6b3e12e454.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_f2826859d1d4d9962332dd6b3e12e454.jpg saved to cache
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8878daf-9971-5dc8-a305-139ef2024c2d
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_e9eb5731e77311a3f7a978cf6eacdacb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_e9eb5731e77311a3f7a978cf6eacdacb.jpg not downloaded yet
2026-03-27 10:45:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5649250>
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_22c7835a6bcb887eb786a5f4ced88713.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_22c7835a6bcb887eb786a5f4ced88713.jpg saved to cache
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8878daf-9971-5dc8-a305-139ef2024c2d
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_66ea379c513e7ff742b842083d8f31c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_66ea379c513e7ff742b842083d8f31c1.jpg not downloaded yet
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf44e090>
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F97%252Fa797cfee6109f7527a0dde829ac12d7b%252Fpa%252FCD13649_e93a72365058cb59f21af0b248b18076.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_e93a72365058cb59f21af0b248b18076.jpg saved to cache
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8878daf-9971-5dc8-a305-139ef2024c2d
2026-03-27 10:45:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8878daf-9971-5dc8-a305-139ef2024c2d, skipping ID generation
2026-03-27 10:45:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8878daf-9971-5dc8-a305-139ef2024c2d with scrape type 1
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8878daf-9971-5dc8-a305-139ef2024c2d sending to next pipeline
2026-03-27 10:45:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8878daf-9971-5dc8-a305-139ef2024c2d, identifier: CD13649
2026-03-27 10:45:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8878daf-9971-5dc8-a305-139ef2024c2d with identifier: CD13649
2026-03-27 10:45:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8878daf-9971-5dc8-a305-139ef2024c2d with identifier: CD13649
2026-03-27 10:45:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8878daf-9971-5dc8-a305-139ef2024c2d with identifier: CD13649 to the API
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_e93a72365058cb59f21af0b248b18076.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:04:31Z',
'fuel_type': 'petrol',
'id': 'b8878daf-9971-5dc8-a305-139ef2024c2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD13649',
'listing': 'auction',
'location': 'DE, Nürnberg',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 140277,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_e93a72365058cb59f21af0b248b18076.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2749809,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_22c7835a6bcb887eb786a5f4ced88713.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2795638,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_d4ec611e3ed344bea7cb5d9b726e12b9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2357789,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_ba31aac82ba6c8ed8ad2834895d0cd4a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2603331,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_f2826859d1d4d9962332dd6b3e12e454.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2628030,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_cc8e2fb5b525b6a2ec377f56b0d0a5f7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_82e5f950376d0266b43a37ad41dc0bef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87705,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_311df0739e060e6d1024f47cea566576.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77507,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_1009f809fa1d58844b29577be6d07b13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8878daf-9971-5dc8-a305-139ef2024c2d/b8878daf-9971-5dc8-a305-139ef2024c2d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75734,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/97/a797cfee6109f7527a0dde829ac12d7b/pa/CD13649_49f210882ab651704e05f1c2ab8b2e93.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-11-13',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2012}
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13649%27 HTTP/1.1" 200 None
2026-03-27 10:45:02 [auto1.de] INFO: Saving data for CD13649: {'created_time': 1774608302.293486, 'last_price_update_time': 1774608302.293499, 'auction_closing_time': 1774713871.0}
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD13649') HTTP/1.1" 204 0
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_714c10fe621e7ee84509e89a270e46f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_714c10fe621e7ee84509e89a270e46f2.jpg not downloaded yet
2026-03-27 10:45:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_7ec8420daea5b4266e45609b86dab926.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_16989278b4d2f4b86b2a436a67214c4a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_96eb20afd81305bebf0d8ba8527c37df.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_96eb20afd81305bebf0d8ba8527c37df.jpg not downloaded yet
2026-03-27 10:45:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WZ51755> (referer: https://www.auto1.com/v1/car-details-view/WZ51755/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_9db7dd0a7e4b3a55efae0bc9c174d558.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_9db7dd0a7e4b3a55efae0bc9c174d558.jpg not downloaded yet
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_ec827005eee8d78549560f620f4e84ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_ec827005eee8d78549560f620f4e84ba.jpg not downloaded yet
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_9cbc23a7fa2b080584ba822787f58c78.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_9cbc23a7fa2b080584ba822787f58c78.jpg not downloaded yet
2026-03-27 10:45:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf44cb10>
2026-03-27 10:45:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_7ec8420daea5b4266e45609b86dab926.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_7ec8420daea5b4266e45609b86dab926.jpg saved to cache
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a
2026-03-27 10:45:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_e9eb5731e77311a3f7a978cf6eacdacb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_714c10fe621e7ee84509e89a270e46f2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be24a6d0>
2026-03-27 10:45:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_16989278b4d2f4b86b2a436a67214c4a.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_16989278b4d2f4b86b2a436a67214c4a.jpg saved to cache
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a
2026-03-27 10:45:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e with identifier: WZ51755
2026-03-27 10:45:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e with scrape type 1
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fbe%252F6abe505913823c3abbfd64c637d76c31%252Fpa%252FWZ51755_da12cda112408266fd38b7a1a1b8be0b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_da12cda112408266fd38b7a1a1b8be0b.jpg already downloaded
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fbe%252F6abe505913823c3abbfd64c637d76c31%252Fpa%252FWZ51755_20b7729879c11c6218d6a946f5d98285.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_20b7729879c11c6218d6a946f5d98285.jpg already downloaded
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fbe%252F6abe505913823c3abbfd64c637d76c31%252Fpa%252FWZ51755_38f01f67774d112face6de1a284c8a49.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_38f01f67774d112face6de1a284c8a49.jpg already downloaded
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fbe%252F6abe505913823c3abbfd64c637d76c31%252Fpa%252FWZ51755_a8390b6a3217a4945177abd15345f904.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_a8390b6a3217a4945177abd15345f904.jpg already downloaded
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fbe%252F6abe505913823c3abbfd64c637d76c31%252Fpa%252FWZ51755_22e72036259086162f7a97c796d2f3fb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_22e72036259086162f7a97c796d2f3fb.jpg already downloaded
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fbe%252F6abe505913823c3abbfd64c637d76c31%252Fpa%252FWZ51755_95e9394808ce9b435c5392bfa5176509.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_95e9394808ce9b435c5392bfa5176509.jpg already downloaded
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fbe%252F6abe505913823c3abbfd64c637d76c31%252Fpa%252FWZ51755_b674d85bb17e9ae107acaddb80f0fa77.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_b674d85bb17e9ae107acaddb80f0fa77.jpg already downloaded
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fbe%252F6abe505913823c3abbfd64c637d76c31%252Fpa%252FWZ51755_f345226a55186a00f846b15b83af5f76.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_f345226a55186a00f846b15b83af5f76.jpg already downloaded
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fbe%252F6abe505913823c3abbfd64c637d76c31%252Fpa%252FWZ51755_7fae4bcf15536a7b0107c7989f6957c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_7fae4bcf15536a7b0107c7989f6957c5.jpg already downloaded
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fbe%252F6abe505913823c3abbfd64c637d76c31%252Fpa%252FWZ51755_91c69d81e102603989886e83d23ca740.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_91c69d81e102603989886e83d23ca740.jpg already downloaded
2026-03-27 10:45:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e, identifier: WZ51755
2026-03-27 10:45:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e with identifier: WZ51755
2026-03-27 10:45:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e with identifier: WZ51755
2026-03-27 10:45:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a1c756a-fc9e-5f31-b748-beab7ccd8e3e with identifier: WZ51755 to the API
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WZ51755>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '3.0L',
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:52:33Z',
'fuel_type': 'diesel',
'id': '9a1c756a-fc9e-5f31-b748-beab7ccd8e3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ51755',
'listing': 'auction',
'location': 'DE, Buch',
'make': 'Audi',
'model': 'A6',
'odometer': 189755,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_da12cda112408266fd38b7a1a1b8be0b.jpg',
'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_20b7729879c11c6218d6a946f5d98285.jpg',
'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_38f01f67774d112face6de1a284c8a49.jpg',
'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_a8390b6a3217a4945177abd15345f904.jpg',
'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_22e72036259086162f7a97c796d2f3fb.jpg',
'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_95e9394808ce9b435c5392bfa5176509.jpg',
'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_b674d85bb17e9ae107acaddb80f0fa77.jpg',
'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_f345226a55186a00f846b15b83af5f76.jpg',
'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_7fae4bcf15536a7b0107c7989f6957c5.jpg',
'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_91c69d81e102603989886e83d23ca740.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1c756a-fc9e-5f31-b748-beab7ccd8e3e/9a1c756a-fc9e-5f31-b748-beab7ccd8e3e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_da12cda112408266fd38b7a1a1b8be0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1c756a-fc9e-5f31-b748-beab7ccd8e3e/9a1c756a-fc9e-5f31-b748-beab7ccd8e3e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2894900,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_20b7729879c11c6218d6a946f5d98285.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1c756a-fc9e-5f31-b748-beab7ccd8e3e/9a1c756a-fc9e-5f31-b748-beab7ccd8e3e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2868092,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_38f01f67774d112face6de1a284c8a49.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1c756a-fc9e-5f31-b748-beab7ccd8e3e/9a1c756a-fc9e-5f31-b748-beab7ccd8e3e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_a8390b6a3217a4945177abd15345f904.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1c756a-fc9e-5f31-b748-beab7ccd8e3e/9a1c756a-fc9e-5f31-b748-beab7ccd8e3e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_22e72036259086162f7a97c796d2f3fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1c756a-fc9e-5f31-b748-beab7ccd8e3e/9a1c756a-fc9e-5f31-b748-beab7ccd8e3e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2979360,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_95e9394808ce9b435c5392bfa5176509.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1c756a-fc9e-5f31-b748-beab7ccd8e3e/9a1c756a-fc9e-5f31-b748-beab7ccd8e3e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59096,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_b674d85bb17e9ae107acaddb80f0fa77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1c756a-fc9e-5f31-b748-beab7ccd8e3e/9a1c756a-fc9e-5f31-b748-beab7ccd8e3e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78561,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_f345226a55186a00f846b15b83af5f76.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1c756a-fc9e-5f31-b748-beab7ccd8e3e/9a1c756a-fc9e-5f31-b748-beab7ccd8e3e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72889,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_7fae4bcf15536a7b0107c7989f6957c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1c756a-fc9e-5f31-b748-beab7ccd8e3e/9a1c756a-fc9e-5f31-b748-beab7ccd8e3e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75866,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/be/6abe505913823c3abbfd64c637d76c31/pa/WZ51755_91c69d81e102603989886e83d23ca740.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-12-06',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ51755%27 HTTP/1.1" 200 None
2026-03-27 10:45:03 [auto1.de] INFO: Saving data for WZ51755: {'created_time': 1774608303.301252, 'last_price_update_time': 1774608303.301263, 'auction_closing_time': 1774716753.0}
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ51755') HTTP/1.1" 204 0
2026-03-27 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_66ea379c513e7ff742b842083d8f31c1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_9cbc23a7fa2b080584ba822787f58c78.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_ec827005eee8d78549560f620f4e84ba.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3af710>
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_e9eb5731e77311a3f7a978cf6eacdacb.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_e9eb5731e77311a3f7a978cf6eacdacb.jpg saved to cache
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5f9150>
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_714c10fe621e7ee84509e89a270e46f2.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_714c10fe621e7ee84509e89a270e46f2.jpg saved to cache
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be216710>
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_66ea379c513e7ff742b842083d8f31c1.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_66ea379c513e7ff742b842083d8f31c1.jpg saved to cache
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be169910>
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_9cbc23a7fa2b080584ba822787f58c78.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_9cbc23a7fa2b080584ba822787f58c78.jpg saved to cache
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a
2026-03-27 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_821fbcb1b62d6ff6b96bb7365a22e53b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4577d0>
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_ec827005eee8d78549560f620f4e84ba.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_ec827005eee8d78549560f620f4e84ba.jpg saved to cache
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a
2026-03-27 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GS36326> (referer: https://www.auto1.com/v1/car-details-view/GS36326/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_96eb20afd81305bebf0d8ba8527c37df.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_9db7dd0a7e4b3a55efae0bc9c174d558.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be23ded0>
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_821fbcb1b62d6ff6b96bb7365a22e53b.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_821fbcb1b62d6ff6b96bb7365a22e53b.jpg saved to cache
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a
2026-03-27 10:45:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aa3dfa2-760d-5565-9835-4eb8359113a9 with identifier: GS36326
2026-03-27 10:45:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aa3dfa2-760d-5565-9835-4eb8359113a9 with scrape type 1
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7aa3dfa2-760d-5565-9835-4eb8359113a9
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F27%252F7d27277a605390f9f524dbd0c4649b3a%252Fpa%252FGS36326_7795ed9473fb6feca56ad9a3450dfd98.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_7795ed9473fb6feca56ad9a3450dfd98.jpg already downloaded
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F27%252F7d27277a605390f9f524dbd0c4649b3a%252Fpa%252FGS36326_7beab48e57e2ac5f541bb06bebc591a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_7beab48e57e2ac5f541bb06bebc591a0.jpg already downloaded
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F27%252F7d27277a605390f9f524dbd0c4649b3a%252Fpa%252FGS36326_d2355a999561d322cc36fab903cc1e0e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_d2355a999561d322cc36fab903cc1e0e.jpg already downloaded
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F27%252F7d27277a605390f9f524dbd0c4649b3a%252Fpa%252FGS36326_741e6c80504d8a929de026eac55e882f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_741e6c80504d8a929de026eac55e882f.jpg already downloaded
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F27%252F7d27277a605390f9f524dbd0c4649b3a%252Fpa%252FGS36326_c5c5f9a189ad9e37c36155394a46048c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_c5c5f9a189ad9e37c36155394a46048c.jpg already downloaded
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F27%252F7d27277a605390f9f524dbd0c4649b3a%252Fpa%252FGS36326_6d036c1c7961a68be4a93dfcdd24c73a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_6d036c1c7961a68be4a93dfcdd24c73a.jpg already downloaded
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F27%252F7d27277a605390f9f524dbd0c4649b3a%252Fpa%252FGS36326_43edfd106201b9521aaf8dc8f421cabb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_43edfd106201b9521aaf8dc8f421cabb.jpg already downloaded
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F27%252F7d27277a605390f9f524dbd0c4649b3a%252Fpa%252FGS36326_8d34a84779900bd3a93c0092ff8bd140.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_8d34a84779900bd3a93c0092ff8bd140.jpg already downloaded
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F27%252F7d27277a605390f9f524dbd0c4649b3a%252Fpa%252FGS36326_f878cc6d3198590f7fd3f316b8c13252.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_f878cc6d3198590f7fd3f316b8c13252.jpg already downloaded
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F27%252F7d27277a605390f9f524dbd0c4649b3a%252Fpa%252FGS36326_833ec604d7e48f236974b35c19d5abe4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_833ec604d7e48f236974b35c19d5abe4.jpg already downloaded
2026-03-27 10:45:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7aa3dfa2-760d-5565-9835-4eb8359113a9, identifier: GS36326
2026-03-27 10:45:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7aa3dfa2-760d-5565-9835-4eb8359113a9 with identifier: GS36326
2026-03-27 10:45:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7aa3dfa2-760d-5565-9835-4eb8359113a9 with identifier: GS36326
2026-03-27 10:45:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7aa3dfa2-760d-5565-9835-4eb8359113a9 with identifier: GS36326 to the API
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GS36326>
{'auction_title': '',
'c_o_2_emission_value': 145,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:27:44Z',
'fuel_type': 'petrol',
'id': '7aa3dfa2-760d-5565-9835-4eb8359113a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS36326',
'listing': 'auction',
'location': 'DE, Kitzingen',
'make': 'Opel',
'model': 'Mokka',
'odometer': 67479,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_7795ed9473fb6feca56ad9a3450dfd98.jpg',
'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_7beab48e57e2ac5f541bb06bebc591a0.jpg',
'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_d2355a999561d322cc36fab903cc1e0e.jpg',
'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_741e6c80504d8a929de026eac55e882f.jpg',
'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_c5c5f9a189ad9e37c36155394a46048c.jpg',
'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_6d036c1c7961a68be4a93dfcdd24c73a.jpg',
'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_43edfd106201b9521aaf8dc8f421cabb.jpg',
'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_8d34a84779900bd3a93c0092ff8bd140.jpg',
'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_f878cc6d3198590f7fd3f316b8c13252.jpg',
'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_833ec604d7e48f236974b35c19d5abe4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa3dfa2-760d-5565-9835-4eb8359113a9/7aa3dfa2-760d-5565-9835-4eb8359113a9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_7795ed9473fb6feca56ad9a3450dfd98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa3dfa2-760d-5565-9835-4eb8359113a9/7aa3dfa2-760d-5565-9835-4eb8359113a9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61128,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_7beab48e57e2ac5f541bb06bebc591a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa3dfa2-760d-5565-9835-4eb8359113a9/7aa3dfa2-760d-5565-9835-4eb8359113a9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57904,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_d2355a999561d322cc36fab903cc1e0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa3dfa2-760d-5565-9835-4eb8359113a9/7aa3dfa2-760d-5565-9835-4eb8359113a9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_741e6c80504d8a929de026eac55e882f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa3dfa2-760d-5565-9835-4eb8359113a9/7aa3dfa2-760d-5565-9835-4eb8359113a9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_c5c5f9a189ad9e37c36155394a46048c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa3dfa2-760d-5565-9835-4eb8359113a9/7aa3dfa2-760d-5565-9835-4eb8359113a9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61712,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_6d036c1c7961a68be4a93dfcdd24c73a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa3dfa2-760d-5565-9835-4eb8359113a9/7aa3dfa2-760d-5565-9835-4eb8359113a9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48374,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_43edfd106201b9521aaf8dc8f421cabb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa3dfa2-760d-5565-9835-4eb8359113a9/7aa3dfa2-760d-5565-9835-4eb8359113a9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_8d34a84779900bd3a93c0092ff8bd140.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa3dfa2-760d-5565-9835-4eb8359113a9/7aa3dfa2-760d-5565-9835-4eb8359113a9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56770,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_f878cc6d3198590f7fd3f316b8c13252.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa3dfa2-760d-5565-9835-4eb8359113a9/7aa3dfa2-760d-5565-9835-4eb8359113a9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61647,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/27/7d27277a605390f9f524dbd0c4649b3a/pa/GS36326_833ec604d7e48f236974b35c19d5abe4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-09-17',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex',
'transmission': 'manual',
'trim': 'Innovation ecoFlex',
'year': 2015}
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36326%27 HTTP/1.1" 200 None
2026-03-27 10:45:04 [auto1.de] INFO: Saving data for GS36326: {'created_time': 1774608304.55713, 'last_price_update_time': 1774608304.557142, 'auction_closing_time': 1774715264.0}
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS36326') HTTP/1.1" 204 0
2026-03-27 10:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_c40f563f675c463a8375bbcc3612bd58.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3c6f90>
2026-03-27 10:45:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_96eb20afd81305bebf0d8ba8527c37df.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_96eb20afd81305bebf0d8ba8527c37df.jpg saved to cache
2026-03-27 10:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a
2026-03-27 10:45:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0a5a10>
2026-03-27 10:45:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fce%252F76cefdd9442f9a01397458262d1d6af1%252Fpa%252FAB88110_9db7dd0a7e4b3a55efae0bc9c174d558.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_9db7dd0a7e4b3a55efae0bc9c174d558.jpg saved to cache
2026-03-27 10:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a
2026-03-27 10:45:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a, skipping ID generation
2026-03-27 10:45:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a with scrape type 1
2026-03-27 10:45:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a sending to next pipeline
2026-03-27 10:45:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a, identifier: AB88110
2026-03-27 10:45:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a with identifier: AB88110
2026-03-27 10:45:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a with identifier: AB88110
2026-03-27 10:45:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a with identifier: AB88110 to the API
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_9db7dd0a7e4b3a55efae0bc9c174d558.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:43:40Z',
'fuel_type': 'diesel',
'id': '5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB88110',
'listing': 'auction',
'location': 'Bitburg',
'make': 'Skoda',
'model': 'Superb',
'odometer': 222846,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69314,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_821fbcb1b62d6ff6b96bb7365a22e53b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66948,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_16989278b4d2f4b86b2a436a67214c4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63434,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_7ec8420daea5b4266e45609b86dab926.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52876,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_e9eb5731e77311a3f7a978cf6eacdacb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67543,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_66ea379c513e7ff742b842083d8f31c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53935,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_714c10fe621e7ee84509e89a270e46f2.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47854,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_96eb20afd81305bebf0d8ba8527c37df.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54532,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_9db7dd0a7e4b3a55efae0bc9c174d558.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_ec827005eee8d78549560f620f4e84ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a/5894ebbc-8cad-5bfb-a6dd-24db71c7ca6a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90945,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/ce/76cefdd9442f9a01397458262d1d6af1/pa/AB88110_9cbc23a7fa2b080584ba822787f58c78.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-03-01',
'seats_number': 2,
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Exclusive 4x4',
'transmission': 'automatic',
'trim': 'Exclusive 4x4',
'year': 2015}
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB88110%27 HTTP/1.1" 200 None
2026-03-27 10:45:05 [auto1.de] INFO: Saving data for AB88110: {'created_time': 1774608305.174039, 'last_price_update_time': 1774608305.174054, 'auction_closing_time': 1774716220.0}
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB88110') HTTP/1.1" 204 0
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be260650>
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fa7%252F5da7e0598e2781d817a122a7af0aad62%252Fpa%252FBP02747_c40f563f675c463a8375bbcc3612bd58.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_c40f563f675c463a8375bbcc3612bd58.jpg saved to cache
2026-03-27 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7734d4b9-6b07-545e-a7ab-6e568f141601
2026-03-27 10:45:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7734d4b9-6b07-545e-a7ab-6e568f141601, skipping ID generation
2026-03-27 10:45:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7734d4b9-6b07-545e-a7ab-6e568f141601 with scrape type 1
2026-03-27 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7734d4b9-6b07-545e-a7ab-6e568f141601 sending to next pipeline
2026-03-27 10:45:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7734d4b9-6b07-545e-a7ab-6e568f141601, identifier: BP02747
2026-03-27 10:45:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7734d4b9-6b07-545e-a7ab-6e568f141601 with identifier: BP02747
2026-03-27 10:45:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7734d4b9-6b07-545e-a7ab-6e568f141601 with identifier: BP02747
2026-03-27 10:45:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7734d4b9-6b07-545e-a7ab-6e568f141601 with identifier: BP02747 to the API
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_c40f563f675c463a8375bbcc3612bd58.jpg>
{'auction_title': '',
'c_o_2_emission_value': 176,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 184,
'expiration_date': '2026-03-28T16:32:41Z',
'fuel_type': 'petrol',
'id': '7734d4b9-6b07-545e-a7ab-6e568f141601',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP02747',
'listing': 'auction',
'location': 'DE, Duisburg',
'make': 'BMW',
'model': 'X3',
'odometer': 10974,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_c40f563f675c463a8375bbcc3612bd58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69859,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_bb4ac50c39a3e61a8a2340a4d70e2a51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_3f00b2b1a86d15043540cf45c9bb00e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61522,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_d5918ba8ac3a901cc61ba4908af85d07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57903,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_d39c4f685e358f14e40816df61d0fa5d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_6fadaae8c90dcbe790542d85bfbbe50a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57943,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_79282d5e698d350bf1544f8ea05dd17e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_b94f2930ece13327d1085574a080bee9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68371,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_6a58068476afd3c249789912b8cb9109.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7734d4b9-6b07-545e-a7ab-6e568f141601/7734d4b9-6b07-545e-a7ab-6e568f141601_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62777,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/a7/5da7e0598e2781d817a122a7af0aad62/pa/BP02747_66dc007d03458e77084446b3f20eae88.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-08-23',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 20i Mild-Hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP02747%27 HTTP/1.1" 200 None
2026-03-27 10:45:05 [auto1.de] INFO: Saving data for BP02747: {'created_time': 1774608305.765001, 'last_price_update_time': 1774608305.765013, 'auction_closing_time': 1774715561.0}
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP02747') HTTP/1.1" 204 0
2026-03-27 10:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_da2f5a2f194decbdaad59eacd81def56.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3d7290>
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb5%252F11b5db110d76a18fa18b2fe66e77d986%252Fpa%252FPA85998_da2f5a2f194decbdaad59eacd81def56.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_da2f5a2f194decbdaad59eacd81def56.jpg saved to cache
2026-03-27 10:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ae1811e-78e3-526d-8183-9a67084a9e5d
2026-03-27 10:45:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ae1811e-78e3-526d-8183-9a67084a9e5d, skipping ID generation
2026-03-27 10:45:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ae1811e-78e3-526d-8183-9a67084a9e5d with scrape type 1
2026-03-27 10:45:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ae1811e-78e3-526d-8183-9a67084a9e5d sending to next pipeline
2026-03-27 10:45:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ae1811e-78e3-526d-8183-9a67084a9e5d, identifier: PA85998
2026-03-27 10:45:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ae1811e-78e3-526d-8183-9a67084a9e5d with identifier: PA85998
2026-03-27 10:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ae1811e-78e3-526d-8183-9a67084a9e5d with identifier: PA85998
2026-03-27 10:45:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ae1811e-78e3-526d-8183-9a67084a9e5d with identifier: PA85998 to the API
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_da2f5a2f194decbdaad59eacd81def56.jpg>
{'auction_title': '',
'c_o_2_emission_value': 214,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 457,
'expiration_date': '2026-03-28T16:19:48Z',
'fuel_type': 'petrol',
'id': '1ae1811e-78e3-526d-8183-9a67084a9e5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA85998',
'listing': 'auction',
'location': 'DE, Bremen',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 86426,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3186985,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_da2f5a2f194decbdaad59eacd81def56.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92111,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_b7be210d05600d4a74d6cd09427222a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2954622,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_91c17a6117a56c74b71274335fc60f46.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72109,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_3a8fa7889d27dff9e107adda45289f96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_ef540fa5e7139302eb2e0d2b6e97e05d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85340,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_abe8e37a09209734931b74f38754aee1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2617497,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_ca93fc9eaf210cc7b926f53af4d00fb8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2799701,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_01e2ff17918506d49e13681fb0895c59.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3188851,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_aeeb7664af5e70df4a6b3b399586aa5c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ae1811e-78e3-526d-8183-9a67084a9e5d/1ae1811e-78e3-526d-8183-9a67084a9e5d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74948,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/b5/11b5db110d76a18fa18b2fe66e77d986/pa/PA85998_c055e329750a14549ebc612d963de7b3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-28',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 53 AMG Mild-Hybrid T 4Matic+',
'transmission': 'automatic',
'trim': 'T 4Matic+',
'year': 2019}
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA85998%27 HTTP/1.1" 200 None
2026-03-27 10:45:06 [auto1.de] INFO: Saving data for PA85998: {'created_time': 1774608306.619479, 'last_price_update_time': 1774608306.619494, 'auction_closing_time': 1774714788.0}
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA85998') HTTP/1.1" 204 0
2026-03-27 10:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JL91815/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:07 [scrapy.extensions.logstats] INFO: Crawled 418 pages (at 37 pages/min), scraped 890 items (at 36 items/min)
2026-03-27 10:45:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-27 10:45:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY57435/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB31061> (referer: https://www.auto1.com/v1/car-details-view/HB31061/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83e8b967-8a3d-51fd-b23b-05555d728276 with identifier: HB31061
2026-03-27 10:45:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83e8b967-8a3d-51fd-b23b-05555d728276 with scrape type 1
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 83e8b967-8a3d-51fd-b23b-05555d728276
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_50935158fa3bf452144690b2708fb1c9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_50935158fa3bf452144690b2708fb1c9.jpg not downloaded yet
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_9b80c46a7b2297e1e1e87f8984be357e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_9b80c46a7b2297e1e1e87f8984be357e.jpg not downloaded yet
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_3fa9cb735d41ad1e6a2ce030dc47b74f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_3fa9cb735d41ad1e6a2ce030dc47b74f.jpg not downloaded yet
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_f621442fe68da84898f515257506ec8e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_f621442fe68da84898f515257506ec8e.jpg not downloaded yet
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_f2f430990ec47190549048c83ebe341d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_f2f430990ec47190549048c83ebe341d.jpg not downloaded yet
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_8c6e1dee208602d9fabdf847325bc262.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_8c6e1dee208602d9fabdf847325bc262.jpg not downloaded yet
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_1a3d79b38f33657271658709c1411389.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_1a3d79b38f33657271658709c1411389.jpg not downloaded yet
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_bbbca294c4b1702f70efda2c00fa921c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_bbbca294c4b1702f70efda2c00fa921c.jpg not downloaded yet
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_3fcdddf86b7e083e8afebb8a100d59df.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_3fcdddf86b7e083e8afebb8a100d59df.jpg not downloaded yet
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_eee1529dd7f89a17b351f8a0fbe1ae98.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_eee1529dd7f89a17b351f8a0fbe1ae98.jpg not downloaded yet
2026-03-27 10:45:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SL27608/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_eee1529dd7f89a17b351f8a0fbe1ae98.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3d5690>
2026-03-27 10:45:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_eee1529dd7f89a17b351f8a0fbe1ae98.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_eee1529dd7f89a17b351f8a0fbe1ae98.jpg saved to cache
2026-03-27 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 83e8b967-8a3d-51fd-b23b-05555d728276
2026-03-27 10:45:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP68218> (referer: https://www.auto1.com/v1/car-details-view/GP68218/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY13477/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_3fcdddf86b7e083e8afebb8a100d59df.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab566936-0092-5264-b538-249375a3f4db with identifier: GP68218
2026-03-27 10:45:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab566936-0092-5264-b538-249375a3f4db with scrape type 1
2026-03-27 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab566936-0092-5264-b538-249375a3f4db
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_9dc6aa58a506c6c62dbdc558d0162114.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_9dc6aa58a506c6c62dbdc558d0162114.jpg not downloaded yet
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_cf02f799cde92443c0f100a69561496f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_cf02f799cde92443c0f100a69561496f.jpg not downloaded yet
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_c3eaaa7511e03be51ebb1f02ba93cce9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_c3eaaa7511e03be51ebb1f02ba93cce9.jpg not downloaded yet
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_391b43bdb3a15ce9979ab314d3cfeac4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_391b43bdb3a15ce9979ab314d3cfeac4.jpg not downloaded yet
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_1764769a1246cb8f9ab79f2617ffef2c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_1764769a1246cb8f9ab79f2617ffef2c.jpg not downloaded yet
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_81f376591f72f94a335d4aeedc41db98.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_81f376591f72f94a335d4aeedc41db98.jpg not downloaded yet
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_461638faa50d0f3ac568bc0c4e31ff39.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_461638faa50d0f3ac568bc0c4e31ff39.jpg not downloaded yet
2026-03-27 10:45:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf551cd0>
2026-03-27 10:45:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_3fcdddf86b7e083e8afebb8a100d59df.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_3fcdddf86b7e083e8afebb8a100d59df.jpg saved to cache
2026-03-27 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 83e8b967-8a3d-51fd-b23b-05555d728276
2026-03-27 10:45:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_1a3d79b38f33657271658709c1411389.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_308730ca1bee87b11fd99ce79d33638e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_308730ca1bee87b11fd99ce79d33638e.jpg not downloaded yet
2026-03-27 10:45:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD28576/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_c1819069e331aa55bed1b60035016138.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_c1819069e331aa55bed1b60035016138.jpg not downloaded yet
2026-03-27 10:45:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_e3febf875518529e8cf533bfd1646312.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_e3febf875518529e8cf533bfd1646312.jpg not downloaded yet
2026-03-27 10:45:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_bbbca294c4b1702f70efda2c00fa921c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:10 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 10544 | hits on page: 40
2026-03-27 10:45:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_e3febf875518529e8cf533bfd1646312.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:10 [auto1.de] INFO: Found listing with ID: UR56671
2026-03-27 10:45:10 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-27 10:45:10 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-27 10:45:10 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-27 10:45:10 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-27 10:45:10 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-27 10:45:10 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-27 10:45:10 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-27 10:45:10 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-27 10:45:10 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-27 10:45:10 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41377%27 HTTP/1.1" 200 None
2026-03-27 10:45:10 [auto1.de] INFO: Scrape type for DV41377: 2
2026-03-27 10:45:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43642e65-0815-5bf0-b640-6173f805d69a with identifier: DV41377
2026-03-27 10:45:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43642e65-0815-5bf0-b640-6173f805d69a with scrape type 2
2026-03-27 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43642e65-0815-5bf0-b640-6173f805d69a with scrape type 2
2026-03-27 10:45:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43642e65-0815-5bf0-b640-6173f805d69a, identifier: DV41377
2026-03-27 10:45:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43642e65-0815-5bf0-b640-6173f805d69a with identifier: DV41377
2026-03-27 10:45:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43642e65-0815-5bf0-b640-6173f805d69a with identifier: DV41377
2026-03-27 10:45:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43642e65-0815-5bf0-b640-6173f805d69a with identifier: DV41377 to the API
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:58:27Z',
'fuel_type': 'petrol',
'id': '43642e65-0815-5bf0-b640-6173f805d69a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV41377',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira',
'odometer': 64357,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-08',
'seller_name': None,
'title': 'Opel Zafira 1.8 Family Plus',
'transmission': 'manual',
'trim': 'Family Plus',
'year': 2013}
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41377%27 HTTP/1.1" 200 None
2026-03-27 10:45:11 [auto1.de] INFO: Saving data for DV41377: {'auction_closing_time': 1774717107.0, 'created_time': 1774031494.790696, 'last_price_update_time': 1774608311.043596}
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV41377') HTTP/1.1" 204 0
2026-03-27 10:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_461638faa50d0f3ac568bc0c4e31ff39.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:11 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR95104%27 HTTP/1.1" 200 None
2026-03-27 10:45:11 [auto1.de] INFO: Scrape type for RR95104: 2
2026-03-27 10:45:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3ca586b-0878-5598-b264-ef661f73908e with identifier: RR95104
2026-03-27 10:45:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3ca586b-0878-5598-b264-ef661f73908e with scrape type 2
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3ca586b-0878-5598-b264-ef661f73908e with scrape type 2
2026-03-27 10:45:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3ca586b-0878-5598-b264-ef661f73908e, identifier: RR95104
2026-03-27 10:45:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0ad750>
2026-03-27 10:45:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_1a3d79b38f33657271658709c1411389.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_1a3d79b38f33657271658709c1411389.jpg saved to cache
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 83e8b967-8a3d-51fd-b23b-05555d728276
2026-03-27 10:45:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0b2ed0>
2026-03-27 10:45:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_bbbca294c4b1702f70efda2c00fa921c.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_bbbca294c4b1702f70efda2c00fa921c.jpg saved to cache
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 83e8b967-8a3d-51fd-b23b-05555d728276
2026-03-27 10:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_81f376591f72f94a335d4aeedc41db98.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3ca586b-0878-5598-b264-ef661f73908e with identifier: RR95104
2026-03-27 10:45:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3ca586b-0878-5598-b264-ef661f73908e with identifier: RR95104
2026-03-27 10:45:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3ca586b-0878-5598-b264-ef661f73908e with identifier: RR95104 to the API
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:06:24Z',
'fuel_type': 'diesel',
'id': 'd3ca586b-0878-5598-b264-ef661f73908e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR95104',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 213283,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-27',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Ambition 4x4',
'transmission': 'automatic',
'trim': 'Ambition 4x4',
'year': 2017}
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR95104%27 HTTP/1.1" 200 None
2026-03-27 10:45:11 [auto1.de] INFO: Saving data for RR95104: {'auction_closing_time': 1774713984.0, 'created_time': 1773132415.151988, 'last_price_update_time': 1774608311.848643}
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR95104') HTTP/1.1" 204 0
2026-03-27 10:45:11 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB29698%27 HTTP/1.1" 200 None
2026-03-27 10:45:11 [auto1.de] INFO: Scrape type for RB29698: 2
2026-03-27 10:45:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a319af6a-c378-55f1-9170-ea84f8a6abf5 with identifier: RB29698
2026-03-27 10:45:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a319af6a-c378-55f1-9170-ea84f8a6abf5 with scrape type 2
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a319af6a-c378-55f1-9170-ea84f8a6abf5 with scrape type 2
2026-03-27 10:45:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a319af6a-c378-55f1-9170-ea84f8a6abf5, identifier: RB29698
2026-03-27 10:45:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH57189/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be289990>
2026-03-27 10:45:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_e3febf875518529e8cf533bfd1646312.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_e3febf875518529e8cf533bfd1646312.jpg saved to cache
2026-03-27 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab566936-0092-5264-b538-249375a3f4db
2026-03-27 10:45:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a319af6a-c378-55f1-9170-ea84f8a6abf5 with identifier: RB29698
2026-03-27 10:45:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a319af6a-c378-55f1-9170-ea84f8a6abf5 with identifier: RB29698
2026-03-27 10:45:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a319af6a-c378-55f1-9170-ea84f8a6abf5 with identifier: RB29698 to the API
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:33:18Z',
'fuel_type': 'diesel',
'id': 'a319af6a-c378-55f1-9170-ea84f8a6abf5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB29698',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 294198,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-26',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2017}
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB29698%27 HTTP/1.1" 200 None
2026-03-27 10:45:12 [auto1.de] INFO: Saving data for RB29698: {'auction_closing_time': 1774715598.0, 'created_time': 1772541363.997127, 'last_price_update_time': 1774608312.44974}
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB29698') HTTP/1.1" 204 0
2026-03-27 10:45:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf41c5d0>
2026-03-27 10:45:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_461638faa50d0f3ac568bc0c4e31ff39.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_461638faa50d0f3ac568bc0c4e31ff39.jpg saved to cache
2026-03-27 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab566936-0092-5264-b538-249375a3f4db
2026-03-27 10:45:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_c1819069e331aa55bed1b60035016138.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:12 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ54274%27 HTTP/1.1" 200 None
2026-03-27 10:45:12 [auto1.de] INFO: Scrape type for TJ54274: 2
2026-03-27 10:45:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc1073af-f2da-5a7b-9024-ad2b9f9adbe2 with identifier: TJ54274
2026-03-27 10:45:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc1073af-f2da-5a7b-9024-ad2b9f9adbe2 with scrape type 2
2026-03-27 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc1073af-f2da-5a7b-9024-ad2b9f9adbe2 with scrape type 2
2026-03-27 10:45:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc1073af-f2da-5a7b-9024-ad2b9f9adbe2, identifier: TJ54274
2026-03-27 10:45:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc1073af-f2da-5a7b-9024-ad2b9f9adbe2 with identifier: TJ54274
2026-03-27 10:45:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc1073af-f2da-5a7b-9024-ad2b9f9adbe2 with identifier: TJ54274
2026-03-27 10:45:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc1073af-f2da-5a7b-9024-ad2b9f9adbe2 with identifier: TJ54274 to the API
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:15:46Z',
'fuel_type': 'diesel',
'id': 'fc1073af-f2da-5a7b-9024-ad2b9f9adbe2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ54274',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 234057,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-27',
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Allure L2',
'transmission': 'automatic',
'trim': 'Allure L2',
'year': 2019}
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ54274%27 HTTP/1.1" 200 None
2026-03-27 10:45:13 [auto1.de] INFO: Saving data for TJ54274: {'auction_closing_time': 1774714546.0, 'created_time': 1773226336.737632, 'last_price_update_time': 1774608313.05795}
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ54274') HTTP/1.1" 204 0
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be139510>
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_81f376591f72f94a335d4aeedc41db98.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_81f376591f72f94a335d4aeedc41db98.jpg saved to cache
2026-03-27 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab566936-0092-5264-b538-249375a3f4db
2026-03-27 10:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_1764769a1246cb8f9ab79f2617ffef2c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:13 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN99160%27 HTTP/1.1" 200 None
2026-03-27 10:45:13 [auto1.de] INFO: Scrape type for BN99160: 2
2026-03-27 10:45:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5712236d-f2e5-5810-88c4-2658be36ae46 with identifier: BN99160
2026-03-27 10:45:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5712236d-f2e5-5810-88c4-2658be36ae46 with scrape type 2
2026-03-27 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5712236d-f2e5-5810-88c4-2658be36ae46 with scrape type 2
2026-03-27 10:45:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5712236d-f2e5-5810-88c4-2658be36ae46, identifier: BN99160
2026-03-27 10:45:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5712236d-f2e5-5810-88c4-2658be36ae46 with identifier: BN99160
2026-03-27 10:45:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5712236d-f2e5-5810-88c4-2658be36ae46 with identifier: BN99160
2026-03-27 10:45:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5712236d-f2e5-5810-88c4-2658be36ae46 with identifier: BN99160 to the API
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-28T16:01:57Z',
'fuel_type': 'petrol',
'id': '5712236d-f2e5-5810-88c4-2658be36ae46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN99160',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 120520,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-03',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.0 TSI Join',
'transmission': 'manual',
'trim': 'Join',
'year': 2019}
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN99160%27 HTTP/1.1" 200 None
2026-03-27 10:45:13 [auto1.de] INFO: Saving data for BN99160: {'auction_closing_time': 1774713717.0, 'created_time': 1773302919.288023, 'last_price_update_time': 1774608313.625446}
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN99160') HTTP/1.1" 204 0
2026-03-27 10:45:13 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-27 10:45:13 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-27 10:45:13 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-27 10:45:13 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-27 10:45:13 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-27 10:45:13 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26589%27 HTTP/1.1" 200 None
2026-03-27 10:45:13 [auto1.de] INFO: Scrape type for XN26589: 1
2026-03-27 10:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE75344/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf64bd0>
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_c1819069e331aa55bed1b60035016138.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_c1819069e331aa55bed1b60035016138.jpg saved to cache
2026-03-27 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab566936-0092-5264-b538-249375a3f4db
2026-03-27 10:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_391b43bdb3a15ce9979ab314d3cfeac4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM89812/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:13 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP95404%27 HTTP/1.1" 200 None
2026-03-27 10:45:13 [auto1.de] INFO: Scrape type for HP95404: 2
2026-03-27 10:45:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1561db0f-b688-5d18-a454-650b34866fef with identifier: HP95404
2026-03-27 10:45:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1561db0f-b688-5d18-a454-650b34866fef with scrape type 2
2026-03-27 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1561db0f-b688-5d18-a454-650b34866fef with scrape type 2
2026-03-27 10:45:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1561db0f-b688-5d18-a454-650b34866fef, identifier: HP95404
2026-03-27 10:45:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf36ea90>
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_1764769a1246cb8f9ab79f2617ffef2c.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_1764769a1246cb8f9ab79f2617ffef2c.jpg saved to cache
2026-03-27 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab566936-0092-5264-b538-249375a3f4db
2026-03-27 10:45:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1561db0f-b688-5d18-a454-650b34866fef with identifier: HP95404
2026-03-27 10:45:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1561db0f-b688-5d18-a454-650b34866fef with identifier: HP95404
2026-03-27 10:45:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1561db0f-b688-5d18-a454-650b34866fef with identifier: HP95404 to the API
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:44:18Z',
'fuel_type': 'diesel',
'id': '1561db0f-b688-5d18-a454-650b34866fef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP95404',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 109213,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-21',
'seller_name': None,
'title': 'Peugeot 308 1.6 Blue-HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2017}
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP95404%27 HTTP/1.1" 200 None
2026-03-27 10:45:14 [auto1.de] INFO: Saving data for HP95404: {'auction_closing_time': 1774716258.0, 'created_time': 1773341653.53218, 'last_price_update_time': 1774608314.219481}
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP95404') HTTP/1.1" 204 0
2026-03-27 10:45:14 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-27 10:45:14 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB73354%27 HTTP/1.1" 200 None
2026-03-27 10:45:14 [auto1.de] INFO: Scrape type for AB73354: 2
2026-03-27 10:45:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 978f3f63-a1b6-58e1-9375-8b891293ec15 with identifier: AB73354
2026-03-27 10:45:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 978f3f63-a1b6-58e1-9375-8b891293ec15 with scrape type 2
2026-03-27 10:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 978f3f63-a1b6-58e1-9375-8b891293ec15 with scrape type 2
2026-03-27 10:45:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 978f3f63-a1b6-58e1-9375-8b891293ec15, identifier: AB73354
2026-03-27 10:45:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_c3eaaa7511e03be51ebb1f02ba93cce9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_cf02f799cde92443c0f100a69561496f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 978f3f63-a1b6-58e1-9375-8b891293ec15 with identifier: AB73354
2026-03-27 10:45:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 978f3f63-a1b6-58e1-9375-8b891293ec15 with identifier: AB73354
2026-03-27 10:45:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 978f3f63-a1b6-58e1-9375-8b891293ec15 with identifier: AB73354 to the API
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 199,
'expiration_date': '2026-03-28T16:26:48Z',
'fuel_type': 'diesel',
'id': '978f3f63-a1b6-58e1-9375-8b891293ec15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB73354',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 114500,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-17',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six 4Motion',
'transmission': 'automatic',
'trim': 'Generation Six 4Motion',
'year': 2020}
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB73354%27 HTTP/1.1" 200 None
2026-03-27 10:45:14 [auto1.de] INFO: Saving data for AB73354: {'auction_closing_time': 1774715208.0, 'created_time': 1773427360.584378, 'last_price_update_time': 1774608314.870522}
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB73354') HTTP/1.1" 204 0
2026-03-27 10:45:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be29f0d0>
2026-03-27 10:45:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_391b43bdb3a15ce9979ab314d3cfeac4.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_391b43bdb3a15ce9979ab314d3cfeac4.jpg saved to cache
2026-03-27 10:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab566936-0092-5264-b538-249375a3f4db
2026-03-27 10:45:14 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-27 10:45:14 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-27 10:45:14 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ74678%27 HTTP/1.1" 200 None
2026-03-27 10:45:14 [auto1.de] INFO: Scrape type for SZ74678: 2
2026-03-27 10:45:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e002cef3-cd69-5677-9a95-12f44a7e2500 with identifier: SZ74678
2026-03-27 10:45:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e002cef3-cd69-5677-9a95-12f44a7e2500 with scrape type 2
2026-03-27 10:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e002cef3-cd69-5677-9a95-12f44a7e2500 with scrape type 2
2026-03-27 10:45:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e002cef3-cd69-5677-9a95-12f44a7e2500, identifier: SZ74678
2026-03-27 10:45:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e002cef3-cd69-5677-9a95-12f44a7e2500 with identifier: SZ74678
2026-03-27 10:45:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e002cef3-cd69-5677-9a95-12f44a7e2500 with identifier: SZ74678
2026-03-27 10:45:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e002cef3-cd69-5677-9a95-12f44a7e2500 with identifier: SZ74678 to the API
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:58:06Z',
'fuel_type': 'diesel',
'id': 'e002cef3-cd69-5677-9a95-12f44a7e2500',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ74678',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 135389,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-22',
'seller_name': None,
'title': 'Renault Megane 1.6 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2018}
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ74678%27 HTTP/1.1" 200 None
2026-03-27 10:45:15 [auto1.de] INFO: Saving data for SZ74678: {'auction_closing_time': 1774717086.0, 'created_time': 1773946477.792062, 'last_price_update_time': 1774608315.433525}
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ74678') HTTP/1.1" 204 0
2026-03-27 10:45:15 [auto1.de] INFO: Found listing with ID: RT76020
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT76020%27 HTTP/1.1" 200 None
2026-03-27 10:45:15 [auto1.de] INFO: Scrape type for RT76020: 2
2026-03-27 10:45:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc676309-1b4e-5257-8762-693ff4f864a1 with identifier: RT76020
2026-03-27 10:45:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc676309-1b4e-5257-8762-693ff4f864a1 with scrape type 2
2026-03-27 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc676309-1b4e-5257-8762-693ff4f864a1 with scrape type 2
2026-03-27 10:45:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc676309-1b4e-5257-8762-693ff4f864a1, identifier: RT76020
2026-03-27 10:45:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH74073/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be288810>
2026-03-27 10:45:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_c3eaaa7511e03be51ebb1f02ba93cce9.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_c3eaaa7511e03be51ebb1f02ba93cce9.jpg saved to cache
2026-03-27 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab566936-0092-5264-b538-249375a3f4db
2026-03-27 10:45:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf831d0>
2026-03-27 10:45:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_cf02f799cde92443c0f100a69561496f.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_cf02f799cde92443c0f100a69561496f.jpg saved to cache
2026-03-27 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab566936-0092-5264-b538-249375a3f4db
2026-03-27 10:45:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc676309-1b4e-5257-8762-693ff4f864a1 with identifier: RT76020
2026-03-27 10:45:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc676309-1b4e-5257-8762-693ff4f864a1 with identifier: RT76020
2026-03-27 10:45:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc676309-1b4e-5257-8762-693ff4f864a1 with identifier: RT76020 to the API
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-28T16:04:46Z',
'fuel_type': 'petrol',
'id': 'bc676309-1b4e-5257-8762-693ff4f864a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT76020',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Space Star',
'odometer': 73695,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-05',
'seller_name': None,
'title': 'Mitsubishi Space Star 1.2 Diamant Edition+',
'transmission': 'manual',
'trim': 'Diamant Edition+',
'year': 2019}
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT76020%27 HTTP/1.1" 200 None
2026-03-27 10:45:16 [auto1.de] INFO: Saving data for RT76020: {'auction_closing_time': 1774713886.0, 'created_time': 1774467484.714932, 'last_price_update_time': 1774608316.122676}
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT76020') HTTP/1.1" 204 0
2026-03-27 10:45:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_9dc6aa58a506c6c62dbdc558d0162114.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:16 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-27 10:45:16 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-27 10:45:16 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA17140%27 HTTP/1.1" 200 None
2026-03-27 10:45:16 [auto1.de] INFO: Scrape type for SA17140: 2
2026-03-27 10:45:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f30114d-9415-58c7-92e8-2767ed86cde6 with identifier: SA17140
2026-03-27 10:45:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f30114d-9415-58c7-92e8-2767ed86cde6 with scrape type 2
2026-03-27 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f30114d-9415-58c7-92e8-2767ed86cde6 with scrape type 2
2026-03-27 10:45:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f30114d-9415-58c7-92e8-2767ed86cde6, identifier: SA17140
2026-03-27 10:45:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CR29385/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f30114d-9415-58c7-92e8-2767ed86cde6 with identifier: SA17140
2026-03-27 10:45:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f30114d-9415-58c7-92e8-2767ed86cde6 with identifier: SA17140
2026-03-27 10:45:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f30114d-9415-58c7-92e8-2767ed86cde6 with identifier: SA17140 to the API
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:34:00Z',
'fuel_type': 'petrol',
'id': '1f30114d-9415-58c7-92e8-2767ed86cde6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA17140',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse Limousine',
'odometer': 113973,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-13',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse Limousine A 220 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2019}
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA17140%27 HTTP/1.1" 200 None
2026-03-27 10:45:16 [auto1.de] INFO: Saving data for SA17140: {'auction_closing_time': 1774715640.0, 'created_time': 1774033696.031654, 'last_price_update_time': 1774608316.615852}
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA17140') HTTP/1.1" 204 0
2026-03-27 10:45:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:16 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-27 10:45:16 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY78817%27 HTTP/1.1" 200 None
2026-03-27 10:45:16 [auto1.de] INFO: Scrape type for VY78817: 2
2026-03-27 10:45:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a777c48e-71f4-55d1-934e-9c5a1a61975d with identifier: VY78817
2026-03-27 10:45:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a777c48e-71f4-55d1-934e-9c5a1a61975d with scrape type 2
2026-03-27 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a777c48e-71f4-55d1-934e-9c5a1a61975d with scrape type 2
2026-03-27 10:45:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a777c48e-71f4-55d1-934e-9c5a1a61975d, identifier: VY78817
2026-03-27 10:45:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX83628/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a777c48e-71f4-55d1-934e-9c5a1a61975d with identifier: VY78817
2026-03-27 10:45:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a777c48e-71f4-55d1-934e-9c5a1a61975d with identifier: VY78817
2026-03-27 10:45:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a777c48e-71f4-55d1-934e-9c5a1a61975d with identifier: VY78817 to the API
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:03:57Z',
'fuel_type': 'petrol',
'id': 'a777c48e-71f4-55d1-934e-9c5a1a61975d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY78817',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 190290,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-15',
'seller_name': None,
'title': 'Volkswagen Touran 1.2 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2017}
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY78817%27 HTTP/1.1" 200 None
2026-03-27 10:45:17 [auto1.de] INFO: Saving data for VY78817: {'auction_closing_time': 1774713837.0, 'created_time': 1773916878.083809, 'last_price_update_time': 1774608317.116041}
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY78817') HTTP/1.1" 204 0
2026-03-27 10:45:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:17 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-27 10:45:17 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-27 10:45:17 [auto1.de] INFO: Found listing with ID: AY50267
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY50267%27 HTTP/1.1" 200 None
2026-03-27 10:45:17 [auto1.de] INFO: Scrape type for AY50267: 2
2026-03-27 10:45:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b211273d-1071-5ded-b3c1-e6520b779bb6 with identifier: AY50267
2026-03-27 10:45:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b211273d-1071-5ded-b3c1-e6520b779bb6 with scrape type 2
2026-03-27 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b211273d-1071-5ded-b3c1-e6520b779bb6 with scrape type 2
2026-03-27 10:45:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b211273d-1071-5ded-b3c1-e6520b779bb6, identifier: AY50267
2026-03-27 10:45:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf37390>
2026-03-27 10:45:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_9dc6aa58a506c6c62dbdc558d0162114.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_9dc6aa58a506c6c62dbdc558d0162114.jpg saved to cache
2026-03-27 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab566936-0092-5264-b538-249375a3f4db
2026-03-27 10:45:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b211273d-1071-5ded-b3c1-e6520b779bb6 with identifier: AY50267
2026-03-27 10:45:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b211273d-1071-5ded-b3c1-e6520b779bb6 with identifier: AY50267
2026-03-27 10:45:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b211273d-1071-5ded-b3c1-e6520b779bb6 with identifier: AY50267 to the API
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:39:29Z',
'fuel_type': 'diesel',
'id': 'b211273d-1071-5ded-b3c1-e6520b779bb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY50267',
'listing': 'auction',
'make': 'Fiat',
'model': 'Doblo',
'odometer': 133844,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-26',
'seller_name': None,
'title': 'Fiat Doblo 1.3 M-Jet Basis Kasten',
'transmission': 'manual',
'trim': 'Basis Kasten',
'year': 2019}
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY50267%27 HTTP/1.1" 200 None
2026-03-27 10:45:17 [auto1.de] INFO: Saving data for AY50267: {'auction_closing_time': 1774715969.0, 'created_time': 1774467394.748925, 'last_price_update_time': 1774608317.748175}
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY50267') HTTP/1.1" 204 0
2026-03-27 10:45:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_8c6e1dee208602d9fabdf847325bc262.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:17 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP12091%27 HTTP/1.1" 200 None
2026-03-27 10:45:17 [auto1.de] INFO: Scrape type for HP12091: 2
2026-03-27 10:45:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e81ed744-89ee-5f5f-811c-d7066ab082ff with identifier: HP12091
2026-03-27 10:45:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e81ed744-89ee-5f5f-811c-d7066ab082ff with scrape type 2
2026-03-27 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e81ed744-89ee-5f5f-811c-d7066ab082ff with scrape type 2
2026-03-27 10:45:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e81ed744-89ee-5f5f-811c-d7066ab082ff, identifier: HP12091
2026-03-27 10:45:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JL91815> (referer: https://www.auto1.com/v1/car-details-view/JL91815/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY57435> (referer: https://www.auto1.com/v1/car-details-view/AY57435/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e81ed744-89ee-5f5f-811c-d7066ab082ff with identifier: HP12091
2026-03-27 10:45:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e81ed744-89ee-5f5f-811c-d7066ab082ff with identifier: HP12091
2026-03-27 10:45:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e81ed744-89ee-5f5f-811c-d7066ab082ff with identifier: HP12091 to the API
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-03-28T16:10:22Z',
'fuel_type': 'diesel',
'id': 'e81ed744-89ee-5f5f-811c-d7066ab082ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP12091',
'listing': 'auction',
'make': 'Kia',
'model': 'Sorento',
'odometer': 180046,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-03',
'seller_name': None,
'title': 'Kia Sorento 2.2 CRDi Vision 4WD',
'transmission': 'automatic',
'trim': 'Vision 4WD',
'year': 2011}
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP12091%27 HTTP/1.1" 200 None
2026-03-27 10:45:18 [auto1.de] INFO: Saving data for HP12091: {'auction_closing_time': 1774714222.0, 'created_time': 1773304933.369629, 'last_price_update_time': 1774608318.255554}
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP12091') HTTP/1.1" 204 0
2026-03-27 10:45:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:18 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB00515%27 HTTP/1.1" 200 None
2026-03-27 10:45:18 [auto1.de] INFO: Scrape type for PB00515: 2
2026-03-27 10:45:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6e1402e-8925-52ef-934e-c21e55e60c66 with identifier: PB00515
2026-03-27 10:45:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6e1402e-8925-52ef-934e-c21e55e60c66 with scrape type 2
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6e1402e-8925-52ef-934e-c21e55e60c66 with scrape type 2
2026-03-27 10:45:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6e1402e-8925-52ef-934e-c21e55e60c66, identifier: PB00515
2026-03-27 10:45:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6e1402e-8925-52ef-934e-c21e55e60c66 with identifier: PB00515
2026-03-27 10:45:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6e1402e-8925-52ef-934e-c21e55e60c66 with identifier: PB00515
2026-03-27 10:45:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6e1402e-8925-52ef-934e-c21e55e60c66 with identifier: PB00515 to the API
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-28T16:05:45Z',
'fuel_type': 'gas',
'id': 'c6e1402e-8925-52ef-934e-c21e55e60c66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB00515',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 26127,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-28',
'seller_name': None,
'title': 'Dacia Duster 1.0 TCe LPG Journey',
'transmission': 'manual',
'trim': 'Journey',
'year': 2023}
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB00515%27 HTTP/1.1" 200 None
2026-03-27 10:45:18 [auto1.de] INFO: Saving data for PB00515: {'auction_closing_time': 1774713945.0, 'created_time': 1773429143.181395, 'last_price_update_time': 1774608318.697571}
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB00515') HTTP/1.1" 204 0
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf35b0d0>
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_8c6e1dee208602d9fabdf847325bc262.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_8c6e1dee208602d9fabdf847325bc262.jpg saved to cache
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 83e8b967-8a3d-51fd-b23b-05555d728276
2026-03-27 10:45:18 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-27 10:45:18 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-27 10:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_f2f430990ec47190549048c83ebe341d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93b4b4e9-50cb-5882-b364-b47601ed4dc6 with identifier: JL91815
2026-03-27 10:45:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93b4b4e9-50cb-5882-b364-b47601ed4dc6 with scrape type 1
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 93b4b4e9-50cb-5882-b364-b47601ed4dc6
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_45f75f3570bc99f24cb3b0e9304a16ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_45f75f3570bc99f24cb3b0e9304a16ce.jpg not downloaded yet
2026-03-27 10:45:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68658590-2bbf-5ac0-bea9-29e94c7e6106 with identifier: AY57435
2026-03-27 10:45:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68658590-2bbf-5ac0-bea9-29e94c7e6106 with scrape type 1
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68658590-2bbf-5ac0-bea9-29e94c7e6106
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_fa0c10ad126068cf5aa20f3b6c5412d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_fa0c10ad126068cf5aa20f3b6c5412d5.jpg not downloaded yet
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_b070ff33ceac83edd5cbf7525d0eb8f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_b070ff33ceac83edd5cbf7525d0eb8f2.jpg not downloaded yet
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_9336f76eace50d2c9b54a89659b53059.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_9336f76eace50d2c9b54a89659b53059.jpg not downloaded yet
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_abc67f1c8c7251430cbf356f99518281.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_abc67f1c8c7251430cbf356f99518281.jpg not downloaded yet
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_321f05eaa4cbbf8a4f8b5ce8e6c4e5b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_321f05eaa4cbbf8a4f8b5ce8e6c4e5b5.jpg not downloaded yet
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5bfa50>
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_f2f430990ec47190549048c83ebe341d.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_f2f430990ec47190549048c83ebe341d.jpg saved to cache
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 83e8b967-8a3d-51fd-b23b-05555d728276
2026-03-27 10:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_308730ca1bee87b11fd99ce79d33638e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_cb3692503699f566de88f1342c513be2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_cb3692503699f566de88f1342c513be2.jpg not downloaded yet
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_93eb24c256a915b43451ddb61ee6aef1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_93eb24c256a915b43451ddb61ee6aef1.jpg not downloaded yet
2026-03-27 10:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SL27608> (referer: https://www.auto1.com/v1/car-details-view/SL27608/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_5d25bdfcf552fbfe3209b6aaf71eafb3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_5d25bdfcf552fbfe3209b6aaf71eafb3.jpg not downloaded yet
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_e572358c3575e1dbef99f4a2fb6f9013.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_e572358c3575e1dbef99f4a2fb6f9013.jpg not downloaded yet
2026-03-27 10:45:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_f15aae59ca51538f6d3edb8f71e69977.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_f15aae59ca51538f6d3edb8f71e69977.jpg not downloaded yet
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_cac7f7b4927bea64e190f56034a46246.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_cac7f7b4927bea64e190f56034a46246.jpg not downloaded yet
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_403d58c4b9abd6de58d5bc97708ed7d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_403d58c4b9abd6de58d5bc97708ed7d6.jpg not downloaded yet
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_e0fb89cfa4f987b314e0e25104229957.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_e0fb89cfa4f987b314e0e25104229957.jpg not downloaded yet
2026-03-27 10:45:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2dda90>
2026-03-27 10:45:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F6a%252Fef6a466ce0eec6d42322fe8a53a9b3b8%252Fpa%252FGP68218_308730ca1bee87b11fd99ce79d33638e.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_308730ca1bee87b11fd99ce79d33638e.jpg saved to cache
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab566936-0092-5264-b538-249375a3f4db
2026-03-27 10:45:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab566936-0092-5264-b538-249375a3f4db, skipping ID generation
2026-03-27 10:45:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab566936-0092-5264-b538-249375a3f4db with scrape type 1
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab566936-0092-5264-b538-249375a3f4db sending to next pipeline
2026-03-27 10:45:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab566936-0092-5264-b538-249375a3f4db, identifier: GP68218
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_b99eeed546e8d86538659cee65a24bb4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_b99eeed546e8d86538659cee65a24bb4.jpg not downloaded yet
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_c53c8c0f49536fa362dd8d8e131f3f83.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_c53c8c0f49536fa362dd8d8e131f3f83.jpg not downloaded yet
2026-03-27 10:45:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab566936-0092-5264-b538-249375a3f4db with identifier: GP68218
2026-03-27 10:45:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab566936-0092-5264-b538-249375a3f4db with identifier: GP68218
2026-03-27 10:45:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab566936-0092-5264-b538-249375a3f4db with identifier: GP68218 to the API
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_308730ca1bee87b11fd99ce79d33638e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:25:46Z',
'fuel_type': 'petrol',
'id': 'ab566936-0092-5264-b538-249375a3f4db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP68218',
'listing': 'auction',
'location': 'DE, Gummersbach',
'make': 'Kia',
'model': 'Soul',
'odometer': 164483,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68335,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_9dc6aa58a506c6c62dbdc558d0162114.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60740,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_cf02f799cde92443c0f100a69561496f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61825,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_c3eaaa7511e03be51ebb1f02ba93cce9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_391b43bdb3a15ce9979ab314d3cfeac4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_1764769a1246cb8f9ab79f2617ffef2c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77382,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_81f376591f72f94a335d4aeedc41db98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_461638faa50d0f3ac568bc0c4e31ff39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2480981,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_308730ca1bee87b11fd99ce79d33638e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56876,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_c1819069e331aa55bed1b60035016138.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab566936-0092-5264-b538-249375a3f4db/ab566936-0092-5264-b538-249375a3f4db_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52698,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/6a/ef6a466ce0eec6d42322fe8a53a9b3b8/pa/GP68218_e3febf875518529e8cf533bfd1646312.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-08-07',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Soul 1.6 GDI Spirit',
'transmission': 'manual',
'trim': 'Spirit',
'year': 2012}
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP68218%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [auto1.de] INFO: Saving data for GP68218: {'created_time': 1774608319.837379, 'last_price_update_time': 1774608319.837397, 'auction_closing_time': 1774715146.0}
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP68218') HTTP/1.1" 204 0
2026-03-27 10:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_93eb24c256a915b43451ddb61ee6aef1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ea41838-591c-53a9-bb05-24d745d48a1e with identifier: SL27608
2026-03-27 10:45:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ea41838-591c-53a9-bb05-24d745d48a1e with scrape type 1
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ea41838-591c-53a9-bb05-24d745d48a1e
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F90%252F8a9078ee4e24cebb01e537a22c6420ab%252Fpa%252FSL27608_63cfc210abfca21c204ad39c91be3102.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_63cfc210abfca21c204ad39c91be3102.jpg already downloaded
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F90%252F8a9078ee4e24cebb01e537a22c6420ab%252Fpa%252FSL27608_b6b862fde26006981613662af23b19e9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_b6b862fde26006981613662af23b19e9.jpg already downloaded
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F90%252F8a9078ee4e24cebb01e537a22c6420ab%252Fpa%252FSL27608_3a8383b27e2047e7fe01f2341a54a05c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_3a8383b27e2047e7fe01f2341a54a05c.jpg already downloaded
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F90%252F8a9078ee4e24cebb01e537a22c6420ab%252Fpa%252FSL27608_b2938b482608d615d650ca20e835bcdd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_b2938b482608d615d650ca20e835bcdd.jpg already downloaded
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F90%252F8a9078ee4e24cebb01e537a22c6420ab%252Fpa%252FSL27608_6be86f6ddffb65b7c871b4350b45bd02.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_6be86f6ddffb65b7c871b4350b45bd02.jpg already downloaded
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F90%252F8a9078ee4e24cebb01e537a22c6420ab%252Fpa%252FSL27608_1298c97ca5f03c5a9eea774aad37a5bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_1298c97ca5f03c5a9eea774aad37a5bf.jpg already downloaded
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F90%252F8a9078ee4e24cebb01e537a22c6420ab%252Fpa%252FSL27608_6b2543ae5496b3a4513541a9d9528586.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_6b2543ae5496b3a4513541a9d9528586.jpg already downloaded
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F90%252F8a9078ee4e24cebb01e537a22c6420ab%252Fpa%252FSL27608_63c84f4d6c92ae5603ab7d9ecafb4b31.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_63c84f4d6c92ae5603ab7d9ecafb4b31.jpg already downloaded
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F90%252F8a9078ee4e24cebb01e537a22c6420ab%252Fpa%252FSL27608_d7b32814883add43d2fc36fe15f058b7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_d7b32814883add43d2fc36fe15f058b7.jpg already downloaded
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F90%252F8a9078ee4e24cebb01e537a22c6420ab%252Fpa%252FSL27608_a027bf6b77815c46a265e5b04c6bf94f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_a027bf6b77815c46a265e5b04c6bf94f.jpg already downloaded
2026-03-27 10:45:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ea41838-591c-53a9-bb05-24d745d48a1e, identifier: SL27608
2026-03-27 10:45:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_321f05eaa4cbbf8a4f8b5ce8e6c4e5b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_6c8630af8054ad0db49ba96490bda0d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_6c8630af8054ad0db49ba96490bda0d5.jpg not downloaded yet
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_cef5777f9058d089ff4877510e9ab2d2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_cef5777f9058d089ff4877510e9ab2d2.jpg not downloaded yet
2026-03-27 10:45:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP68778/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ea41838-591c-53a9-bb05-24d745d48a1e with identifier: SL27608
2026-03-27 10:45:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ea41838-591c-53a9-bb05-24d745d48a1e with identifier: SL27608
2026-03-27 10:45:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ea41838-591c-53a9-bb05-24d745d48a1e with identifier: SL27608 to the API
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SL27608>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 80,
'expiration_date': '2026-03-28T16:35:00Z',
'fuel_type': 'petrol',
'id': '8ea41838-591c-53a9-bb05-24d745d48a1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL27608',
'listing': 'auction',
'location': 'DE, Kippenheim',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 91083,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_63cfc210abfca21c204ad39c91be3102.jpg',
'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_b6b862fde26006981613662af23b19e9.jpg',
'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_3a8383b27e2047e7fe01f2341a54a05c.jpg',
'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_b2938b482608d615d650ca20e835bcdd.jpg',
'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_6be86f6ddffb65b7c871b4350b45bd02.jpg',
'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_1298c97ca5f03c5a9eea774aad37a5bf.jpg',
'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_6b2543ae5496b3a4513541a9d9528586.jpg',
'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_63c84f4d6c92ae5603ab7d9ecafb4b31.jpg',
'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_d7b32814883add43d2fc36fe15f058b7.jpg',
'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_a027bf6b77815c46a265e5b04c6bf94f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea41838-591c-53a9-bb05-24d745d48a1e/8ea41838-591c-53a9-bb05-24d745d48a1e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_63cfc210abfca21c204ad39c91be3102.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea41838-591c-53a9-bb05-24d745d48a1e/8ea41838-591c-53a9-bb05-24d745d48a1e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2013446,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_b6b862fde26006981613662af23b19e9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea41838-591c-53a9-bb05-24d745d48a1e/8ea41838-591c-53a9-bb05-24d745d48a1e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68394,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_3a8383b27e2047e7fe01f2341a54a05c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea41838-591c-53a9-bb05-24d745d48a1e/8ea41838-591c-53a9-bb05-24d745d48a1e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_b2938b482608d615d650ca20e835bcdd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea41838-591c-53a9-bb05-24d745d48a1e/8ea41838-591c-53a9-bb05-24d745d48a1e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65348,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_6be86f6ddffb65b7c871b4350b45bd02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea41838-591c-53a9-bb05-24d745d48a1e/8ea41838-591c-53a9-bb05-24d745d48a1e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_1298c97ca5f03c5a9eea774aad37a5bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea41838-591c-53a9-bb05-24d745d48a1e/8ea41838-591c-53a9-bb05-24d745d48a1e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_6b2543ae5496b3a4513541a9d9528586.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea41838-591c-53a9-bb05-24d745d48a1e/8ea41838-591c-53a9-bb05-24d745d48a1e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2026692,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_63c84f4d6c92ae5603ab7d9ecafb4b31.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea41838-591c-53a9-bb05-24d745d48a1e/8ea41838-591c-53a9-bb05-24d745d48a1e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77027,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_d7b32814883add43d2fc36fe15f058b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea41838-591c-53a9-bb05-24d745d48a1e/8ea41838-591c-53a9-bb05-24d745d48a1e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/90/8a9078ee4e24cebb01e537a22c6420ab/pa/SL27608_a027bf6b77815c46a265e5b04c6bf94f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-02-21',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2010}
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL27608%27 HTTP/1.1" 200 None
2026-03-27 10:45:20 [auto1.de] INFO: Saving data for SL27608: {'created_time': 1774608320.578145, 'last_price_update_time': 1774608320.578159, 'auction_closing_time': 1774715700.0}
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL27608') HTTP/1.1" 204 0
2026-03-27 10:45:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD28576> (referer: https://www.auto1.com/v1/car-details-view/ZD28576/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_057e79a02ef8e05516b883bd91367a8d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_057e79a02ef8e05516b883bd91367a8d.jpg not downloaded yet
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_bc38d12833ea8e8954d009c55eeb3f26.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_bc38d12833ea8e8954d009c55eeb3f26.jpg not downloaded yet
2026-03-27 10:45:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3892d0>
2026-03-27 10:45:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_93eb24c256a915b43451ddb61ee6aef1.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_93eb24c256a915b43451ddb61ee6aef1.jpg saved to cache
2026-03-27 10:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68658590-2bbf-5ac0-bea9-29e94c7e6106
2026-03-27 10:45:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be00ae10>
2026-03-27 10:45:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_321f05eaa4cbbf8a4f8b5ce8e6c4e5b5.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_321f05eaa4cbbf8a4f8b5ce8e6c4e5b5.jpg saved to cache
2026-03-27 10:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68658590-2bbf-5ac0-bea9-29e94c7e6106
2026-03-27 10:45:20 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 10544 | hits on page: 40
2026-03-27 10:45:20 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-27 10:45:20 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-27 10:45:20 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE10872%27 HTTP/1.1" 200 None
2026-03-27 10:45:20 [auto1.de] INFO: Scrape type for ZE10872: 2
2026-03-27 10:45:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452 with identifier: ZE10872
2026-03-27 10:45:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452 with scrape type 2
2026-03-27 10:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452 with scrape type 2
2026-03-27 10:45:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452, identifier: ZE10872
2026-03-27 10:45:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452 with identifier: ZE10872
2026-03-27 10:45:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452 with identifier: ZE10872
2026-03-27 10:45:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452 with identifier: ZE10872 to the API
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:03:30Z',
'fuel_type': 'diesel',
'id': '8c18dfa4-0fa0-52d4-a3d9-3f42e8c4d452',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE10872',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 237976,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-13',
'seller_name': None,
'title': 'BMW 5er 520d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2016}
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE10872%27 HTTP/1.1" 200 None
2026-03-27 10:45:21 [auto1.de] INFO: Saving data for ZE10872: {'auction_closing_time': 1774713810.0, 'created_time': 1774031832.62569, 'last_price_update_time': 1774608321.292625}
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE10872') HTTP/1.1" 204 0
2026-03-27 10:45:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 643c22f9-9c40-5d40-9c79-b4aaf666f822 with identifier: ZD28576
2026-03-27 10:45:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 643c22f9-9c40-5d40-9c79-b4aaf666f822 with scrape type 1
2026-03-27 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 643c22f9-9c40-5d40-9c79-b4aaf666f822
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_87924bedb64294ec2e2178dd4dd68cab.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_87924bedb64294ec2e2178dd4dd68cab.jpg not downloaded yet
2026-03-27 10:45:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_403d58c4b9abd6de58d5bc97708ed7d6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:21 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-27 10:45:21 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-27 10:45:21 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-27 10:45:21 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE44500%27 HTTP/1.1" 200 None
2026-03-27 10:45:21 [auto1.de] INFO: Scrape type for VE44500: 2
2026-03-27 10:45:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a with identifier: VE44500
2026-03-27 10:45:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a with scrape type 2
2026-03-27 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a with scrape type 2
2026-03-27 10:45:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a, identifier: VE44500
2026-03-27 10:45:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_e0fb89cfa4f987b314e0e25104229957.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_c53c8c0f49536fa362dd8d8e131f3f83.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_b99eeed546e8d86538659cee65a24bb4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a with identifier: VE44500
2026-03-27 10:45:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a with identifier: VE44500
2026-03-27 10:45:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3de96f9d-f83e-52e8-a07b-8dd38e2cb28a with identifier: VE44500 to the API
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:27:15Z',
'fuel_type': 'petrol',
'id': '3de96f9d-f83e-52e8-a07b-8dd38e2cb28a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE44500',
'listing': 'auction',
'make': 'Opel',
'model': 'Adam',
'odometer': 104180,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-29',
'seller_name': None,
'title': 'Opel Adam 1.4 Turbo S',
'transmission': 'manual',
'trim': 'S',
'year': 2018}
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE44500%27 HTTP/1.1" 200 None
2026-03-27 10:45:21 [auto1.de] INFO: Saving data for VE44500: {'auction_closing_time': 1774715235.0, 'created_time': 1774468161.16167, 'last_price_update_time': 1774608321.885431}
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE44500') HTTP/1.1" 204 0
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_6d59ae0abb25877b42e004c0ce32493a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_6d59ae0abb25877b42e004c0ce32493a.jpg not downloaded yet
2026-03-27 10:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_cef5777f9058d089ff4877510e9ab2d2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:22 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-27 10:45:22 [auto1.de] INFO: Found listing with ID: KS08572
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS08572%27 HTTP/1.1" 200 None
2026-03-27 10:45:22 [auto1.de] INFO: Scrape type for KS08572: 2
2026-03-27 10:45:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fd6e3de-1a77-5330-9242-b7fb50f23bf9 with identifier: KS08572
2026-03-27 10:45:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fd6e3de-1a77-5330-9242-b7fb50f23bf9 with scrape type 2
2026-03-27 10:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fd6e3de-1a77-5330-9242-b7fb50f23bf9 with scrape type 2
2026-03-27 10:45:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3fd6e3de-1a77-5330-9242-b7fb50f23bf9, identifier: KS08572
2026-03-27 10:45:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3fd6e3de-1a77-5330-9242-b7fb50f23bf9 with identifier: KS08572
2026-03-27 10:45:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3fd6e3de-1a77-5330-9242-b7fb50f23bf9 with identifier: KS08572
2026-03-27 10:45:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3fd6e3de-1a77-5330-9242-b7fb50f23bf9 with identifier: KS08572 to the API
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 370,
'expiration_date': '2026-03-28T16:33:57Z',
'fuel_type': 'petrol',
'id': '3fd6e3de-1a77-5330-9242-b7fb50f23bf9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS08572',
'listing': 'auction',
'make': 'Kia',
'model': 'Stinger',
'odometer': 36660,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-31',
'seller_name': None,
'title': 'Kia Stinger 3.3 V6 TGDI GT 4WD',
'transmission': 'automatic',
'trim': 'GT 4WD',
'year': 2018}
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS08572%27 HTTP/1.1" 200 None
2026-03-27 10:45:22 [auto1.de] INFO: Saving data for KS08572: {'auction_closing_time': 1774715637.0, 'created_time': 1774435406.685547, 'last_price_update_time': 1774608322.541845}
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS08572') HTTP/1.1" 204 0
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_023b78b2429299623da0faad1c5be766.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_023b78b2429299623da0faad1c5be766.jpg not downloaded yet
2026-03-27 10:45:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0ada50>
2026-03-27 10:45:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_403d58c4b9abd6de58d5bc97708ed7d6.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_403d58c4b9abd6de58d5bc97708ed7d6.jpg saved to cache
2026-03-27 10:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 93b4b4e9-50cb-5882-b364-b47601ed4dc6
2026-03-27 10:45:22 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-27 10:45:22 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-27 10:45:22 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-27 10:45:22 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-27 10:45:22 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-27 10:45:22 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-27 10:45:22 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-27 10:45:22 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-27 10:45:22 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN04335%27 HTTP/1.1" 200 None
2026-03-27 10:45:22 [auto1.de] INFO: Scrape type for ZN04335: 2
2026-03-27 10:45:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64a51235-0f1f-53a6-bceb-284a0ab7ca50 with identifier: ZN04335
2026-03-27 10:45:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64a51235-0f1f-53a6-bceb-284a0ab7ca50 with scrape type 2
2026-03-27 10:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64a51235-0f1f-53a6-bceb-284a0ab7ca50 with scrape type 2
2026-03-27 10:45:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64a51235-0f1f-53a6-bceb-284a0ab7ca50, identifier: ZN04335
2026-03-27 10:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XN26589/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64a51235-0f1f-53a6-bceb-284a0ab7ca50 with identifier: ZN04335
2026-03-27 10:45:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64a51235-0f1f-53a6-bceb-284a0ab7ca50 with identifier: ZN04335
2026-03-27 10:45:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64a51235-0f1f-53a6-bceb-284a0ab7ca50 with identifier: ZN04335 to the API
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:15:37Z',
'fuel_type': 'diesel',
'id': '64a51235-0f1f-53a6-bceb-284a0ab7ca50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN04335',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 224947,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-28',
'seller_name': None,
'title': 'Audi A4 2.0 TDIe Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2011}
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN04335%27 HTTP/1.1" 200 None
2026-03-27 10:45:23 [auto1.de] INFO: Saving data for ZN04335: {'auction_closing_time': 1774714537.0, 'created_time': 1773225996.144559, 'last_price_update_time': 1774608323.167725}
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN04335') HTTP/1.1" 204 0
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_d2a691c204fbc59e7f35f01773631f24.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_d2a691c204fbc59e7f35f01773631f24.jpg not downloaded yet
2026-03-27 10:45:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf36b490>
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_e0fb89cfa4f987b314e0e25104229957.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_e0fb89cfa4f987b314e0e25104229957.jpg saved to cache
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 68658590-2bbf-5ac0-bea9-29e94c7e6106
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be031e10>
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_c53c8c0f49536fa362dd8d8e131f3f83.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_c53c8c0f49536fa362dd8d8e131f3f83.jpg saved to cache
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 68658590-2bbf-5ac0-bea9-29e94c7e6106
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf06290>
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_b99eeed546e8d86538659cee65a24bb4.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_b99eeed546e8d86538659cee65a24bb4.jpg saved to cache
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 93b4b4e9-50cb-5882-b364-b47601ed4dc6
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be194ad0>
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_cef5777f9058d089ff4877510e9ab2d2.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_cef5777f9058d089ff4877510e9ab2d2.jpg saved to cache
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 68658590-2bbf-5ac0-bea9-29e94c7e6106
2026-03-27 10:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_bc38d12833ea8e8954d009c55eeb3f26.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:23 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-27 10:45:23 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-27 10:45:23 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR60766%27 HTTP/1.1" 200 None
2026-03-27 10:45:23 [auto1.de] INFO: Scrape type for JR60766: 2
2026-03-27 10:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b603c23-5c31-5308-b575-782f1fdea21f with identifier: JR60766
2026-03-27 10:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b603c23-5c31-5308-b575-782f1fdea21f with scrape type 2
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b603c23-5c31-5308-b575-782f1fdea21f with scrape type 2
2026-03-27 10:45:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b603c23-5c31-5308-b575-782f1fdea21f, identifier: JR60766
2026-03-27 10:45:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b603c23-5c31-5308-b575-782f1fdea21f with identifier: JR60766
2026-03-27 10:45:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b603c23-5c31-5308-b575-782f1fdea21f with identifier: JR60766
2026-03-27 10:45:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b603c23-5c31-5308-b575-782f1fdea21f with identifier: JR60766 to the API
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:06:37Z',
'fuel_type': 'petrol',
'id': '4b603c23-5c31-5308-b575-782f1fdea21f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR60766',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 115661,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-06',
'seller_name': None,
'title': 'Audi Q3 2.0 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2013}
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR60766%27 HTTP/1.1" 200 None
2026-03-27 10:45:24 [auto1.de] INFO: Saving data for JR60766: {'auction_closing_time': 1774713997.0, 'created_time': 1773400661.702349, 'last_price_update_time': 1774608324.081121}
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR60766') HTTP/1.1" 204 0
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_f104beb4e6e02bf18627e284e7aee8b7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_f104beb4e6e02bf18627e284e7aee8b7.jpg not downloaded yet
2026-03-27 10:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_057e79a02ef8e05516b883bd91367a8d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:24 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM66386%27 HTTP/1.1" 200 None
2026-03-27 10:45:24 [auto1.de] INFO: Scrape type for TM66386: 2
2026-03-27 10:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7da4cd20-cd91-5649-8777-b14c8f2ea840 with identifier: TM66386
2026-03-27 10:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7da4cd20-cd91-5649-8777-b14c8f2ea840 with scrape type 2
2026-03-27 10:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7da4cd20-cd91-5649-8777-b14c8f2ea840 with scrape type 2
2026-03-27 10:45:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7da4cd20-cd91-5649-8777-b14c8f2ea840, identifier: TM66386
2026-03-27 10:45:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7da4cd20-cd91-5649-8777-b14c8f2ea840 with identifier: TM66386
2026-03-27 10:45:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7da4cd20-cd91-5649-8777-b14c8f2ea840 with identifier: TM66386
2026-03-27 10:45:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7da4cd20-cd91-5649-8777-b14c8f2ea840 with identifier: TM66386 to the API
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-28T16:12:28Z',
'fuel_type': 'diesel',
'id': '7da4cd20-cd91-5649-8777-b14c8f2ea840',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM66386',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 119550,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-06',
'seller_name': None,
'title': 'BMW X3 xDrive 30d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2017}
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM66386%27 HTTP/1.1" 200 None
2026-03-27 10:45:24 [auto1.de] INFO: Saving data for TM66386: {'auction_closing_time': 1774714348.0, 'created_time': 1774349825.70511, 'last_price_update_time': 1774608324.669884}
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM66386') HTTP/1.1" 204 0
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_47cdb8e163e7e131931462180e0a9685.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_47cdb8e163e7e131931462180e0a9685.jpg not downloaded yet
2026-03-27 10:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be248bd0>
2026-03-27 10:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_bc38d12833ea8e8954d009c55eeb3f26.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_bc38d12833ea8e8954d009c55eeb3f26.jpg saved to cache
2026-03-27 10:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 68658590-2bbf-5ac0-bea9-29e94c7e6106
2026-03-27 10:45:24 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH24339%27 HTTP/1.1" 200 None
2026-03-27 10:45:24 [auto1.de] INFO: Scrape type for MH24339: 2
2026-03-27 10:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acea335d-749a-573e-9503-5e65dd24a15c with identifier: MH24339
2026-03-27 10:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acea335d-749a-573e-9503-5e65dd24a15c with scrape type 2
2026-03-27 10:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acea335d-749a-573e-9503-5e65dd24a15c with scrape type 2
2026-03-27 10:45:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acea335d-749a-573e-9503-5e65dd24a15c, identifier: MH24339
2026-03-27 10:45:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acea335d-749a-573e-9503-5e65dd24a15c with identifier: MH24339
2026-03-27 10:45:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acea335d-749a-573e-9503-5e65dd24a15c with identifier: MH24339
2026-03-27 10:45:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acea335d-749a-573e-9503-5e65dd24a15c with identifier: MH24339 to the API
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:01:26Z',
'fuel_type': 'diesel',
'id': 'acea335d-749a-573e-9503-5e65dd24a15c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH24339',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 300246,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-02',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 220 Shooting Brake',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH24339%27 HTTP/1.1" 200 None
2026-03-27 10:45:25 [auto1.de] INFO: Saving data for MH24339: {'auction_closing_time': 1774713686.0, 'created_time': 1773859421.609044, 'last_price_update_time': 1774608325.230375}
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH24339') HTTP/1.1" 204 0
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_1a8bb86320846fe518a891fefea321fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_1a8bb86320846fe518a891fefea321fd.jpg not downloaded yet
2026-03-27 10:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5ec6d0>
2026-03-27 10:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_057e79a02ef8e05516b883bd91367a8d.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_057e79a02ef8e05516b883bd91367a8d.jpg saved to cache
2026-03-27 10:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 93b4b4e9-50cb-5882-b364-b47601ed4dc6
2026-03-27 10:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_d2a691c204fbc59e7f35f01773631f24.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_6d59ae0abb25877b42e004c0ce32493a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:25 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS94316%27 HTTP/1.1" 200 None
2026-03-27 10:45:25 [auto1.de] INFO: Scrape type for KS94316: 2
2026-03-27 10:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbf4f19c-9a14-54c3-8293-93f7d40e4257 with identifier: KS94316
2026-03-27 10:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbf4f19c-9a14-54c3-8293-93f7d40e4257 with scrape type 2
2026-03-27 10:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbf4f19c-9a14-54c3-8293-93f7d40e4257 with scrape type 2
2026-03-27 10:45:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbf4f19c-9a14-54c3-8293-93f7d40e4257, identifier: KS94316
2026-03-27 10:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM89812> (referer: https://www.auto1.com/v1/car-details-view/LM89812/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbf4f19c-9a14-54c3-8293-93f7d40e4257 with identifier: KS94316
2026-03-27 10:45:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbf4f19c-9a14-54c3-8293-93f7d40e4257 with identifier: KS94316
2026-03-27 10:45:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbf4f19c-9a14-54c3-8293-93f7d40e4257 with identifier: KS94316 to the API
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:05:40Z',
'fuel_type': 'gas',
'id': 'bbf4f19c-9a14-54c3-8293-93f7d40e4257',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS94316',
'listing': 'auction',
'make': 'Opel',
'model': 'Combo',
'odometer': 77698,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-25',
'seller_name': None,
'title': 'Opel Combo 1.4 Turbo Kasten L1H1 2,4t',
'transmission': 'manual',
'trim': 'Kasten L1H1 2,4t',
'year': 2014}
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS94316%27 HTTP/1.1" 200 None
2026-03-27 10:45:25 [auto1.de] INFO: Saving data for KS94316: {'auction_closing_time': 1774713940.0, 'created_time': 1772725963.182595, 'last_price_update_time': 1774608325.813466}
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS94316') HTTP/1.1" 204 0
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_e5a9b945db9655108d427fcaf9162e64.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_e5a9b945db9655108d427fcaf9162e64.jpg not downloaded yet
2026-03-27 10:45:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:25 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR21224%27 HTTP/1.1" 200 None
2026-03-27 10:45:25 [auto1.de] INFO: Scrape type for JR21224: 2
2026-03-27 10:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72ccc8b5-084f-5d38-95de-9803e74d340e with identifier: JR21224
2026-03-27 10:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72ccc8b5-084f-5d38-95de-9803e74d340e with scrape type 2
2026-03-27 10:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72ccc8b5-084f-5d38-95de-9803e74d340e with scrape type 2
2026-03-27 10:45:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72ccc8b5-084f-5d38-95de-9803e74d340e, identifier: JR21224
2026-03-27 10:45:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72ccc8b5-084f-5d38-95de-9803e74d340e with identifier: JR21224
2026-03-27 10:45:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72ccc8b5-084f-5d38-95de-9803e74d340e with identifier: JR21224
2026-03-27 10:45:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72ccc8b5-084f-5d38-95de-9803e74d340e with identifier: JR21224 to the API
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:33:39Z',
'fuel_type': 'petrol',
'id': '72ccc8b5-084f-5d38-95de-9803e74d340e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR21224',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 152431,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-11',
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'year': 2019}
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR21224%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [auto1.de] INFO: Saving data for JR21224: {'auction_closing_time': 1774715619.0, 'created_time': 1774349484.681611, 'last_price_update_time': 1774608326.393932}
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR21224') HTTP/1.1" 204 0
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_9e4e8a16036e22a02037bede24b7ba9d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_9e4e8a16036e22a02037bede24b7ba9d.jpg not downloaded yet
2026-03-27 10:45:26 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-27 10:45:26 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-27 10:45:26 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59954%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [auto1.de] INFO: Scrape type for XA59954: 0
2026-03-27 10:45:26 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ93039%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [auto1.de] INFO: Scrape type for DZ93039: 0
2026-03-27 10:45:26 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-27 10:45:26 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB74696%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [auto1.de] INFO: Scrape type for NB74696: 0
2026-03-27 10:45:26 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-27 10:45:26 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-27 10:45:26 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-27 10:45:26 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-27 10:45:26 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-27 10:45:26 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-27 10:45:26 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ18760%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [auto1.de] INFO: Scrape type for LJ18760: 0
2026-03-27 10:45:26 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS70073%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [auto1.de] INFO: Scrape type for VS70073: 0
2026-03-27 10:45:26 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV72825%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [auto1.de] INFO: Scrape type for BV72825: 0
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2df7d0>
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_d2a691c204fbc59e7f35f01773631f24.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_d2a691c204fbc59e7f35f01773631f24.jpg saved to cache
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 643c22f9-9c40-5d40-9c79-b4aaf666f822
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf35b410>
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_6d59ae0abb25877b42e004c0ce32493a.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_6d59ae0abb25877b42e004c0ce32493a.jpg saved to cache
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 643c22f9-9c40-5d40-9c79-b4aaf666f822
2026-03-27 10:45:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 with identifier: LM89812
2026-03-27 10:45:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 with scrape type 1
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8b7c7c3b-1990-537a-8d75-d46f7fda4b09
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fcf%252Ffdcf73d660d4a17ae185e665514abc91%252Fpa%252FLM89812_583e8a3417397b3776181823dddb7de4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_583e8a3417397b3776181823dddb7de4.jpg not downloaded yet
2026-03-27 10:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_1a8bb86320846fe518a891fefea321fd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_c5a37eb487ad0a2c1cee3ae24eb62612.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_c5a37eb487ad0a2c1cee3ae24eb62612.jpg not downloaded yet
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fcf%252Ffdcf73d660d4a17ae185e665514abc91%252Fpa%252FLM89812_97f9a68a47b502b3ea1315f4fe3785e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_97f9a68a47b502b3ea1315f4fe3785e2.jpg not downloaded yet
2026-03-27 10:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CR29385> (referer: https://www.auto1.com/v1/car-details-view/CR29385/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fcf%252Ffdcf73d660d4a17ae185e665514abc91%252Fpa%252FLM89812_ac4fece09867b5c5a7cafd1b71f55332.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_ac4fece09867b5c5a7cafd1b71f55332.jpg not downloaded yet
2026-03-27 10:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_f621442fe68da84898f515257506ec8e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fcf%252Ffdcf73d660d4a17ae185e665514abc91%252Fpa%252FLM89812_7eb78775831f777dafe1f57ae3c0b820.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_7eb78775831f777dafe1f57ae3c0b820.jpg not downloaded yet
2026-03-27 10:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY13477> (referer: https://www.auto1.com/v1/car-details-view/UY13477/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fcf%252Ffdcf73d660d4a17ae185e665514abc91%252Fpa%252FLM89812_fa6e0ab0898875881bc3799e6d55bd14.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_fa6e0ab0898875881bc3799e6d55bd14.jpg not downloaded yet
2026-03-27 10:45:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_583e8a3417397b3776181823dddb7de4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0cc4d0>
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_1a8bb86320846fe518a891fefea321fd.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_1a8bb86320846fe518a891fefea321fd.jpg saved to cache
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 643c22f9-9c40-5d40-9c79-b4aaf666f822
2026-03-27 10:45:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac3d4731-f68c-59c7-9a4c-4f683965d7df with identifier: CR29385
2026-03-27 10:45:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3d4731-f68c-59c7-9a4c-4f683965d7df with scrape type 1
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac3d4731-f68c-59c7-9a4c-4f683965d7df
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F18%252F63180abaf6d81350e88c831a067da27e%252Fpa%252FCR29385_3ab1c8bf986f2949e0874646daba4ce2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_3ab1c8bf986f2949e0874646daba4ce2.jpg already downloaded
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F18%252F63180abaf6d81350e88c831a067da27e%252Fpa%252FCR29385_ba6751d685ba796f56b796bd57e9aaed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_ba6751d685ba796f56b796bd57e9aaed.jpg already downloaded
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F18%252F63180abaf6d81350e88c831a067da27e%252Fpa%252FCR29385_49315ef1831ed4bdb20288396598c76e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_49315ef1831ed4bdb20288396598c76e.jpg already downloaded
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F18%252F63180abaf6d81350e88c831a067da27e%252Fpa%252FCR29385_a39602b37fc46e7b6d928421417aac02.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_a39602b37fc46e7b6d928421417aac02.jpg already downloaded
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F18%252F63180abaf6d81350e88c831a067da27e%252Fpa%252FCR29385_7f613ed136942c4f53b8662a3b27685e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_7f613ed136942c4f53b8662a3b27685e.jpg already downloaded
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F18%252F63180abaf6d81350e88c831a067da27e%252Fpa%252FCR29385_8534b63abd1a7e18c720b9607401053f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_8534b63abd1a7e18c720b9607401053f.jpg already downloaded
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F18%252F63180abaf6d81350e88c831a067da27e%252Fpa%252FCR29385_b6bd96a1da4e6d2594e96ee2cedfc9d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_b6bd96a1da4e6d2594e96ee2cedfc9d1.jpg already downloaded
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F18%252F63180abaf6d81350e88c831a067da27e%252Fpa%252FCR29385_17386cc123cfc7fb7088ef60dd528f47.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_17386cc123cfc7fb7088ef60dd528f47.jpg already downloaded
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F18%252F63180abaf6d81350e88c831a067da27e%252Fpa%252FCR29385_9fbfd7d6120bbc8a8cd25369e9a278b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_9fbfd7d6120bbc8a8cd25369e9a278b2.jpg already downloaded
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F18%252F63180abaf6d81350e88c831a067da27e%252Fpa%252FCR29385_082f3401ff58c2d7bbae56fbbd930a7e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_082f3401ff58c2d7bbae56fbbd930a7e.jpg already downloaded
2026-03-27 10:45:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac3d4731-f68c-59c7-9a4c-4f683965d7df, identifier: CR29385
2026-03-27 10:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_7eb78775831f777dafe1f57ae3c0b820.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac3d4731-f68c-59c7-9a4c-4f683965d7df with identifier: CR29385
2026-03-27 10:45:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac3d4731-f68c-59c7-9a4c-4f683965d7df with identifier: CR29385
2026-03-27 10:45:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac3d4731-f68c-59c7-9a4c-4f683965d7df with identifier: CR29385 to the API
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CR29385>
{'auction_title': '',
'c_o_2_emission_value': 186,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 227,
'expiration_date': '2026-03-28T16:54:22Z',
'fuel_type': 'petrol',
'id': 'ac3d4731-f68c-59c7-9a4c-4f683965d7df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR29385',
'listing': 'auction',
'location': 'DE, Dortmund',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 34263,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_3ab1c8bf986f2949e0874646daba4ce2.jpg',
'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_ba6751d685ba796f56b796bd57e9aaed.jpg',
'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_49315ef1831ed4bdb20288396598c76e.jpg',
'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_a39602b37fc46e7b6d928421417aac02.jpg',
'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_7f613ed136942c4f53b8662a3b27685e.jpg',
'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_8534b63abd1a7e18c720b9607401053f.jpg',
'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_b6bd96a1da4e6d2594e96ee2cedfc9d1.jpg',
'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_17386cc123cfc7fb7088ef60dd528f47.jpg',
'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_9fbfd7d6120bbc8a8cd25369e9a278b2.jpg',
'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_082f3401ff58c2d7bbae56fbbd930a7e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3d4731-f68c-59c7-9a4c-4f683965d7df/ac3d4731-f68c-59c7-9a4c-4f683965d7df_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86665,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_3ab1c8bf986f2949e0874646daba4ce2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3d4731-f68c-59c7-9a4c-4f683965d7df/ac3d4731-f68c-59c7-9a4c-4f683965d7df_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90124,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_ba6751d685ba796f56b796bd57e9aaed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3d4731-f68c-59c7-9a4c-4f683965d7df/ac3d4731-f68c-59c7-9a4c-4f683965d7df_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92333,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_49315ef1831ed4bdb20288396598c76e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3d4731-f68c-59c7-9a4c-4f683965d7df/ac3d4731-f68c-59c7-9a4c-4f683965d7df_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75491,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_a39602b37fc46e7b6d928421417aac02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3d4731-f68c-59c7-9a4c-4f683965d7df/ac3d4731-f68c-59c7-9a4c-4f683965d7df_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_7f613ed136942c4f53b8662a3b27685e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3d4731-f68c-59c7-9a4c-4f683965d7df/ac3d4731-f68c-59c7-9a4c-4f683965d7df_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89796,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_8534b63abd1a7e18c720b9607401053f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3d4731-f68c-59c7-9a4c-4f683965d7df/ac3d4731-f68c-59c7-9a4c-4f683965d7df_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2814732,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_b6bd96a1da4e6d2594e96ee2cedfc9d1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3d4731-f68c-59c7-9a4c-4f683965d7df/ac3d4731-f68c-59c7-9a4c-4f683965d7df_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84813,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_17386cc123cfc7fb7088ef60dd528f47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3d4731-f68c-59c7-9a4c-4f683965d7df/ac3d4731-f68c-59c7-9a4c-4f683965d7df_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_9fbfd7d6120bbc8a8cd25369e9a278b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3d4731-f68c-59c7-9a4c-4f683965d7df/ac3d4731-f68c-59c7-9a4c-4f683965d7df_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99462,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/18/63180abaf6d81350e88c831a067da27e/pa/CR29385_082f3401ff58c2d7bbae56fbbd930a7e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-07-21',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic Avantgarde',
'transmission': 'automatic',
'trim': '4Matic Avantgarde',
'year': 2022}
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR29385%27 HTTP/1.1" 200 None
2026-03-27 10:45:27 [auto1.de] INFO: Saving data for CR29385: {'created_time': 1774608327.545426, 'last_price_update_time': 1774608327.545438, 'auction_closing_time': 1774716862.0}
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR29385') HTTP/1.1" 204 0
2026-03-27 10:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_ac4fece09867b5c5a7cafd1b71f55332.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_fa6e0ab0898875881bc3799e6d55bd14.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_c5a37eb487ad0a2c1cee3ae24eb62612.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be106910>
2026-03-27 10:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_f621442fe68da84898f515257506ec8e.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_f621442fe68da84898f515257506ec8e.jpg saved to cache
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 83e8b967-8a3d-51fd-b23b-05555d728276
2026-03-27 10:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 with identifier: UY13477
2026-03-27 10:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 with scrape type 1
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4bf5f630-2a72-5211-aa24-f6dda42ac5a4
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F1d%252F9a1dc82f11bbdfe2a4ebb9b4338e38aa%252Fpa%252FUY13477_a47449c06773a314574a3aee05b73422.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_a47449c06773a314574a3aee05b73422.jpg not downloaded yet
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bdf31e50>
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b7c7c3b-1990-537a-8d75-d46f7fda4b09/8b7c7c3b-1990-537a-8d75-d46f7fda4b09_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fcf%252Ffdcf73d660d4a17ae185e665514abc91%252Fpa%252FLM89812_583e8a3417397b3776181823dddb7de4.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_583e8a3417397b3776181823dddb7de4.jpg saved to cache
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b7c7c3b-1990-537a-8d75-d46f7fda4b09
2026-03-27 10:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH74073> (referer: https://www.auto1.com/v1/car-details-view/GH74073/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf35a950>
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b7c7c3b-1990-537a-8d75-d46f7fda4b09/8b7c7c3b-1990-537a-8d75-d46f7fda4b09_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fcf%252Ffdcf73d660d4a17ae185e665514abc91%252Fpa%252FLM89812_7eb78775831f777dafe1f57ae3c0b820.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_7eb78775831f777dafe1f57ae3c0b820.jpg saved to cache
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b7c7c3b-1990-537a-8d75-d46f7fda4b09
2026-03-27 10:45:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F1d%252F9a1dc82f11bbdfe2a4ebb9b4338e38aa%252Fpa%252FUY13477_18da9beb0c3e9062374764b3b7bf40ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_18da9beb0c3e9062374764b3b7bf40ae.jpg not downloaded yet
2026-03-27 10:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_97f9a68a47b502b3ea1315f4fe3785e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf5475d0>
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b7c7c3b-1990-537a-8d75-d46f7fda4b09/8b7c7c3b-1990-537a-8d75-d46f7fda4b09_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fcf%252Ffdcf73d660d4a17ae185e665514abc91%252Fpa%252FLM89812_ac4fece09867b5c5a7cafd1b71f55332.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_ac4fece09867b5c5a7cafd1b71f55332.jpg saved to cache
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b7c7c3b-1990-537a-8d75-d46f7fda4b09
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf373f90>
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b7c7c3b-1990-537a-8d75-d46f7fda4b09/8b7c7c3b-1990-537a-8d75-d46f7fda4b09_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fcf%252Ffdcf73d660d4a17ae185e665514abc91%252Fpa%252FLM89812_fa6e0ab0898875881bc3799e6d55bd14.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_fa6e0ab0898875881bc3799e6d55bd14.jpg saved to cache
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b7c7c3b-1990-537a-8d75-d46f7fda4b09
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf41e110>
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_c5a37eb487ad0a2c1cee3ae24eb62612.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_c5a37eb487ad0a2c1cee3ae24eb62612.jpg saved to cache
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 643c22f9-9c40-5d40-9c79-b4aaf666f822
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F1d%252F9a1dc82f11bbdfe2a4ebb9b4338e38aa%252Fpa%252FUY13477_8e236307f11782bd705ea0ca1b4eac56.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_8e236307f11782bd705ea0ca1b4eac56.jpg not downloaded yet
2026-03-27 10:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_e5a9b945db9655108d427fcaf9162e64.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F1d%252F9a1dc82f11bbdfe2a4ebb9b4338e38aa%252Fpa%252FUY13477_8e91c865dca78ec05020549a77e2bcc4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_8e91c865dca78ec05020549a77e2bcc4.jpg not downloaded yet
2026-03-27 10:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7be6b64-4dec-5cd6-849f-da7d39d696fa with identifier: GH74073
2026-03-27 10:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7be6b64-4dec-5cd6-849f-da7d39d696fa with scrape type 1
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c7be6b64-4dec-5cd6-849f-da7d39d696fa
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F30%252Fe630b022d516b98bfea7e0c20eb55d95%252Fpa%252FGH74073_468b1a3b97cbf7a33e1ec09a2f71069b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_468b1a3b97cbf7a33e1ec09a2f71069b.jpg already downloaded
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F30%252Fe630b022d516b98bfea7e0c20eb55d95%252Fpa%252FGH74073_23b6e324cdda937839b0351340018287.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_23b6e324cdda937839b0351340018287.jpg already downloaded
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F30%252Fe630b022d516b98bfea7e0c20eb55d95%252Fpa%252FGH74073_3bd136422e14baabe5c91256756b133c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_3bd136422e14baabe5c91256756b133c.jpg already downloaded
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F30%252Fe630b022d516b98bfea7e0c20eb55d95%252Fpa%252FGH74073_604fab7934be7a3b45e95a03a75c4dec.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_604fab7934be7a3b45e95a03a75c4dec.jpg already downloaded
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F30%252Fe630b022d516b98bfea7e0c20eb55d95%252Fpa%252FGH74073_eaeff50ca0e8676303d0fe54926fb0c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_eaeff50ca0e8676303d0fe54926fb0c4.jpg already downloaded
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F30%252Fe630b022d516b98bfea7e0c20eb55d95%252Fpa%252FGH74073_23967a5071b883348a91570303edc927.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_23967a5071b883348a91570303edc927.jpg already downloaded
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F30%252Fe630b022d516b98bfea7e0c20eb55d95%252Fpa%252FGH74073_29416f37f307fb9dc7fb4f013d6df33a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_29416f37f307fb9dc7fb4f013d6df33a.jpg already downloaded
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F30%252Fe630b022d516b98bfea7e0c20eb55d95%252Fpa%252FGH74073_d8601c154d22a51ccd56e2fa022f04d9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_d8601c154d22a51ccd56e2fa022f04d9.jpg already downloaded
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F30%252Fe630b022d516b98bfea7e0c20eb55d95%252Fpa%252FGH74073_c3468322924605189d58da770cb100e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_c3468322924605189d58da770cb100e5.jpg already downloaded
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F30%252Fe630b022d516b98bfea7e0c20eb55d95%252Fpa%252FGH74073_56db9354d94517a8d012269b3267e300.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_56db9354d94517a8d012269b3267e300.jpg already downloaded
2026-03-27 10:45:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7be6b64-4dec-5cd6-849f-da7d39d696fa, identifier: GH74073
2026-03-27 10:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf51e910>
2026-03-27 10:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b7c7c3b-1990-537a-8d75-d46f7fda4b09/8b7c7c3b-1990-537a-8d75-d46f7fda4b09_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fcf%252Ffdcf73d660d4a17ae185e665514abc91%252Fpa%252FLM89812_97f9a68a47b502b3ea1315f4fe3785e2.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_97f9a68a47b502b3ea1315f4fe3785e2.jpg saved to cache
2026-03-27 10:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b7c7c3b-1990-537a-8d75-d46f7fda4b09
2026-03-27 10:45:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b7c7c3b-1990-537a-8d75-d46f7fda4b09, skipping ID generation
2026-03-27 10:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 with scrape type 1
2026-03-27 10:45:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 sending to next pipeline
2026-03-27 10:45:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b7c7c3b-1990-537a-8d75-d46f7fda4b09, identifier: LM89812
2026-03-27 10:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_9e4e8a16036e22a02037bede24b7ba9d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7be6b64-4dec-5cd6-849f-da7d39d696fa with identifier: GH74073
2026-03-27 10:45:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7be6b64-4dec-5cd6-849f-da7d39d696fa with identifier: GH74073
2026-03-27 10:45:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7be6b64-4dec-5cd6-849f-da7d39d696fa with identifier: GH74073 to the API
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GH74073>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-03-28T16:11:22Z',
'fuel_type': 'diesel',
'id': 'c7be6b64-4dec-5cd6-849f-da7d39d696fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH74073',
'listing': 'auction',
'location': 'DE, Germersheim',
'make': 'BMW',
'model': '1er',
'odometer': 291267,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_468b1a3b97cbf7a33e1ec09a2f71069b.jpg',
'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_23b6e324cdda937839b0351340018287.jpg',
'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_3bd136422e14baabe5c91256756b133c.jpg',
'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_604fab7934be7a3b45e95a03a75c4dec.jpg',
'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_eaeff50ca0e8676303d0fe54926fb0c4.jpg',
'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_23967a5071b883348a91570303edc927.jpg',
'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_29416f37f307fb9dc7fb4f013d6df33a.jpg',
'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_d8601c154d22a51ccd56e2fa022f04d9.jpg',
'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_c3468322924605189d58da770cb100e5.jpg',
'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_56db9354d94517a8d012269b3267e300.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7be6b64-4dec-5cd6-849f-da7d39d696fa/c7be6b64-4dec-5cd6-849f-da7d39d696fa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2676445,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_468b1a3b97cbf7a33e1ec09a2f71069b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7be6b64-4dec-5cd6-849f-da7d39d696fa/c7be6b64-4dec-5cd6-849f-da7d39d696fa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_23b6e324cdda937839b0351340018287.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7be6b64-4dec-5cd6-849f-da7d39d696fa/c7be6b64-4dec-5cd6-849f-da7d39d696fa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2673301,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_3bd136422e14baabe5c91256756b133c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7be6b64-4dec-5cd6-849f-da7d39d696fa/c7be6b64-4dec-5cd6-849f-da7d39d696fa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2783495,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_604fab7934be7a3b45e95a03a75c4dec.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7be6b64-4dec-5cd6-849f-da7d39d696fa/c7be6b64-4dec-5cd6-849f-da7d39d696fa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2629137,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_eaeff50ca0e8676303d0fe54926fb0c4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7be6b64-4dec-5cd6-849f-da7d39d696fa/c7be6b64-4dec-5cd6-849f-da7d39d696fa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72217,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_23967a5071b883348a91570303edc927.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7be6b64-4dec-5cd6-849f-da7d39d696fa/c7be6b64-4dec-5cd6-849f-da7d39d696fa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2862223,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_29416f37f307fb9dc7fb4f013d6df33a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7be6b64-4dec-5cd6-849f-da7d39d696fa/c7be6b64-4dec-5cd6-849f-da7d39d696fa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2912672,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_d8601c154d22a51ccd56e2fa022f04d9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7be6b64-4dec-5cd6-849f-da7d39d696fa/c7be6b64-4dec-5cd6-849f-da7d39d696fa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68712,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_c3468322924605189d58da770cb100e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7be6b64-4dec-5cd6-849f-da7d39d696fa/c7be6b64-4dec-5cd6-849f-da7d39d696fa_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/30/e630b022d516b98bfea7e0c20eb55d95/pa/GH74073_56db9354d94517a8d012269b3267e300.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-05-10',
'seats_number': 4,
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH74073%27 HTTP/1.1" 200 None
2026-03-27 10:45:32 [auto1.de] INFO: Saving data for GH74073: {'created_time': 1774608332.946838, 'last_price_update_time': 1774608332.946849, 'auction_closing_time': 1774714282.0}
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH74073') HTTP/1.1" 204 0
2026-03-27 10:45:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 with identifier: LM89812
2026-03-27 10:45:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 with identifier: LM89812
2026-03-27 10:45:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b7c7c3b-1990-537a-8d75-d46f7fda4b09 with identifier: LM89812 to the API
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_97f9a68a47b502b3ea1315f4fe3785e2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 4',
'engine': '1.9L',
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:35:32Z',
'fuel_type': 'diesel',
'id': '8b7c7c3b-1990-537a-8d75-d46f7fda4b09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM89812',
'listing': 'auction',
'location': 'DE, Kerpen',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 247375,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b7c7c3b-1990-537a-8d75-d46f7fda4b09/8b7c7c3b-1990-537a-8d75-d46f7fda4b09_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88682,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_583e8a3417397b3776181823dddb7de4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b7c7c3b-1990-537a-8d75-d46f7fda4b09/8b7c7c3b-1990-537a-8d75-d46f7fda4b09_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85714,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_97f9a68a47b502b3ea1315f4fe3785e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b7c7c3b-1990-537a-8d75-d46f7fda4b09/8b7c7c3b-1990-537a-8d75-d46f7fda4b09_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80242,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_ac4fece09867b5c5a7cafd1b71f55332.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b7c7c3b-1990-537a-8d75-d46f7fda4b09/8b7c7c3b-1990-537a-8d75-d46f7fda4b09_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71527,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_7eb78775831f777dafe1f57ae3c0b820.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b7c7c3b-1990-537a-8d75-d46f7fda4b09/8b7c7c3b-1990-537a-8d75-d46f7fda4b09_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70831,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/cf/fdcf73d660d4a17ae185e665514abc91/pa/LM89812_fa6e0ab0898875881bc3799e6d55bd14.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-11-12',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf V 1.9 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2006}
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM89812%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [auto1.de] INFO: Saving data for LM89812: {'created_time': 1774608333.388092, 'last_price_update_time': 1774608333.388106, 'auction_closing_time': 1774715732.0}
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM89812') HTTP/1.1" 204 0
2026-03-27 10:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_a47449c06773a314574a3aee05b73422.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F1d%252F9a1dc82f11bbdfe2a4ebb9b4338e38aa%252Fpa%252FUY13477_724a0afe84ee04c9b4832c46ce6fbbb0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_724a0afe84ee04c9b4832c46ce6fbbb0.jpg not downloaded yet
2026-03-27 10:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_6c8630af8054ad0db49ba96490bda0d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE75344> (referer: https://www.auto1.com/v1/car-details-view/ZE75344/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP68778> (referer: https://www.auto1.com/v1/car-details-view/NP68778/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX83628> (referer: https://www.auto1.com/v1/car-details-view/XX83628/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1f4d50>
2026-03-27 10:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_e5a9b945db9655108d427fcaf9162e64.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_e5a9b945db9655108d427fcaf9162e64.jpg saved to cache
2026-03-27 10:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 643c22f9-9c40-5d40-9c79-b4aaf666f822
2026-03-27 10:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be163650>
2026-03-27 10:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_9e4e8a16036e22a02037bede24b7ba9d.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_9e4e8a16036e22a02037bede24b7ba9d.jpg saved to cache
2026-03-27 10:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 643c22f9-9c40-5d40-9c79-b4aaf666f822
2026-03-27 10:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_87924bedb64294ec2e2178dd4dd68cab.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5649550>
2026-03-27 10:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bf5f630-2a72-5211-aa24-f6dda42ac5a4/4bf5f630-2a72-5211-aa24-f6dda42ac5a4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F1d%252F9a1dc82f11bbdfe2a4ebb9b4338e38aa%252Fpa%252FUY13477_a47449c06773a314574a3aee05b73422.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_a47449c06773a314574a3aee05b73422.jpg saved to cache
2026-03-27 10:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4bf5f630-2a72-5211-aa24-f6dda42ac5a4
2026-03-27 10:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_023b78b2429299623da0faad1c5be766.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be161750>
2026-03-27 10:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_6c8630af8054ad0db49ba96490bda0d5.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_6c8630af8054ad0db49ba96490bda0d5.jpg saved to cache
2026-03-27 10:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 93b4b4e9-50cb-5882-b364-b47601ed4dc6
2026-03-27 10:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0b3edc3-54ee-5d10-a257-8964ec12603e with identifier: ZE75344
2026-03-27 10:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0b3edc3-54ee-5d10-a257-8964ec12603e with scrape type 1
2026-03-27 10:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d0b3edc3-54ee-5d10-a257-8964ec12603e
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F0c%252F760c76742eb4ee73b660455afa340ff8%252Fpa%252FZE75344_0e8acabbb7b9d1a84ffc1e2efc51548f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_0e8acabbb7b9d1a84ffc1e2efc51548f.jpg not downloaded yet
2026-03-27 10:45:33 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 10544 | hits on page: 40
2026-03-27 10:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4737775-8f56-5c0c-9480-9c5b96a3afb4 with identifier: NP68778
2026-03-27 10:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4737775-8f56-5c0c-9480-9c5b96a3afb4 with scrape type 1
2026-03-27 10:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b4737775-8f56-5c0c-9480-9c5b96a3afb4
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9a%252Ff89a61895e2abb0d88c610cd14de88d8%252Fpa%252FNP68778_fbd38c288b0b23c84863f6f58334e27f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_fbd38c288b0b23c84863f6f58334e27f.jpg not downloaded yet
2026-03-27 10:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71677453-e954-5857-8232-c903da3363c8 with identifier: XX83628
2026-03-27 10:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71677453-e954-5857-8232-c903da3363c8 with scrape type 1
2026-03-27 10:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 71677453-e954-5857-8232-c903da3363c8
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F7f%252Ff37f574da72fbb1c817084d498fb119a%252Fpa%252FXX83628_6b862e15ac13074ae7458feaa3e3e214.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_6b862e15ac13074ae7458feaa3e3e214.jpg not downloaded yet
2026-03-27 10:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_47cdb8e163e7e131931462180e0a9685.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F0c%252F760c76742eb4ee73b660455afa340ff8%252Fpa%252FZE75344_4d34b4530e5b70824ee5682be0a83847.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_4d34b4530e5b70824ee5682be0a83847.jpg not downloaded yet
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM48488%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [auto1.de] INFO: Scrape type for UM48488: 0
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV46397%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [auto1.de] INFO: Scrape type for FV46397: 0
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ08427%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [auto1.de] INFO: Scrape type for UZ08427: 0
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK99321%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [auto1.de] INFO: Scrape type for SK99321: 0
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG91001%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [auto1.de] INFO: Scrape type for SG91001: 0
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: BP51481
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP51481%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [auto1.de] INFO: Scrape type for BP51481: 0
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX26895%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [auto1.de] INFO: Scrape type for MX26895: 0
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63966%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [auto1.de] INFO: Scrape type for LD63966: 0
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: PV47280
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME64315%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [auto1.de] INFO: Scrape type for ME64315: 0
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54097%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [auto1.de] INFO: Scrape type for HJ54097: 0
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU13127%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [auto1.de] INFO: Scrape type for PU13127: 0
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX34768%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [auto1.de] INFO: Scrape type for BX34768: 0
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA81936%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [auto1.de] INFO: Scrape type for SA81936: 0
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: JT81466
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: UY61545
2026-03-27 10:45:33 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV52918%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [auto1.de] INFO: Scrape type for LV52918: 0
2026-03-27 10:45:34 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-27 10:45:34 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-27 10:45:34 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP43977%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [auto1.de] INFO: Scrape type for CP43977: 0
2026-03-27 10:45:34 [auto1.de] INFO: Found listing with ID: MR29539
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR29539%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [auto1.de] INFO: Scrape type for MR29539: 0
2026-03-27 10:45:34 [auto1.de] INFO: Found listing with ID: TT64948
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT64948%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [auto1.de] INFO: Scrape type for TT64948: 0
2026-03-27 10:45:34 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN00007%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [auto1.de] INFO: Scrape type for FN00007: 0
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9a%252Ff89a61895e2abb0d88c610cd14de88d8%252Fpa%252FNP68778_feedb5230a8c87e40e8993991a970a41.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_feedb5230a8c87e40e8993991a970a41.jpg not downloaded yet
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F7f%252Ff37f574da72fbb1c817084d498fb119a%252Fpa%252FXX83628_8eac90335b445c2df5043dea2e562981.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_8eac90335b445c2df5043dea2e562981.jpg not downloaded yet
2026-03-27 10:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_724a0afe84ee04c9b4832c46ce6fbbb0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_8e236307f11782bd705ea0ca1b4eac56.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_f15aae59ca51538f6d3edb8f71e69977.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_18da9beb0c3e9062374764b3b7bf40ae.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_8e91c865dca78ec05020549a77e2bcc4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_cac7f7b4927bea64e190f56034a46246.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F0c%252F760c76742eb4ee73b660455afa340ff8%252Fpa%252FZE75344_b8575cd9fe4ef18d18b30a8e74d388bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_b8575cd9fe4ef18d18b30a8e74d388bc.jpg not downloaded yet
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9a%252Ff89a61895e2abb0d88c610cd14de88d8%252Fpa%252FNP68778_801b4fca687e37367a459d53303a4afc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_801b4fca687e37367a459d53303a4afc.jpg not downloaded yet
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F7f%252Ff37f574da72fbb1c817084d498fb119a%252Fpa%252FXX83628_84dba8df65642b0936e41efb3279b269.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_84dba8df65642b0936e41efb3279b269.jpg not downloaded yet
2026-03-27 10:45:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3ae450>
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_87924bedb64294ec2e2178dd4dd68cab.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_87924bedb64294ec2e2178dd4dd68cab.jpg saved to cache
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 643c22f9-9c40-5d40-9c79-b4aaf666f822
2026-03-27 10:45:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf484e90>
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_023b78b2429299623da0faad1c5be766.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_023b78b2429299623da0faad1c5be766.jpg saved to cache
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 643c22f9-9c40-5d40-9c79-b4aaf666f822
2026-03-27 10:45:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be263950>
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_47cdb8e163e7e131931462180e0a9685.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_47cdb8e163e7e131931462180e0a9685.jpg saved to cache
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 643c22f9-9c40-5d40-9c79-b4aaf666f822
2026-03-27 10:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_5d25bdfcf552fbfe3209b6aaf71eafb3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F0c%252F760c76742eb4ee73b660455afa340ff8%252Fpa%252FZE75344_457b7f977e3dd4f3c8251f19d85029a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_457b7f977e3dd4f3c8251f19d85029a1.jpg not downloaded yet
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9a%252Ff89a61895e2abb0d88c610cd14de88d8%252Fpa%252FNP68778_aa233b069c154c309da1f3b5bf2a980d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_aa233b069c154c309da1f3b5bf2a980d.jpg not downloaded yet
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F7f%252Ff37f574da72fbb1c817084d498fb119a%252Fpa%252FXX83628_7bec1227c373eebde652ec5e4558fb5d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_7bec1227c373eebde652ec5e4558fb5d.jpg not downloaded yet
2026-03-27 10:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_cb3692503699f566de88f1342c513be2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_e572358c3575e1dbef99f4a2fb6f9013.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F0c%252F760c76742eb4ee73b660455afa340ff8%252Fpa%252FZE75344_869a0d2bdb7b65620062d4f4e35c1e61.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_869a0d2bdb7b65620062d4f4e35c1e61.jpg not downloaded yet
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9a%252Ff89a61895e2abb0d88c610cd14de88d8%252Fpa%252FNP68778_6046e6d70a1a394e4eec2511a3e425e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_6046e6d70a1a394e4eec2511a3e425e6.jpg not downloaded yet
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F7f%252Ff37f574da72fbb1c817084d498fb119a%252Fpa%252FXX83628_402f5a25f8f0af071bdc40791a82f1fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_402f5a25f8f0af071bdc40791a82f1fc.jpg not downloaded yet
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be008d90>
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bf5f630-2a72-5211-aa24-f6dda42ac5a4/4bf5f630-2a72-5211-aa24-f6dda42ac5a4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F1d%252F9a1dc82f11bbdfe2a4ebb9b4338e38aa%252Fpa%252FUY13477_724a0afe84ee04c9b4832c46ce6fbbb0.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_724a0afe84ee04c9b4832c46ce6fbbb0.jpg saved to cache
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4bf5f630-2a72-5211-aa24-f6dda42ac5a4
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0fa9d0>
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bf5f630-2a72-5211-aa24-f6dda42ac5a4/4bf5f630-2a72-5211-aa24-f6dda42ac5a4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F1d%252F9a1dc82f11bbdfe2a4ebb9b4338e38aa%252Fpa%252FUY13477_8e236307f11782bd705ea0ca1b4eac56.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_8e236307f11782bd705ea0ca1b4eac56.jpg saved to cache
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4bf5f630-2a72-5211-aa24-f6dda42ac5a4
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf572990>
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_f15aae59ca51538f6d3edb8f71e69977.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_f15aae59ca51538f6d3edb8f71e69977.jpg saved to cache
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 93b4b4e9-50cb-5882-b364-b47601ed4dc6
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2c4710>
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bf5f630-2a72-5211-aa24-f6dda42ac5a4/4bf5f630-2a72-5211-aa24-f6dda42ac5a4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F1d%252F9a1dc82f11bbdfe2a4ebb9b4338e38aa%252Fpa%252FUY13477_18da9beb0c3e9062374764b3b7bf40ae.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_18da9beb0c3e9062374764b3b7bf40ae.jpg saved to cache
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4bf5f630-2a72-5211-aa24-f6dda42ac5a4
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be03bb10>
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bf5f630-2a72-5211-aa24-f6dda42ac5a4/4bf5f630-2a72-5211-aa24-f6dda42ac5a4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F1d%252F9a1dc82f11bbdfe2a4ebb9b4338e38aa%252Fpa%252FUY13477_8e91c865dca78ec05020549a77e2bcc4.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_8e91c865dca78ec05020549a77e2bcc4.jpg saved to cache
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4bf5f630-2a72-5211-aa24-f6dda42ac5a4
2026-03-27 10:45:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4bf5f630-2a72-5211-aa24-f6dda42ac5a4, skipping ID generation
2026-03-27 10:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 with scrape type 1
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 sending to next pipeline
2026-03-27 10:45:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bf5f630-2a72-5211-aa24-f6dda42ac5a4, identifier: UY13477
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0090d0>
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_cac7f7b4927bea64e190f56034a46246.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_cac7f7b4927bea64e190f56034a46246.jpg saved to cache
2026-03-27 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68658590-2bbf-5ac0-bea9-29e94c7e6106
2026-03-27 10:45:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 with identifier: UY13477
2026-03-27 10:45:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 with identifier: UY13477
2026-03-27 10:45:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bf5f630-2a72-5211-aa24-f6dda42ac5a4 with identifier: UY13477 to the API
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_8e91c865dca78ec05020549a77e2bcc4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 80,
'expiration_date': '2026-03-28T16:21:56Z',
'fuel_type': 'petrol',
'id': '4bf5f630-2a72-5211-aa24-f6dda42ac5a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY13477',
'listing': 'auction',
'location': 'Chemnitz',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 156419,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bf5f630-2a72-5211-aa24-f6dda42ac5a4/4bf5f630-2a72-5211-aa24-f6dda42ac5a4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92800,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_a47449c06773a314574a3aee05b73422.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bf5f630-2a72-5211-aa24-f6dda42ac5a4/4bf5f630-2a72-5211-aa24-f6dda42ac5a4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85389,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_18da9beb0c3e9062374764b3b7bf40ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bf5f630-2a72-5211-aa24-f6dda42ac5a4/4bf5f630-2a72-5211-aa24-f6dda42ac5a4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75377,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_8e236307f11782bd705ea0ca1b4eac56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bf5f630-2a72-5211-aa24-f6dda42ac5a4/4bf5f630-2a72-5211-aa24-f6dda42ac5a4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66917,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_8e91c865dca78ec05020549a77e2bcc4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bf5f630-2a72-5211-aa24-f6dda42ac5a4/4bf5f630-2a72-5211-aa24-f6dda42ac5a4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 126833,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/1d/9a1dc82f11bbdfe2a4ebb9b4338e38aa/pa/UY13477_724a0afe84ee04c9b4832c46ce6fbbb0.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-05-04',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.4 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY13477%27 HTTP/1.1" 200 None
2026-03-27 10:45:35 [auto1.de] INFO: Saving data for UY13477: {'created_time': 1774608335.531029, 'last_price_update_time': 1774608335.531046, 'auction_closing_time': 1774714916.0}
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY13477') HTTP/1.1" 204 0
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F0c%252F760c76742eb4ee73b660455afa340ff8%252Fpa%252FZE75344_59c4e2ed8094502f24473c4f634fe9b7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_59c4e2ed8094502f24473c4f634fe9b7.jpg not downloaded yet
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9a%252Ff89a61895e2abb0d88c610cd14de88d8%252Fpa%252FNP68778_80928ac390a6ed79312df7d6a0374de7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_80928ac390a6ed79312df7d6a0374de7.jpg not downloaded yet
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c6ddfe50>
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_5d25bdfcf552fbfe3209b6aaf71eafb3.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_5d25bdfcf552fbfe3209b6aaf71eafb3.jpg saved to cache
2026-03-27 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 93b4b4e9-50cb-5882-b364-b47601ed4dc6
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4f7f90>
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_cb3692503699f566de88f1342c513be2.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_cb3692503699f566de88f1342c513be2.jpg saved to cache
2026-03-27 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 93b4b4e9-50cb-5882-b364-b47601ed4dc6
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf55a990>
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_e572358c3575e1dbef99f4a2fb6f9013.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_e572358c3575e1dbef99f4a2fb6f9013.jpg saved to cache
2026-03-27 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68658590-2bbf-5ac0-bea9-29e94c7e6106
2026-03-27 10:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_7bec1227c373eebde652ec5e4558fb5d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_457b7f977e3dd4f3c8251f19d85029a1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_84dba8df65642b0936e41efb3279b269.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_8eac90335b445c2df5043dea2e562981.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_801b4fca687e37367a459d53303a4afc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_aa233b069c154c309da1f3b5bf2a980d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_f104beb4e6e02bf18627e284e7aee8b7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_b8575cd9fe4ef18d18b30a8e74d388bc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_6b862e15ac13074ae7458feaa3e3e214.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_fbd38c288b0b23c84863f6f58334e27f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_80928ac390a6ed79312df7d6a0374de7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_feedb5230a8c87e40e8993991a970a41.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_0e8acabbb7b9d1a84ffc1e2efc51548f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1168d0>
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71677453-e954-5857-8232-c903da3363c8/71677453-e954-5857-8232-c903da3363c8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F7f%252Ff37f574da72fbb1c817084d498fb119a%252Fpa%252FXX83628_7bec1227c373eebde652ec5e4558fb5d.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_7bec1227c373eebde652ec5e4558fb5d.jpg saved to cache
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71677453-e954-5857-8232-c903da3363c8
2026-03-27 10:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_402f5a25f8f0af071bdc40791a82f1fc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_abc67f1c8c7251430cbf356f99518281.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_b070ff33ceac83edd5cbf7525d0eb8f2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf559b90>
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b3edc3-54ee-5d10-a257-8964ec12603e/d0b3edc3-54ee-5d10-a257-8964ec12603e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F0c%252F760c76742eb4ee73b660455afa340ff8%252Fpa%252FZE75344_457b7f977e3dd4f3c8251f19d85029a1.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_457b7f977e3dd4f3c8251f19d85029a1.jpg saved to cache
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0b3edc3-54ee-5d10-a257-8964ec12603e
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1c3310>
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71677453-e954-5857-8232-c903da3363c8/71677453-e954-5857-8232-c903da3363c8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F7f%252Ff37f574da72fbb1c817084d498fb119a%252Fpa%252FXX83628_84dba8df65642b0936e41efb3279b269.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_84dba8df65642b0936e41efb3279b269.jpg saved to cache
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71677453-e954-5857-8232-c903da3363c8
2026-03-27 10:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_9336f76eace50d2c9b54a89659b53059.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_59c4e2ed8094502f24473c4f634fe9b7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_4d34b4530e5b70824ee5682be0a83847.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_6046e6d70a1a394e4eec2511a3e425e6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_869a0d2bdb7b65620062d4f4e35c1e61.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be23e950>
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71677453-e954-5857-8232-c903da3363c8/71677453-e954-5857-8232-c903da3363c8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F7f%252Ff37f574da72fbb1c817084d498fb119a%252Fpa%252FXX83628_8eac90335b445c2df5043dea2e562981.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_8eac90335b445c2df5043dea2e562981.jpg saved to cache
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71677453-e954-5857-8232-c903da3363c8
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be093c50>
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4737775-8f56-5c0c-9480-9c5b96a3afb4/b4737775-8f56-5c0c-9480-9c5b96a3afb4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9a%252Ff89a61895e2abb0d88c610cd14de88d8%252Fpa%252FNP68778_801b4fca687e37367a459d53303a4afc.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_801b4fca687e37367a459d53303a4afc.jpg saved to cache
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4737775-8f56-5c0c-9480-9c5b96a3afb4
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf389d50>
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4737775-8f56-5c0c-9480-9c5b96a3afb4/b4737775-8f56-5c0c-9480-9c5b96a3afb4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9a%252Ff89a61895e2abb0d88c610cd14de88d8%252Fpa%252FNP68778_aa233b069c154c309da1f3b5bf2a980d.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_aa233b069c154c309da1f3b5bf2a980d.jpg saved to cache
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4737775-8f56-5c0c-9480-9c5b96a3afb4
2026-03-27 10:45:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be093fd0>
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fe3%252F57e3a7705f848e3664cf6fd84f635817%252Fpa%252FZD28576_f104beb4e6e02bf18627e284e7aee8b7.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_f104beb4e6e02bf18627e284e7aee8b7.jpg saved to cache
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 643c22f9-9c40-5d40-9c79-b4aaf666f822
2026-03-27 10:45:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 643c22f9-9c40-5d40-9c79-b4aaf666f822, skipping ID generation
2026-03-27 10:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 643c22f9-9c40-5d40-9c79-b4aaf666f822 with scrape type 1
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 643c22f9-9c40-5d40-9c79-b4aaf666f822 sending to next pipeline
2026-03-27 10:45:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 643c22f9-9c40-5d40-9c79-b4aaf666f822, identifier: ZD28576
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be25c950>
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b3edc3-54ee-5d10-a257-8964ec12603e/d0b3edc3-54ee-5d10-a257-8964ec12603e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F0c%252F760c76742eb4ee73b660455afa340ff8%252Fpa%252FZE75344_b8575cd9fe4ef18d18b30a8e74d388bc.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_b8575cd9fe4ef18d18b30a8e74d388bc.jpg saved to cache
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0b3edc3-54ee-5d10-a257-8964ec12603e
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2653d0>
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71677453-e954-5857-8232-c903da3363c8/71677453-e954-5857-8232-c903da3363c8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F7f%252Ff37f574da72fbb1c817084d498fb119a%252Fpa%252FXX83628_6b862e15ac13074ae7458feaa3e3e214.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_6b862e15ac13074ae7458feaa3e3e214.jpg saved to cache
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71677453-e954-5857-8232-c903da3363c8
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf32c350>
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4737775-8f56-5c0c-9480-9c5b96a3afb4/b4737775-8f56-5c0c-9480-9c5b96a3afb4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9a%252Ff89a61895e2abb0d88c610cd14de88d8%252Fpa%252FNP68778_fbd38c288b0b23c84863f6f58334e27f.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_fbd38c288b0b23c84863f6f58334e27f.jpg saved to cache
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4737775-8f56-5c0c-9480-9c5b96a3afb4
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf389c90>
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4737775-8f56-5c0c-9480-9c5b96a3afb4/b4737775-8f56-5c0c-9480-9c5b96a3afb4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9a%252Ff89a61895e2abb0d88c610cd14de88d8%252Fpa%252FNP68778_80928ac390a6ed79312df7d6a0374de7.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_80928ac390a6ed79312df7d6a0374de7.jpg saved to cache
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4737775-8f56-5c0c-9480-9c5b96a3afb4
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1bb810>
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4737775-8f56-5c0c-9480-9c5b96a3afb4/b4737775-8f56-5c0c-9480-9c5b96a3afb4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9a%252Ff89a61895e2abb0d88c610cd14de88d8%252Fpa%252FNP68778_feedb5230a8c87e40e8993991a970a41.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_feedb5230a8c87e40e8993991a970a41.jpg saved to cache
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4737775-8f56-5c0c-9480-9c5b96a3afb4
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be090110>
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b3edc3-54ee-5d10-a257-8964ec12603e/d0b3edc3-54ee-5d10-a257-8964ec12603e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F0c%252F760c76742eb4ee73b660455afa340ff8%252Fpa%252FZE75344_0e8acabbb7b9d1a84ffc1e2efc51548f.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_0e8acabbb7b9d1a84ffc1e2efc51548f.jpg saved to cache
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0b3edc3-54ee-5d10-a257-8964ec12603e
2026-03-27 10:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_fa0c10ad126068cf5aa20f3b6c5412d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 643c22f9-9c40-5d40-9c79-b4aaf666f822 with identifier: ZD28576
2026-03-27 10:45:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 643c22f9-9c40-5d40-9c79-b4aaf666f822 with identifier: ZD28576
2026-03-27 10:45:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 643c22f9-9c40-5d40-9c79-b4aaf666f822 with identifier: ZD28576 to the API
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_f104beb4e6e02bf18627e284e7aee8b7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 87,
'category': 'Rental',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:48:59Z',
'fuel_type': 'diesel',
'id': '643c22f9-9c40-5d40-9c79-b4aaf666f822',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD28576',
'listing': 'auction',
'location': 'DE, Arnsberg',
'make': 'Seat',
'model': 'Leon',
'odometer': 198583,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2692054,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_87924bedb64294ec2e2178dd4dd68cab.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68892,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_6d59ae0abb25877b42e004c0ce32493a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2557791,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_023b78b2429299623da0faad1c5be766.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52370,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_d2a691c204fbc59e7f35f01773631f24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2597942,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_f104beb4e6e02bf18627e284e7aee8b7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2467017,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_47cdb8e163e7e131931462180e0a9685.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47800,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_1a8bb86320846fe518a891fefea321fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68679,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_e5a9b945db9655108d427fcaf9162e64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73887,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_9e4e8a16036e22a02037bede24b7ba9d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_643c22f9-9c40-5d40-9c79-b4aaf666f822/643c22f9-9c40-5d40-9c79-b4aaf666f822_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/e3/57e3a7705f848e3664cf6fd84f635817/pa/ZD28576_c5a37eb487ad0a2c1cee3ae24eb62612.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-06-14',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Leon 1.6 TDI Style Ecomotive',
'transmission': 'manual',
'trim': 'Style Ecomotive',
'year': 2015}
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28576%27 HTTP/1.1" 200 None
2026-03-27 10:45:37 [auto1.de] INFO: Saving data for ZD28576: {'created_time': 1774608337.256713, 'last_price_update_time': 1774608337.256728, 'auction_closing_time': 1774716539.0}
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD28576') HTTP/1.1" 204 0
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf412f90>
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71677453-e954-5857-8232-c903da3363c8/71677453-e954-5857-8232-c903da3363c8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F7f%252Ff37f574da72fbb1c817084d498fb119a%252Fpa%252FXX83628_402f5a25f8f0af071bdc40791a82f1fc.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_402f5a25f8f0af071bdc40791a82f1fc.jpg saved to cache
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71677453-e954-5857-8232-c903da3363c8
2026-03-27 10:45:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71677453-e954-5857-8232-c903da3363c8, skipping ID generation
2026-03-27 10:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71677453-e954-5857-8232-c903da3363c8 with scrape type 1
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71677453-e954-5857-8232-c903da3363c8 sending to next pipeline
2026-03-27 10:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71677453-e954-5857-8232-c903da3363c8, identifier: XX83628
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be25f310>
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_abc67f1c8c7251430cbf356f99518281.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_abc67f1c8c7251430cbf356f99518281.jpg saved to cache
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 93b4b4e9-50cb-5882-b364-b47601ed4dc6
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c561eb50>
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_b070ff33ceac83edd5cbf7525d0eb8f2.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_b070ff33ceac83edd5cbf7525d0eb8f2.jpg saved to cache
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 93b4b4e9-50cb-5882-b364-b47601ed4dc6
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0aba90>
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_9336f76eace50d2c9b54a89659b53059.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_9336f76eace50d2c9b54a89659b53059.jpg saved to cache
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68658590-2bbf-5ac0-bea9-29e94c7e6106
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf326010>
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b3edc3-54ee-5d10-a257-8964ec12603e/d0b3edc3-54ee-5d10-a257-8964ec12603e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F0c%252F760c76742eb4ee73b660455afa340ff8%252Fpa%252FZE75344_59c4e2ed8094502f24473c4f634fe9b7.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_59c4e2ed8094502f24473c4f634fe9b7.jpg saved to cache
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0b3edc3-54ee-5d10-a257-8964ec12603e
2026-03-27 10:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_50935158fa3bf452144690b2708fb1c9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71677453-e954-5857-8232-c903da3363c8 with identifier: XX83628
2026-03-27 10:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71677453-e954-5857-8232-c903da3363c8 with identifier: XX83628
2026-03-27 10:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71677453-e954-5857-8232-c903da3363c8 with identifier: XX83628 to the API
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_402f5a25f8f0af071bdc40791a82f1fc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.1L',
'engine_horse_power': 67,
'expiration_date': '2026-03-28T16:37:50Z',
'fuel_type': 'petrol',
'id': '71677453-e954-5857-8232-c903da3363c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX83628',
'listing': 'auction',
'location': 'DE, Karlsruhe',
'make': 'Hyundai',
'model': 'i10',
'odometer': 120611,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71677453-e954-5857-8232-c903da3363c8/71677453-e954-5857-8232-c903da3363c8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_6b862e15ac13074ae7458feaa3e3e214.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71677453-e954-5857-8232-c903da3363c8/71677453-e954-5857-8232-c903da3363c8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74583,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_8eac90335b445c2df5043dea2e562981.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71677453-e954-5857-8232-c903da3363c8/71677453-e954-5857-8232-c903da3363c8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_84dba8df65642b0936e41efb3279b269.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71677453-e954-5857-8232-c903da3363c8/71677453-e954-5857-8232-c903da3363c8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_7bec1227c373eebde652ec5e4558fb5d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71677453-e954-5857-8232-c903da3363c8/71677453-e954-5857-8232-c903da3363c8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/7f/f37f574da72fbb1c817084d498fb119a/pa/XX83628_402f5a25f8f0af071bdc40791a82f1fc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-06-15',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai i10 1.1 Edition+',
'transmission': 'manual',
'trim': 'Edition+',
'year': 2009}
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX83628%27 HTTP/1.1" 200 None
2026-03-27 10:45:37 [auto1.de] INFO: Saving data for XX83628: {'created_time': 1774608337.976488, 'last_price_update_time': 1774608337.976501, 'auction_closing_time': 1774715870.0}
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX83628') HTTP/1.1" 204 0
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be074dd0>
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b3edc3-54ee-5d10-a257-8964ec12603e/d0b3edc3-54ee-5d10-a257-8964ec12603e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F0c%252F760c76742eb4ee73b660455afa340ff8%252Fpa%252FZE75344_4d34b4530e5b70824ee5682be0a83847.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_4d34b4530e5b70824ee5682be0a83847.jpg saved to cache
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0b3edc3-54ee-5d10-a257-8964ec12603e
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be221610>
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4737775-8f56-5c0c-9480-9c5b96a3afb4/b4737775-8f56-5c0c-9480-9c5b96a3afb4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9a%252Ff89a61895e2abb0d88c610cd14de88d8%252Fpa%252FNP68778_6046e6d70a1a394e4eec2511a3e425e6.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_6046e6d70a1a394e4eec2511a3e425e6.jpg saved to cache
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4737775-8f56-5c0c-9480-9c5b96a3afb4
2026-03-27 10:45:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4737775-8f56-5c0c-9480-9c5b96a3afb4, skipping ID generation
2026-03-27 10:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4737775-8f56-5c0c-9480-9c5b96a3afb4 with scrape type 1
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4737775-8f56-5c0c-9480-9c5b96a3afb4 sending to next pipeline
2026-03-27 10:45:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4737775-8f56-5c0c-9480-9c5b96a3afb4, identifier: NP68778
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5b84b10>
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b3edc3-54ee-5d10-a257-8964ec12603e/d0b3edc3-54ee-5d10-a257-8964ec12603e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F0c%252F760c76742eb4ee73b660455afa340ff8%252Fpa%252FZE75344_869a0d2bdb7b65620062d4f4e35c1e61.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_869a0d2bdb7b65620062d4f4e35c1e61.jpg saved to cache
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0b3edc3-54ee-5d10-a257-8964ec12603e
2026-03-27 10:45:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0b3edc3-54ee-5d10-a257-8964ec12603e, skipping ID generation
2026-03-27 10:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0b3edc3-54ee-5d10-a257-8964ec12603e with scrape type 1
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0b3edc3-54ee-5d10-a257-8964ec12603e sending to next pipeline
2026-03-27 10:45:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0b3edc3-54ee-5d10-a257-8964ec12603e, identifier: ZE75344
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be223990>
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F06%252F2e066bffb4385dbd34ef26fe29da62d5%252Fpa%252FAY57435_fa0c10ad126068cf5aa20f3b6c5412d5.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_fa0c10ad126068cf5aa20f3b6c5412d5.jpg saved to cache
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68658590-2bbf-5ac0-bea9-29e94c7e6106
2026-03-27 10:45:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68658590-2bbf-5ac0-bea9-29e94c7e6106, skipping ID generation
2026-03-27 10:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68658590-2bbf-5ac0-bea9-29e94c7e6106 with scrape type 1
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68658590-2bbf-5ac0-bea9-29e94c7e6106 sending to next pipeline
2026-03-27 10:45:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68658590-2bbf-5ac0-bea9-29e94c7e6106, identifier: AY57435
2026-03-27 10:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4737775-8f56-5c0c-9480-9c5b96a3afb4 with identifier: NP68778
2026-03-27 10:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4737775-8f56-5c0c-9480-9c5b96a3afb4 with identifier: NP68778
2026-03-27 10:45:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4737775-8f56-5c0c-9480-9c5b96a3afb4 with identifier: NP68778 to the API
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_6046e6d70a1a394e4eec2511a3e425e6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 157,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.9L',
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:24:40Z',
'fuel_type': 'diesel',
'id': 'b4737775-8f56-5c0c-9480-9c5b96a3afb4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP68778',
'listing': 'auction',
'location': 'DE, Ulm-Senden',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 288153,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4737775-8f56-5c0c-9480-9c5b96a3afb4/b4737775-8f56-5c0c-9480-9c5b96a3afb4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73849,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_fbd38c288b0b23c84863f6f58334e27f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4737775-8f56-5c0c-9480-9c5b96a3afb4/b4737775-8f56-5c0c-9480-9c5b96a3afb4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77667,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_feedb5230a8c87e40e8993991a970a41.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4737775-8f56-5c0c-9480-9c5b96a3afb4/b4737775-8f56-5c0c-9480-9c5b96a3afb4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_801b4fca687e37367a459d53303a4afc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4737775-8f56-5c0c-9480-9c5b96a3afb4/b4737775-8f56-5c0c-9480-9c5b96a3afb4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61573,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_aa233b069c154c309da1f3b5bf2a980d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4737775-8f56-5c0c-9480-9c5b96a3afb4/b4737775-8f56-5c0c-9480-9c5b96a3afb4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72227,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_6046e6d70a1a394e4eec2511a3e425e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4737775-8f56-5c0c-9480-9c5b96a3afb4/b4737775-8f56-5c0c-9480-9c5b96a3afb4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52026,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/9a/f89a61895e2abb0d88c610cd14de88d8/pa/NP68778_80928ac390a6ed79312df7d6a0374de7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-08-26',
'seats_number': 7,
'seller_name': None,
'title': 'Volkswagen Touran 1.9 TDI Freestyle',
'transmission': 'manual',
'trim': 'Freestyle',
'year': 2009}
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP68778%27 HTTP/1.1" 200 None
2026-03-27 10:45:38 [auto1.de] INFO: Saving data for NP68778: {'created_time': 1774608338.882908, 'last_price_update_time': 1774608338.882922, 'auction_closing_time': 1774715080.0}
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP68778') HTTP/1.1" 204 0
2026-03-27 10:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0b3edc3-54ee-5d10-a257-8964ec12603e with identifier: ZE75344
2026-03-27 10:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0b3edc3-54ee-5d10-a257-8964ec12603e with identifier: ZE75344
2026-03-27 10:45:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0b3edc3-54ee-5d10-a257-8964ec12603e with identifier: ZE75344 to the API
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_869a0d2bdb7b65620062d4f4e35c1e61.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:18:58Z',
'fuel_type': 'petrol',
'id': 'd0b3edc3-54ee-5d10-a257-8964ec12603e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE75344',
'listing': 'auction',
'location': 'DE, Ulm-Senden',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 220560,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b3edc3-54ee-5d10-a257-8964ec12603e/d0b3edc3-54ee-5d10-a257-8964ec12603e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78811,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_0e8acabbb7b9d1a84ffc1e2efc51548f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b3edc3-54ee-5d10-a257-8964ec12603e/d0b3edc3-54ee-5d10-a257-8964ec12603e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78171,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_4d34b4530e5b70824ee5682be0a83847.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b3edc3-54ee-5d10-a257-8964ec12603e/d0b3edc3-54ee-5d10-a257-8964ec12603e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75902,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_b8575cd9fe4ef18d18b30a8e74d388bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b3edc3-54ee-5d10-a257-8964ec12603e/d0b3edc3-54ee-5d10-a257-8964ec12603e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_457b7f977e3dd4f3c8251f19d85029a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b3edc3-54ee-5d10-a257-8964ec12603e/d0b3edc3-54ee-5d10-a257-8964ec12603e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122555,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_869a0d2bdb7b65620062d4f4e35c1e61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b3edc3-54ee-5d10-a257-8964ec12603e/d0b3edc3-54ee-5d10-a257-8964ec12603e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/0c/760c76742eb4ee73b660455afa340ff8/pa/ZE75344_59c4e2ed8094502f24473c4f634fe9b7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-09-30',
'seats_number': 7,
'seller_name': None,
'title': 'Volkswagen Touran 1.4 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2010}
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE75344%27 HTTP/1.1" 200 None
2026-03-27 10:45:39 [auto1.de] INFO: Saving data for ZE75344: {'created_time': 1774608339.267499, 'last_price_update_time': 1774608339.267514, 'auction_closing_time': 1774714738.0}
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE75344') HTTP/1.1" 204 0
2026-03-27 10:45:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68658590-2bbf-5ac0-bea9-29e94c7e6106 with identifier: AY57435
2026-03-27 10:45:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68658590-2bbf-5ac0-bea9-29e94c7e6106 with identifier: AY57435
2026-03-27 10:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68658590-2bbf-5ac0-bea9-29e94c7e6106 with identifier: AY57435 to the API
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_fa0c10ad126068cf5aa20f3b6c5412d5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:42:22Z',
'fuel_type': 'petrol',
'id': '68658590-2bbf-5ac0-bea9-29e94c7e6106',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY57435',
'listing': 'auction',
'location': 'Regensburg',
'make': 'Toyota',
'model': 'Auris',
'odometer': 80979,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_fa0c10ad126068cf5aa20f3b6c5412d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_9336f76eace50d2c9b54a89659b53059.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71064,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_321f05eaa4cbbf8a4f8b5ce8e6c4e5b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71326,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_93eb24c256a915b43451ddb61ee6aef1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74979,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_e572358c3575e1dbef99f4a2fb6f9013.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75055,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_cac7f7b4927bea64e190f56034a46246.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73713,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_e0fb89cfa4f987b314e0e25104229957.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_c53c8c0f49536fa362dd8d8e131f3f83.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77963,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_cef5777f9058d089ff4877510e9ab2d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68658590-2bbf-5ac0-bea9-29e94c7e6106/68658590-2bbf-5ac0-bea9-29e94c7e6106_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76976,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/06/2e066bffb4385dbd34ef26fe29da62d5/pa/AY57435_bc38d12833ea8e8954d009c55eeb3f26.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-01-20',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Auris 1.3 Cool',
'transmission': 'manual',
'trim': 'Cool',
'year': 2016}
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY57435%27 HTTP/1.1" 200 None
2026-03-27 10:45:39 [auto1.de] INFO: Saving data for AY57435: {'created_time': 1774608339.877896, 'last_price_update_time': 1774608339.87791, 'auction_closing_time': 1774716142.0}
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY57435') HTTP/1.1" 204 0
2026-03-27 10:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be249990>
2026-03-27 10:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_50935158fa3bf452144690b2708fb1c9.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_50935158fa3bf452144690b2708fb1c9.jpg saved to cache
2026-03-27 10:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83e8b967-8a3d-51fd-b23b-05555d728276
2026-03-27 10:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_45f75f3570bc99f24cb3b0e9304a16ce.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_3fa9cb735d41ad1e6a2ce030dc47b74f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_9b80c46a7b2297e1e1e87f8984be357e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be01a850>
2026-03-27 10:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Ff1%252F37f180230b6ab0b30302fa25b3913391%252Fpa%252FJL91815_45f75f3570bc99f24cb3b0e9304a16ce.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_45f75f3570bc99f24cb3b0e9304a16ce.jpg saved to cache
2026-03-27 10:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93b4b4e9-50cb-5882-b364-b47601ed4dc6
2026-03-27 10:45:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93b4b4e9-50cb-5882-b364-b47601ed4dc6, skipping ID generation
2026-03-27 10:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93b4b4e9-50cb-5882-b364-b47601ed4dc6 with scrape type 1
2026-03-27 10:45:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93b4b4e9-50cb-5882-b364-b47601ed4dc6 sending to next pipeline
2026-03-27 10:45:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93b4b4e9-50cb-5882-b364-b47601ed4dc6, identifier: JL91815
2026-03-27 10:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93b4b4e9-50cb-5882-b364-b47601ed4dc6 with identifier: JL91815
2026-03-27 10:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93b4b4e9-50cb-5882-b364-b47601ed4dc6 with identifier: JL91815
2026-03-27 10:45:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93b4b4e9-50cb-5882-b364-b47601ed4dc6 with identifier: JL91815 to the API
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_45f75f3570bc99f24cb3b0e9304a16ce.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:13:21Z',
'fuel_type': 'petrol',
'id': '93b4b4e9-50cb-5882-b364-b47601ed4dc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL91815',
'listing': 'auction',
'location': 'DE, Hilden',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 88428,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2664558,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_45f75f3570bc99f24cb3b0e9304a16ce.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64643,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_b070ff33ceac83edd5cbf7525d0eb8f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_abc67f1c8c7251430cbf356f99518281.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_cb3692503699f566de88f1342c513be2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58077,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_5d25bdfcf552fbfe3209b6aaf71eafb3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69186,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_f15aae59ca51538f6d3edb8f71e69977.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_403d58c4b9abd6de58d5bc97708ed7d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70114,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_b99eeed546e8d86538659cee65a24bb4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_6c8630af8054ad0db49ba96490bda0d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93b4b4e9-50cb-5882-b364-b47601ed4dc6/93b4b4e9-50cb-5882-b364-b47601ed4dc6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64914,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/f1/37f180230b6ab0b30302fa25b3913391/pa/JL91815_057e79a02ef8e05516b883bd91367a8d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-06',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180',
'transmission': 'manual',
'trim': '',
'year': 2017}
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL91815%27 HTTP/1.1" 200 None
2026-03-27 10:45:40 [auto1.de] INFO: Saving data for JL91815: {'created_time': 1774608340.673145, 'last_price_update_time': 1774608340.673162, 'auction_closing_time': 1774714401.0}
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL91815') HTTP/1.1" 204 0
2026-03-27 10:45:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3d7910>
2026-03-27 10:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_3fa9cb735d41ad1e6a2ce030dc47b74f.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_3fa9cb735d41ad1e6a2ce030dc47b74f.jpg saved to cache
2026-03-27 10:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 83e8b967-8a3d-51fd-b23b-05555d728276
2026-03-27 10:45:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c42547d0>
2026-03-27 10:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F80%252F4380724c34e7c552dacafe45f59379a7%252Fpa%252FHB31061_9b80c46a7b2297e1e1e87f8984be357e.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_9b80c46a7b2297e1e1e87f8984be357e.jpg saved to cache
2026-03-27 10:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 83e8b967-8a3d-51fd-b23b-05555d728276
2026-03-27 10:45:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 83e8b967-8a3d-51fd-b23b-05555d728276, skipping ID generation
2026-03-27 10:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83e8b967-8a3d-51fd-b23b-05555d728276 with scrape type 1
2026-03-27 10:45:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83e8b967-8a3d-51fd-b23b-05555d728276 sending to next pipeline
2026-03-27 10:45:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83e8b967-8a3d-51fd-b23b-05555d728276, identifier: HB31061
2026-03-27 10:45:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83e8b967-8a3d-51fd-b23b-05555d728276 with identifier: HB31061
2026-03-27 10:45:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83e8b967-8a3d-51fd-b23b-05555d728276 with identifier: HB31061
2026-03-27 10:45:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83e8b967-8a3d-51fd-b23b-05555d728276 with identifier: HB31061 to the API
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_9b80c46a7b2297e1e1e87f8984be357e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 122,
'expiration_date': '2026-03-28T16:15:05Z',
'fuel_type': 'petrol',
'id': '83e8b967-8a3d-51fd-b23b-05555d728276',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB31061',
'listing': 'auction',
'location': 'DE, Chemnitz',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 112719,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68945,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_50935158fa3bf452144690b2708fb1c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3002221,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_9b80c46a7b2297e1e1e87f8984be357e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2961267,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_3fa9cb735d41ad1e6a2ce030dc47b74f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2906135,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_f621442fe68da84898f515257506ec8e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_f2f430990ec47190549048c83ebe341d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_8c6e1dee208602d9fabdf847325bc262.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_1a3d79b38f33657271658709c1411389.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2972121,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_bbbca294c4b1702f70efda2c00fa921c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63248,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_3fcdddf86b7e083e8afebb8a100d59df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e8b967-8a3d-51fd-b23b-05555d728276/83e8b967-8a3d-51fd-b23b-05555d728276_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70665,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/80/4380724c34e7c552dacafe45f59379a7/pa/HB31061_eee1529dd7f89a17b351f8a0fbe1ae98.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-03-02',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 1.4 TSI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2009}
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB31061%27 HTTP/1.1" 200 None
2026-03-27 10:45:41 [auto1.de] INFO: Saving data for HB31061: {'created_time': 1774608341.52851, 'last_price_update_time': 1774608341.528523, 'auction_closing_time': 1774714505.0}
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB31061') HTTP/1.1" 204 0
2026-03-27 10:45:41 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 132.882(s), this was the 1st time calling it.
2026-03-27 10:45:41 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.445985301789971 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:45:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN46705/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN46705> (referer: https://www.auto1.com/v1/car-details-view/EN46705/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3640239-69bd-5ce3-877b-7f4b6ed81c7a with identifier: EN46705
2026-03-27 10:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3640239-69bd-5ce3-877b-7f4b6ed81c7a with scrape type 1
2026-03-27 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3640239-69bd-5ce3-877b-7f4b6ed81c7a
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_9bb182dc356cb6afed6dc39728cb2af1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_9bb182dc356cb6afed6dc39728cb2af1.jpg not downloaded yet
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_50aae321c6685dcb822dfd66bcdacd20.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_50aae321c6685dcb822dfd66bcdacd20.jpg not downloaded yet
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_07a97b798ba40a071d8340963ac392cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_07a97b798ba40a071d8340963ac392cf.jpg not downloaded yet
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_ad7cf896f3b6b249616dd7d23d0cbf72.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_ad7cf896f3b6b249616dd7d23d0cbf72.jpg not downloaded yet
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_2442770ff9911737ed62548596e93865.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_2442770ff9911737ed62548596e93865.jpg not downloaded yet
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_eb500085cb130256500855ea7a84c6fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_eb500085cb130256500855ea7a84c6fc.jpg not downloaded yet
2026-03-27 10:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_9bb182dc356cb6afed6dc39728cb2af1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_14fb0bc49aa07d8785d86317a9534cfa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_14fb0bc49aa07d8785d86317a9534cfa.jpg not downloaded yet
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_1238097db571081918446188f76ad803.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_1238097db571081918446188f76ad803.jpg not downloaded yet
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_681ad09ecdb2f780f8f96c9f39218c7d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_681ad09ecdb2f780f8f96c9f39218c7d.jpg not downloaded yet
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_8de274fe6fd0e051fb1faaff8cc6edf4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_8de274fe6fd0e051fb1faaff8cc6edf4.jpg not downloaded yet
2026-03-27 10:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_50aae321c6685dcb822dfd66bcdacd20.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c53c6350>
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_9bb182dc356cb6afed6dc39728cb2af1.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_9bb182dc356cb6afed6dc39728cb2af1.jpg saved to cache
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3640239-69bd-5ce3-877b-7f4b6ed81c7a
2026-03-27 10:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_07a97b798ba40a071d8340963ac392cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be0cc350>
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_50aae321c6685dcb822dfd66bcdacd20.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_50aae321c6685dcb822dfd66bcdacd20.jpg saved to cache
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f3640239-69bd-5ce3-877b-7f4b6ed81c7a
2026-03-27 10:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_2442770ff9911737ed62548596e93865.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2e4d10>
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_07a97b798ba40a071d8340963ac392cf.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_07a97b798ba40a071d8340963ac392cf.jpg saved to cache
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3640239-69bd-5ce3-877b-7f4b6ed81c7a
2026-03-27 10:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_681ad09ecdb2f780f8f96c9f39218c7d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_8de274fe6fd0e051fb1faaff8cc6edf4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_eb500085cb130256500855ea7a84c6fc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_ad7cf896f3b6b249616dd7d23d0cbf72.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_14fb0bc49aa07d8785d86317a9534cfa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf555e90>
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_2442770ff9911737ed62548596e93865.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_2442770ff9911737ed62548596e93865.jpg saved to cache
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f3640239-69bd-5ce3-877b-7f4b6ed81c7a
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be167b50>
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_681ad09ecdb2f780f8f96c9f39218c7d.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_681ad09ecdb2f780f8f96c9f39218c7d.jpg saved to cache
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f3640239-69bd-5ce3-877b-7f4b6ed81c7a
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c424ab90>
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_8de274fe6fd0e051fb1faaff8cc6edf4.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_8de274fe6fd0e051fb1faaff8cc6edf4.jpg saved to cache
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f3640239-69bd-5ce3-877b-7f4b6ed81c7a
2026-03-27 10:45:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf326ad0>
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_eb500085cb130256500855ea7a84c6fc.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_eb500085cb130256500855ea7a84c6fc.jpg saved to cache
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3640239-69bd-5ce3-877b-7f4b6ed81c7a
2026-03-27 10:45:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf35dc10>
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_ad7cf896f3b6b249616dd7d23d0cbf72.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_ad7cf896f3b6b249616dd7d23d0cbf72.jpg saved to cache
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f3640239-69bd-5ce3-877b-7f4b6ed81c7a
2026-03-27 10:45:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf356c10>
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_14fb0bc49aa07d8785d86317a9534cfa.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_14fb0bc49aa07d8785d86317a9534cfa.jpg saved to cache
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f3640239-69bd-5ce3-877b-7f4b6ed81c7a
2026-03-27 10:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_1238097db571081918446188f76ad803.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be209350>
2026-03-27 10:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319990cf9a336344ac23f3c92430b37%252Fpa%252FEN46705_1238097db571081918446188f76ad803.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_1238097db571081918446188f76ad803.jpg saved to cache
2026-03-27 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f3640239-69bd-5ce3-877b-7f4b6ed81c7a
2026-03-27 10:45:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3640239-69bd-5ce3-877b-7f4b6ed81c7a, skipping ID generation
2026-03-27 10:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3640239-69bd-5ce3-877b-7f4b6ed81c7a with scrape type 1
2026-03-27 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3640239-69bd-5ce3-877b-7f4b6ed81c7a sending to next pipeline
2026-03-27 10:45:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3640239-69bd-5ce3-877b-7f4b6ed81c7a, identifier: EN46705
2026-03-27 10:45:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3640239-69bd-5ce3-877b-7f4b6ed81c7a with identifier: EN46705
2026-03-27 10:45:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3640239-69bd-5ce3-877b-7f4b6ed81c7a with identifier: EN46705
2026-03-27 10:45:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3640239-69bd-5ce3-877b-7f4b6ed81c7a with identifier: EN46705 to the API
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_1238097db571081918446188f76ad803.jpg>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:57:07Z',
'fuel_type': 'diesel',
'id': 'f3640239-69bd-5ce3-877b-7f4b6ed81c7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN46705',
'listing': 'auction',
'location': 'DE, Dresden',
'make': 'Volkswagen',
'model': 'T6 Caravelle',
'odometer': 368178,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61763,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_9bb182dc356cb6afed6dc39728cb2af1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_50aae321c6685dcb822dfd66bcdacd20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41716,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_07a97b798ba40a071d8340963ac392cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2355062,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_ad7cf896f3b6b249616dd7d23d0cbf72.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36155,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_2442770ff9911737ed62548596e93865.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2812315,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_eb500085cb130256500855ea7a84c6fc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2551215,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_14fb0bc49aa07d8785d86317a9534cfa.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2554804,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_1238097db571081918446188f76ad803.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58028,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_681ad09ecdb2f780f8f96c9f39218c7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3640239-69bd-5ce3-877b-7f4b6ed81c7a/f3640239-69bd-5ce3-877b-7f4b6ed81c7a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58425,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319990cf9a336344ac23f3c92430b37/pa/EN46705_8de274fe6fd0e051fb1faaff8cc6edf4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-26',
'seats_number': 6,
'seller_name': None,
'title': 'Volkswagen T6 Caravelle 2.0 TDI Comfortline lang',
'transmission': 'automatic',
'trim': 'Comfortline lang',
'year': 2017}
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN46705%27 HTTP/1.1" 200 None
2026-03-27 10:45:51 [auto1.de] INFO: Saving data for EN46705: {'created_time': 1774608351.743091, 'last_price_update_time': 1774608351.743107, 'auction_closing_time': 1774717027.0}
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN46705') HTTP/1.1" 204 0
2026-03-27 10:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB79504> (referer: https://www.auto1.com/v1/car-details-view/AB79504/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b72cc7b6-e2a6-536a-9133-863a3c2098c4 with identifier: AB79504
2026-03-27 10:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b72cc7b6-e2a6-536a-9133-863a3c2098c4 with scrape type 1
2026-03-27 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b72cc7b6-e2a6-536a-9133-863a3c2098c4
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_4209f17265589ede5b2c98654c842139.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_4209f17265589ede5b2c98654c842139.jpg not downloaded yet
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_fd4912cc053df828dca3bb5146356ac7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_fd4912cc053df828dca3bb5146356ac7.jpg not downloaded yet
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_6017a7020c1bc9c91ea4b835bf8c79f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_6017a7020c1bc9c91ea4b835bf8c79f1.jpg not downloaded yet
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_a59a6a930824a43a0d5420017de8cdf0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_a59a6a930824a43a0d5420017de8cdf0.jpg not downloaded yet
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_b0ddd4e9319ee9a5ead183b2228debc4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_b0ddd4e9319ee9a5ead183b2228debc4.jpg not downloaded yet
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_01096bc6a21b67c51810a5158ae73976.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_01096bc6a21b67c51810a5158ae73976.jpg not downloaded yet
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_4209f17265589ede5b2c98654c842139.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_3e6f7eb837f06774470198eee69505b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_3e6f7eb837f06774470198eee69505b1.jpg not downloaded yet
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_f6c8cdfb5f4d1513fcb96963444fe05b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_f6c8cdfb5f4d1513fcb96963444fe05b.jpg not downloaded yet
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_396cb4e039f9c7bcba219bca31497627.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_396cb4e039f9c7bcba219bca31497627.jpg not downloaded yet
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_cff28373717cb12588e04630c03428aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_cff28373717cb12588e04630c03428aa.jpg not downloaded yet
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_b0ddd4e9319ee9a5ead183b2228debc4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be1ed650>
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_4209f17265589ede5b2c98654c842139.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_4209f17265589ede5b2c98654c842139.jpg saved to cache
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b72cc7b6-e2a6-536a-9133-863a3c2098c4
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_a59a6a930824a43a0d5420017de8cdf0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_01096bc6a21b67c51810a5158ae73976.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_cff28373717cb12588e04630c03428aa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_fd4912cc053df828dca3bb5146356ac7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_3e6f7eb837f06774470198eee69505b1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_f6c8cdfb5f4d1513fcb96963444fe05b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_6017a7020c1bc9c91ea4b835bf8c79f1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be165750>
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_b0ddd4e9319ee9a5ead183b2228debc4.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_b0ddd4e9319ee9a5ead183b2228debc4.jpg saved to cache
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b72cc7b6-e2a6-536a-9133-863a3c2098c4
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_396cb4e039f9c7bcba219bca31497627.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3d7dd0>
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_a59a6a930824a43a0d5420017de8cdf0.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_a59a6a930824a43a0d5420017de8cdf0.jpg saved to cache
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b72cc7b6-e2a6-536a-9133-863a3c2098c4
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be223f50>
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_01096bc6a21b67c51810a5158ae73976.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_01096bc6a21b67c51810a5158ae73976.jpg saved to cache
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b72cc7b6-e2a6-536a-9133-863a3c2098c4
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be24bf50>
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_cff28373717cb12588e04630c03428aa.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_cff28373717cb12588e04630c03428aa.jpg saved to cache
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b72cc7b6-e2a6-536a-9133-863a3c2098c4
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5c41110>
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_fd4912cc053df828dca3bb5146356ac7.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_fd4912cc053df828dca3bb5146356ac7.jpg saved to cache
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b72cc7b6-e2a6-536a-9133-863a3c2098c4
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be248850>
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_3e6f7eb837f06774470198eee69505b1.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_3e6f7eb837f06774470198eee69505b1.jpg saved to cache
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b72cc7b6-e2a6-536a-9133-863a3c2098c4
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf3aded0>
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_f6c8cdfb5f4d1513fcb96963444fe05b.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_f6c8cdfb5f4d1513fcb96963444fe05b.jpg saved to cache
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b72cc7b6-e2a6-536a-9133-863a3c2098c4
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2cfb90>
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_6017a7020c1bc9c91ea4b835bf8c79f1.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_6017a7020c1bc9c91ea4b835bf8c79f1.jpg saved to cache
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b72cc7b6-e2a6-536a-9133-863a3c2098c4
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf300b10>
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F07%252F3c07c1b5ad4e306cf7c291fdca1a93a5%252Fpa%252FAB79504_396cb4e039f9c7bcba219bca31497627.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_396cb4e039f9c7bcba219bca31497627.jpg saved to cache
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b72cc7b6-e2a6-536a-9133-863a3c2098c4
2026-03-27 10:45:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b72cc7b6-e2a6-536a-9133-863a3c2098c4, skipping ID generation
2026-03-27 10:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b72cc7b6-e2a6-536a-9133-863a3c2098c4 with scrape type 1
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b72cc7b6-e2a6-536a-9133-863a3c2098c4 sending to next pipeline
2026-03-27 10:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b72cc7b6-e2a6-536a-9133-863a3c2098c4, identifier: AB79504
2026-03-27 10:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b72cc7b6-e2a6-536a-9133-863a3c2098c4 with identifier: AB79504
2026-03-27 10:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b72cc7b6-e2a6-536a-9133-863a3c2098c4 with identifier: AB79504
2026-03-27 10:45:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b72cc7b6-e2a6-536a-9133-863a3c2098c4 with identifier: AB79504 to the API
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_396cb4e039f9c7bcba219bca31497627.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.1L',
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:01:30Z',
'fuel_type': 'petrol',
'id': 'b72cc7b6-e2a6-536a-9133-863a3c2098c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB79504',
'listing': 'auction',
'location': 'DE, Nürnberg',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 118697,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78547,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_4209f17265589ede5b2c98654c842139.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74541,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_fd4912cc053df828dca3bb5146356ac7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_6017a7020c1bc9c91ea4b835bf8c79f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70993,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_a59a6a930824a43a0d5420017de8cdf0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70777,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_b0ddd4e9319ee9a5ead183b2228debc4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70025,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_01096bc6a21b67c51810a5158ae73976.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68525,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_3e6f7eb837f06774470198eee69505b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72543,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_f6c8cdfb5f4d1513fcb96963444fe05b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_396cb4e039f9c7bcba219bca31497627.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b72cc7b6-e2a6-536a-9133-863a3c2098c4/b72cc7b6-e2a6-536a-9133-863a3c2098c4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57006,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/07/3c07c1b5ad4e306cf7c291fdca1a93a5/pa/AB79504_cff28373717cb12588e04630c03428aa.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-11',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.1 Cool&Connect',
'transmission': 'manual',
'trim': 'Cool&Connect',
'year': 2018}
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB79504%27 HTTP/1.1" 200 None
2026-03-27 10:45:53 [auto1.de] INFO: Saving data for AB79504: {'created_time': 1774608353.351295, 'last_price_update_time': 1774608353.351305, 'auction_closing_time': 1774713690.0}
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB79504') HTTP/1.1" 204 0
2026-03-27 10:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:55 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 10546 | hits on page: 40
2026-03-27 10:45:55 [auto1.de] INFO: Found listing with ID: TT64948
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT64948%27 HTTP/1.1" 200 None
2026-03-27 10:45:56 [auto1.de] INFO: Scrape type for TT64948: 0
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN00007%27 HTTP/1.1" 200 None
2026-03-27 10:45:56 [auto1.de] INFO: Scrape type for FN00007: 0
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: MD24285
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD24285%27 HTTP/1.1" 200 None
2026-03-27 10:45:56 [auto1.de] INFO: Scrape type for MD24285: 0
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: PZ15198
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: CS43081
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: VK35465
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: XB83488
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: PB97983
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB97983%27 HTTP/1.1" 200 None
2026-03-27 10:45:56 [auto1.de] INFO: Scrape type for PB97983: 0
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: TJ47343
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ47343%27 HTTP/1.1" 200 None
2026-03-27 10:45:56 [auto1.de] INFO: Scrape type for TJ47343: 0
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: EW59604
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW59604%27 HTTP/1.1" 200 None
2026-03-27 10:45:56 [auto1.de] INFO: Scrape type for EW59604: 0
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: PW82810
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: UF12983
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: CU83309
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: BS12588
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: KX53011
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX53011%27 HTTP/1.1" 200 None
2026-03-27 10:45:56 [auto1.de] INFO: Scrape type for KX53011: 0
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: HU83387
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: PC88965
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC88965%27 HTTP/1.1" 200 None
2026-03-27 10:45:56 [auto1.de] INFO: Scrape type for PC88965: 0
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: DB01962
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB01962%27 HTTP/1.1" 200 None
2026-03-27 10:45:56 [auto1.de] INFO: Scrape type for DB01962: 0
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: AX06709
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX06709%27 HTTP/1.1" 200 None
2026-03-27 10:45:56 [auto1.de] INFO: Scrape type for AX06709: 0
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: PZ75208
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ75208%27 HTTP/1.1" 200 None
2026-03-27 10:45:56 [auto1.de] INFO: Scrape type for PZ75208: 0
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: YE66561
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: PP34384
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: XK86433
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK86433%27 HTTP/1.1" 200 None
2026-03-27 10:45:56 [auto1.de] INFO: Scrape type for XK86433: 0
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: YF34973
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: KM41790
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: YB74722
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB74722%27 HTTP/1.1" 200 None
2026-03-27 10:45:56 [auto1.de] INFO: Scrape type for YB74722: 0
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: WH24454
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH24454%27 HTTP/1.1" 200 None
2026-03-27 10:45:56 [auto1.de] INFO: Scrape type for WH24454: 0
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: EJ40923
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ40923%27 HTTP/1.1" 200 None
2026-03-27 10:45:56 [auto1.de] INFO: Scrape type for EJ40923: 0
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: LF15045
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: NY54284
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY54284%27 HTTP/1.1" 200 None
2026-03-27 10:45:56 [auto1.de] INFO: Scrape type for NY54284: 0
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: GG72977
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: FS85079
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: XP07522
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP07522%27 HTTP/1.1" 200 None
2026-03-27 10:45:56 [auto1.de] INFO: Scrape type for XP07522: 0
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: YH30461
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: TT10154
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: WS38719
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: AZ12620
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: FX92929
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX92929%27 HTTP/1.1" 200 None
2026-03-27 10:45:56 [auto1.de] INFO: Scrape type for FX92929: 0
2026-03-27 10:45:56 [auto1.de] INFO: Found listing with ID: MM64196
2026-03-27 10:45:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:58 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 10546 | hits on page: 40
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: SS53200
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS53200%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for SS53200: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: LH98636
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH98636%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for LH98636: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: UM45865
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: AC56018
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC56018%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for AC56018: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: TB15479
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96832%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for BV96832: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: RJ03862
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ03862%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for RJ03862: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU04688%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for ZU04688: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: YM50991
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: LW43153
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: EL74738
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL74738%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for EL74738: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: BA39633
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA39633%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for BA39633: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX03120%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for DX03120: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: LX87284
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX87284%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for LX87284: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: SL35659
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: UR30493
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM39243%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for JM39243: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: XU99482
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU99482%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for XU99482: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL30108%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for FL30108: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: RS30445
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS30445%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for RS30445: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: AR77656
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR77656%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for AR77656: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF79085%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for RF79085: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS74184%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for YS74184: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK97708%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for YK97708: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV99123%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for HV99123: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: FC70862
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC70862%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for FC70862: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC06801%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for NC06801: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN58886%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for UN58886: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: VV06990
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV06990%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for VV06990: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: FP09616
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP09616%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for FP09616: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: SR89138
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT56915%27 HTTP/1.1" 200 None
2026-03-27 10:45:58 [auto1.de] INFO: Scrape type for YT56915: 0
2026-03-27 10:45:58 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-27 10:45:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:01 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 10547 | hits on page: 40
2026-03-27 10:46:01 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-27 10:46:01 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS21978%27 HTTP/1.1" 200 None
2026-03-27 10:46:01 [auto1.de] INFO: Scrape type for XS21978: 0
2026-03-27 10:46:01 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41784%27 HTTP/1.1" 200 None
2026-03-27 10:46:01 [auto1.de] INFO: Scrape type for MF41784: 0
2026-03-27 10:46:01 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-27 10:46:01 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-27 10:46:01 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW08292%27 HTTP/1.1" 200 None
2026-03-27 10:46:01 [auto1.de] INFO: Scrape type for AW08292: 0
2026-03-27 10:46:01 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC44311%27 HTTP/1.1" 200 None
2026-03-27 10:46:01 [auto1.de] INFO: Scrape type for EC44311: 0
2026-03-27 10:46:01 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW13893%27 HTTP/1.1" 200 None
2026-03-27 10:46:01 [auto1.de] INFO: Scrape type for CW13893: 0
2026-03-27 10:46:01 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-27 10:46:01 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09458%27 HTTP/1.1" 200 None
2026-03-27 10:46:01 [auto1.de] INFO: Scrape type for LL09458: 0
2026-03-27 10:46:01 [auto1.de] INFO: Found listing with ID: AF40281
2026-03-27 10:46:01 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-27 10:46:01 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-27 10:46:01 [auto1.de] INFO: Found listing with ID: HW97387
2026-03-27 10:46:01 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY19584%27 HTTP/1.1" 200 None
2026-03-27 10:46:01 [auto1.de] INFO: Scrape type for WY19584: 0
2026-03-27 10:46:01 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL23601%27 HTTP/1.1" 200 None
2026-03-27 10:46:01 [auto1.de] INFO: Scrape type for RL23601: 0
2026-03-27 10:46:01 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG38928%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [auto1.de] INFO: Scrape type for HG38928: 0
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: KP41876
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP41876%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [auto1.de] INFO: Scrape type for KP41876: 0
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72462%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [auto1.de] INFO: Scrape type for RW72462: 0
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR91039%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [auto1.de] INFO: Scrape type for PR91039: 0
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: WN39089
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN39089%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [auto1.de] INFO: Scrape type for WN39089: 0
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL40040%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [auto1.de] INFO: Scrape type for WL40040: 0
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: YT66272
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB40051%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [auto1.de] INFO: Scrape type for CB40051: 0
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: KD39094
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD39094%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [auto1.de] INFO: Scrape type for KD39094: 0
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: XT19157
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: SK57616
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK57616%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [auto1.de] INFO: Scrape type for SK57616: 0
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF32306%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [auto1.de] INFO: Scrape type for YF32306: 0
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: NY16569
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD66077%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [auto1.de] INFO: Scrape type for BD66077: 0
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-27 10:46:02 [auto1.de] INFO: Found listing with ID: HL50945
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL50945%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [auto1.de] INFO: Scrape type for HL50945: 0
2026-03-27 10:46:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:07 [scrapy.extensions.logstats] INFO: Crawled 452 pages (at 34 pages/min), scraped 928 items (at 38 items/min)
2026-03-27 10:46:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-27 10:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:10 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 10549 | hits on page: 40
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: HL50945
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL50945%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for HL50945: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP85983%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for DP85983: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: KC05152
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC05152%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for KC05152: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: LN11604
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11604%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for LN11604: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: TM05155
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: RL83266
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: LC81158
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD13909%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for JD13909: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: VS07108
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS07108%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for VS07108: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: AR17356
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: KF20598
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: TH73061
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND58698%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for ND58698: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: GP51980
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP51980%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for GP51980: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: LT54057
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT54057%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for LT54057: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: GR72963
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF35410%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for HF35410: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX25662%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for FX25662: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: ZF80187
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF80187%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for ZF80187: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: LC07612
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC07612%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for LC07612: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: RP33469
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: DV01319
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT08770%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for MT08770: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: VC98877
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC98877%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for VC98877: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA95146%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for UA95146: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ54071%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for DJ54071: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: GZ60410
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ60410%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for GZ60410: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR47170%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for GR47170: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: WW55447
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW55447%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for WW55447: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ74150%27 HTTP/1.1" 200 None
2026-03-27 10:46:10 [auto1.de] INFO: Scrape type for EJ74150: 0
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-27 10:46:10 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-27 10:46:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:12 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.816(s), this was the 1st time calling it.
2026-03-27 10:46:12 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.351451721166587 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:12 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 10549 | hits on page: 40
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP04527%27 HTTP/1.1" 200 None
2026-03-27 10:46:12 [auto1.de] INFO: Scrape type for BP04527: 0
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA78994%27 HTTP/1.1" 200 None
2026-03-27 10:46:12 [auto1.de] INFO: Scrape type for XA78994: 0
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: CA34591
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA34591%27 HTTP/1.1" 200 None
2026-03-27 10:46:12 [auto1.de] INFO: Scrape type for CA34591: 0
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT68659%27 HTTP/1.1" 200 None
2026-03-27 10:46:12 [auto1.de] INFO: Scrape type for TT68659: 0
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: KL31519
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: WD80617
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77262%27 HTTP/1.1" 200 None
2026-03-27 10:46:12 [auto1.de] INFO: Scrape type for DW77262: 0
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG86685%27 HTTP/1.1" 200 None
2026-03-27 10:46:12 [auto1.de] INFO: Scrape type for BG86685: 0
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG74955%27 HTTP/1.1" 200 None
2026-03-27 10:46:12 [auto1.de] INFO: Scrape type for NG74955: 0
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP93113%27 HTTP/1.1" 200 None
2026-03-27 10:46:12 [auto1.de] INFO: Scrape type for MP93113: 0
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK07522%27 HTTP/1.1" 200 None
2026-03-27 10:46:12 [auto1.de] INFO: Scrape type for ZK07522: 0
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: UT62888
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF55933%27 HTTP/1.1" 200 None
2026-03-27 10:46:12 [auto1.de] INFO: Scrape type for SF55933: 0
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: NM17989
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: ZU61192
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: PE44862
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: EA70059
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: RU77143
2026-03-27 10:46:12 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-27 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM77424%27 HTTP/1.1" 200 None
2026-03-27 10:46:13 [auto1.de] INFO: Scrape type for EM77424: 0
2026-03-27 10:46:13 [auto1.de] INFO: Found listing with ID: BT78007
2026-03-27 10:46:13 [auto1.de] INFO: Found listing with ID: FT39707
2026-03-27 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT39707%27 HTTP/1.1" 200 None
2026-03-27 10:46:13 [auto1.de] INFO: Scrape type for FT39707: 0
2026-03-27 10:46:13 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-27 10:46:13 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-27 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB89503%27 HTTP/1.1" 200 None
2026-03-27 10:46:13 [auto1.de] INFO: Scrape type for RB89503: 0
2026-03-27 10:46:13 [auto1.de] INFO: Found listing with ID: DF56561
2026-03-27 10:46:13 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-27 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW82351%27 HTTP/1.1" 200 None
2026-03-27 10:46:13 [auto1.de] INFO: Scrape type for DW82351: 0
2026-03-27 10:46:13 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-27 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG11243%27 HTTP/1.1" 200 None
2026-03-27 10:46:13 [auto1.de] INFO: Scrape type for LG11243: 0
2026-03-27 10:46:13 [auto1.de] INFO: Found listing with ID: ZN63740
2026-03-27 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN63740%27 HTTP/1.1" 200 None
2026-03-27 10:46:13 [auto1.de] INFO: Scrape type for ZN63740: 0
2026-03-27 10:46:13 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-27 10:46:13 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-27 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM68518%27 HTTP/1.1" 200 None
2026-03-27 10:46:13 [auto1.de] INFO: Scrape type for CM68518: 0
2026-03-27 10:46:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:21 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 10550 | hits on page: 40
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM68518%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for CM68518: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: HE99483
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE99483%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for HE99483: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL38204%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for ZL38204: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH69099%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for CH69099: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: CA82513
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF68220%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for CF68220: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: MH82983
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED89448%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for ED89448: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34905%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for UH34905: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: SN43229
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: YF68653
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF68653%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for YF68653: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: HA84095
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: NW08152
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU22691%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for LU22691: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: ER86835
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER86835%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for ER86835: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: RB35490
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB35490%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for RB35490: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: AP00177
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: KZ11902
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ11902%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for KZ11902: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: HW63647
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW63647%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for HW63647: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: BZ95639
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU35907%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for UU35907: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU13937%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for CU13937: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: JC65940
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC65940%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for JC65940: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: AC60710
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC60710%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for AC60710: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: GL86487
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL86487%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for GL86487: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: JT80939
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT80939%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for JT80939: 0
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: SC46764
2026-03-27 10:46:21 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD59172%27 HTTP/1.1" 200 None
2026-03-27 10:46:21 [auto1.de] INFO: Scrape type for SD59172: 0
2026-03-27 10:46:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XJ62576/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XJ62576> (referer: https://www.auto1.com/v1/car-details-view/XJ62576/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a80eae5e-5aca-57a8-90ad-f7cd28bef639 with identifier: XJ62576
2026-03-27 10:46:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a80eae5e-5aca-57a8-90ad-f7cd28bef639 with scrape type 1
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a80eae5e-5aca-57a8-90ad-f7cd28bef639
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_fab9e5822bcd0d8afb6a352b71f31291.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_fab9e5822bcd0d8afb6a352b71f31291.jpg not downloaded yet
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_7e2ec1cbae8c95500af869b5f7fd31ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_7e2ec1cbae8c95500af869b5f7fd31ea.jpg not downloaded yet
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_016c4b635c10421ddb266c5dfda93cdc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_016c4b635c10421ddb266c5dfda93cdc.jpg not downloaded yet
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_e4f0dadcefb4cca153817d3545f03793.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_e4f0dadcefb4cca153817d3545f03793.jpg not downloaded yet
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_237af22b622a9fa7208600ab9abc4e49.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_237af22b622a9fa7208600ab9abc4e49.jpg not downloaded yet
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_d9e5fd3160fcf7fb18e14361489366aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_d9e5fd3160fcf7fb18e14361489366aa.jpg not downloaded yet
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_2946db1f7545a09288dc0cd367fff4a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_2946db1f7545a09288dc0cd367fff4a7.jpg not downloaded yet
2026-03-27 10:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_fab9e5822bcd0d8afb6a352b71f31291.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_823659c626db2253b80577a88101f092.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_823659c626db2253b80577a88101f092.jpg not downloaded yet
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_2179973b3f663034a0511a07c5b50079.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_2179973b3f663034a0511a07c5b50079.jpg not downloaded yet
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_d6392b4d2dfbaec4258d84417244f98b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_d6392b4d2dfbaec4258d84417244f98b.jpg not downloaded yet
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2f9790>
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_fab9e5822bcd0d8afb6a352b71f31291.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_fab9e5822bcd0d8afb6a352b71f31291.jpg saved to cache
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a80eae5e-5aca-57a8-90ad-f7cd28bef639
2026-03-27 10:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_016c4b635c10421ddb266c5dfda93cdc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_e4f0dadcefb4cca153817d3545f03793.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_2946db1f7545a09288dc0cd367fff4a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_7e2ec1cbae8c95500af869b5f7fd31ea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_823659c626db2253b80577a88101f092.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_2179973b3f663034a0511a07c5b50079.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf4e2f50>
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_016c4b635c10421ddb266c5dfda93cdc.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_016c4b635c10421ddb266c5dfda93cdc.jpg saved to cache
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a80eae5e-5aca-57a8-90ad-f7cd28bef639
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf554390>
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_e4f0dadcefb4cca153817d3545f03793.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_e4f0dadcefb4cca153817d3545f03793.jpg saved to cache
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a80eae5e-5aca-57a8-90ad-f7cd28bef639
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be29d110>
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_2946db1f7545a09288dc0cd367fff4a7.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_2946db1f7545a09288dc0cd367fff4a7.jpg saved to cache
2026-03-27 10:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a80eae5e-5aca-57a8-90ad-f7cd28bef639
2026-03-27 10:46:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be161890>
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_7e2ec1cbae8c95500af869b5f7fd31ea.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_7e2ec1cbae8c95500af869b5f7fd31ea.jpg saved to cache
2026-03-27 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a80eae5e-5aca-57a8-90ad-f7cd28bef639
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be29c2d0>
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_823659c626db2253b80577a88101f092.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_823659c626db2253b80577a88101f092.jpg saved to cache
2026-03-27 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a80eae5e-5aca-57a8-90ad-f7cd28bef639
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be29f4d0>
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_2179973b3f663034a0511a07c5b50079.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_2179973b3f663034a0511a07c5b50079.jpg saved to cache
2026-03-27 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a80eae5e-5aca-57a8-90ad-f7cd28bef639
2026-03-27 10:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_237af22b622a9fa7208600ab9abc4e49.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_d9e5fd3160fcf7fb18e14361489366aa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_d6392b4d2dfbaec4258d84417244f98b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf58bd50>
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_237af22b622a9fa7208600ab9abc4e49.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_237af22b622a9fa7208600ab9abc4e49.jpg saved to cache
2026-03-27 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a80eae5e-5aca-57a8-90ad-f7cd28bef639
2026-03-27 10:46:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be165b50>
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_d9e5fd3160fcf7fb18e14361489366aa.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_d9e5fd3160fcf7fb18e14361489366aa.jpg saved to cache
2026-03-27 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a80eae5e-5aca-57a8-90ad-f7cd28bef639
2026-03-27 10:46:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56c5c6f810>
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F1f%252Fe51f234eccdccc0ef707c8942ede7bac%252Fpa%252FXJ62576_d6392b4d2dfbaec4258d84417244f98b.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_d6392b4d2dfbaec4258d84417244f98b.jpg saved to cache
2026-03-27 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a80eae5e-5aca-57a8-90ad-f7cd28bef639
2026-03-27 10:46:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a80eae5e-5aca-57a8-90ad-f7cd28bef639, skipping ID generation
2026-03-27 10:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a80eae5e-5aca-57a8-90ad-f7cd28bef639 with scrape type 1
2026-03-27 10:46:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a80eae5e-5aca-57a8-90ad-f7cd28bef639 sending to next pipeline
2026-03-27 10:46:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a80eae5e-5aca-57a8-90ad-f7cd28bef639, identifier: XJ62576
2026-03-27 10:46:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a80eae5e-5aca-57a8-90ad-f7cd28bef639 with identifier: XJ62576
2026-03-27 10:46:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a80eae5e-5aca-57a8-90ad-f7cd28bef639 with identifier: XJ62576
2026-03-27 10:46:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a80eae5e-5aca-57a8-90ad-f7cd28bef639 with identifier: XJ62576 to the API
2026-03-27 10:46:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_d6392b4d2dfbaec4258d84417244f98b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': 'Rental',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:25:40Z',
'fuel_type': 'petrol',
'id': 'a80eae5e-5aca-57a8-90ad-f7cd28bef639',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ62576',
'listing': 'auction',
'location': 'DE, Heilbronn',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 260278,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86466,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_fab9e5822bcd0d8afb6a352b71f31291.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2917982,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_7e2ec1cbae8c95500af869b5f7fd31ea.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2724027,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_016c4b635c10421ddb266c5dfda93cdc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59534,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_e4f0dadcefb4cca153817d3545f03793.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2945238,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_237af22b622a9fa7208600ab9abc4e49.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2827142,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_d9e5fd3160fcf7fb18e14361489366aa.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56877,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_2946db1f7545a09288dc0cd367fff4a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65436,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_823659c626db2253b80577a88101f092.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_2179973b3f663034a0511a07c5b50079.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a80eae5e-5aca-57a8-90ad-f7cd28bef639/a80eae5e-5aca-57a8-90ad-f7cd28bef639_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2961894,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge5/1f/e51f234eccdccc0ef707c8942ede7bac/pa/XJ62576_d6392b4d2dfbaec4258d84417244f98b.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-05-25',
'seats_number': 7,
'seller_name': None,
'title': 'Volkswagen Touran 1.4 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2014}
2026-03-27 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ62576%27 HTTP/1.1" 200 None
2026-03-27 10:46:25 [auto1.de] INFO: Saving data for XJ62576: {'created_time': 1774608385.576119, 'last_price_update_time': 1774608385.576131, 'auction_closing_time': 1774715140.0}
2026-03-27 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ62576') HTTP/1.1" 204 0
2026-03-27 10:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:26 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 10550 | hits on page: 40
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: LT87510
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT87510%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for LT87510: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: HS66299
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02715%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for FZ02715: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: RE68011
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE68011%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for RE68011: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: EF04397
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF04397%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for EF04397: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB40940%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for VB40940: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: EX19537
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX19537%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for EX19537: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN95759%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for YN95759: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: AM33807
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR19321%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for FR19321: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: FM78793
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78793%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for FM78793: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA19207%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for GA19207: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: KJ36924
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ36924%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for KJ36924: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK32752%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for MK32752: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ61824%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for GJ61824: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC40686%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for FC40686: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: XL96433
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL96433%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for XL96433: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: PR65982
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: AZ34844
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: JM60205
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM60205%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for JM60205: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: GF55006
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF55006%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for GF55006: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: AN12831
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: YR79281
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: SU92551
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU92551%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for SU92551: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: LS85848
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: TG14213
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG14213%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for TG14213: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: AS40376
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: TU30729
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: HU56318
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU56318%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for HU56318: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: RE74325
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: MP75232
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: XY02302
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY02302%27 HTTP/1.1" 200 None
2026-03-27 10:46:26 [auto1.de] INFO: Scrape type for XY02302: 0
2026-03-27 10:46:26 [auto1.de] INFO: Found listing with ID: UG51054
2026-03-27 10:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG51054%27 HTTP/1.1" 200 None
2026-03-27 10:46:27 [auto1.de] INFO: Scrape type for UG51054: 0
2026-03-27 10:46:27 [auto1.de] INFO: Found listing with ID: UR01748
2026-03-27 10:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR01748%27 HTTP/1.1" 200 None
2026-03-27 10:46:27 [auto1.de] INFO: Scrape type for UR01748: 0
2026-03-27 10:46:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:34 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 10550 | hits on page: 40
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: DF13757
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF13757%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for DF13757: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: NV71867
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV71867%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for NV71867: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: PW82256
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW82256%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for PW82256: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: SV44842
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV44842%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for SV44842: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: RB81388
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81388%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for RB81388: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: EC82787
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: FE14338
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE14338%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for FE14338: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: KM55226
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM55226%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for KM55226: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: UM20037
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: PF70156
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: ME65704
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME65704%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for ME65704: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: BF56330
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF56330%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for BF56330: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: UU13663
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU13663%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for UU13663: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: NB32533
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: VD76950
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: AA97264
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA97264%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for AA97264: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: LJ65322
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: XP11073
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: XF49404
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: TB50006
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: DW79441
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: AP31336
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: ES39418
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: RT12397
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: BM18767
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: DL24394
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL24394%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for DL24394: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: LU41152
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU41152%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for LU41152: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: LC19229
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC19229%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for LC19229: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: AN50976
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN50976%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for AN50976: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: JD37809
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD37809%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for JD37809: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: CT52786
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: HE75386
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: CY30248
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: XZ96898
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: JA01983
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA01983%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for JA01983: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: DP30254
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP30254%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for DP30254: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: PE01581
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: DK17127
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK17127%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for DK17127: 0
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: KC84563
2026-03-27 10:46:34 [auto1.de] INFO: Found listing with ID: AN39214
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN39214%27 HTTP/1.1" 200 None
2026-03-27 10:46:34 [auto1.de] INFO: Scrape type for AN39214: 0
2026-03-27 10:46:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:36 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 10550 | hits on page: 40
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: NP82575
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: KZ45391
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ45391%27 HTTP/1.1" 200 None
2026-03-27 10:46:36 [auto1.de] INFO: Scrape type for KZ45391: 0
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: CA25135
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA25135%27 HTTP/1.1" 200 None
2026-03-27 10:46:36 [auto1.de] INFO: Scrape type for CA25135: 0
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: NS70849
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS70849%27 HTTP/1.1" 200 None
2026-03-27 10:46:36 [auto1.de] INFO: Scrape type for NS70849: 0
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: YT48506
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48506%27 HTTP/1.1" 200 None
2026-03-27 10:46:36 [auto1.de] INFO: Scrape type for YT48506: 0
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: LM65356
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM65356%27 HTTP/1.1" 200 None
2026-03-27 10:46:36 [auto1.de] INFO: Scrape type for LM65356: 0
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: FD43857
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD43857%27 HTTP/1.1" 200 None
2026-03-27 10:46:36 [auto1.de] INFO: Scrape type for FD43857: 0
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: YP78886
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP78886%27 HTTP/1.1" 200 None
2026-03-27 10:46:36 [auto1.de] INFO: Scrape type for YP78886: 0
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: FA74860
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: LJ32377
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV83127%27 HTTP/1.1" 200 None
2026-03-27 10:46:36 [auto1.de] INFO: Scrape type for ZV83127: 0
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: HS10985
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS10985%27 HTTP/1.1" 200 None
2026-03-27 10:46:36 [auto1.de] INFO: Scrape type for HS10985: 0
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: SG43675
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: LZ61913
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ61913%27 HTTP/1.1" 200 None
2026-03-27 10:46:36 [auto1.de] INFO: Scrape type for LZ61913: 0
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: YT82208
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: XV81276
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: EM14245
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: KM31933
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM31933%27 HTTP/1.1" 200 None
2026-03-27 10:46:36 [auto1.de] INFO: Scrape type for KM31933: 0
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: DK13262
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: JC94959
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC94959%27 HTTP/1.1" 200 None
2026-03-27 10:46:36 [auto1.de] INFO: Scrape type for JC94959: 0
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: KL21870
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL21870%27 HTTP/1.1" 200 None
2026-03-27 10:46:36 [auto1.de] INFO: Scrape type for KL21870: 0
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: DU90887
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: YU83796
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU83796%27 HTTP/1.1" 200 None
2026-03-27 10:46:36 [auto1.de] INFO: Scrape type for YU83796: 0
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: VK16260
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK16260%27 HTTP/1.1" 200 None
2026-03-27 10:46:36 [auto1.de] INFO: Scrape type for VK16260: 0
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: VW23219
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: AK10320
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: PA97380
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA97380%27 HTTP/1.1" 200 None
2026-03-27 10:46:36 [auto1.de] INFO: Scrape type for PA97380: 0
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: KU90890
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: KY36378
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: LC01777
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC01777%27 HTTP/1.1" 200 None
2026-03-27 10:46:36 [auto1.de] INFO: Scrape type for LC01777: 0
2026-03-27 10:46:36 [auto1.de] INFO: Found listing with ID: RH56837
2026-03-27 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH56837%27 HTTP/1.1" 200 None
2026-03-27 10:46:37 [auto1.de] INFO: Scrape type for RH56837: 0
2026-03-27 10:46:37 [auto1.de] INFO: Found listing with ID: YD12708
2026-03-27 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12708%27 HTTP/1.1" 200 None
2026-03-27 10:46:37 [auto1.de] INFO: Scrape type for YD12708: 0
2026-03-27 10:46:37 [auto1.de] INFO: Found listing with ID: WB51072
2026-03-27 10:46:37 [auto1.de] INFO: Found listing with ID: WX33301
2026-03-27 10:46:37 [auto1.de] INFO: Found listing with ID: LC73374
2026-03-27 10:46:37 [auto1.de] INFO: Found listing with ID: WG52283
2026-03-27 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG52283%27 HTTP/1.1" 200 None
2026-03-27 10:46:37 [auto1.de] INFO: Scrape type for WG52283: 0
2026-03-27 10:46:37 [auto1.de] INFO: Found listing with ID: ED90812
2026-03-27 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED90812%27 HTTP/1.1" 200 None
2026-03-27 10:46:37 [auto1.de] INFO: Scrape type for ED90812: 0
2026-03-27 10:46:37 [auto1.de] INFO: Found listing with ID: GL77539
2026-03-27 10:46:37 [auto1.de] INFO: Found listing with ID: HC53321
2026-03-27 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC53321%27 HTTP/1.1" 200 None
2026-03-27 10:46:37 [auto1.de] INFO: Scrape type for HC53321: 0
2026-03-27 10:46:37 [auto1.de] INFO: Found listing with ID: RA83567
2026-03-27 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA83567%27 HTTP/1.1" 200 None
2026-03-27 10:46:37 [auto1.de] INFO: Scrape type for RA83567: 0
2026-03-27 10:46:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XN26589> (referer: https://www.auto1.com/v1/car-details-view/XN26589/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74897efa-cfcb-5863-93d9-b0587ef97589 with identifier: XN26589
2026-03-27 10:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74897efa-cfcb-5863-93d9-b0587ef97589 with scrape type 1
2026-03-27 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74897efa-cfcb-5863-93d9-b0587ef97589
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fc4%252Fd5c4d1ec313a5af3e4ab0f1066ea5176%252Fpa%252FXN26589_2a25e6de668aef677d533896423e6df0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_2a25e6de668aef677d533896423e6df0.jpg already downloaded
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fc4%252Fd5c4d1ec313a5af3e4ab0f1066ea5176%252Fpa%252FXN26589_cbd4ffa6a4b7c28ed7f81126dc4f543d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_cbd4ffa6a4b7c28ed7f81126dc4f543d.jpg already downloaded
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fc4%252Fd5c4d1ec313a5af3e4ab0f1066ea5176%252Fpa%252FXN26589_eb35d227c41841770665ffffa882c0dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_eb35d227c41841770665ffffa882c0dd.jpg already downloaded
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fc4%252Fd5c4d1ec313a5af3e4ab0f1066ea5176%252Fpa%252FXN26589_7b5f772440e405eb7b672a409d00bffe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_7b5f772440e405eb7b672a409d00bffe.jpg already downloaded
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fc4%252Fd5c4d1ec313a5af3e4ab0f1066ea5176%252Fpa%252FXN26589_2839516f8df9cbb0f524f6f13f5f2b23.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_2839516f8df9cbb0f524f6f13f5f2b23.jpg already downloaded
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fc4%252Fd5c4d1ec313a5af3e4ab0f1066ea5176%252Fpa%252FXN26589_95cd53ea96af08812da3158fb8c76088.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_95cd53ea96af08812da3158fb8c76088.jpg already downloaded
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fc4%252Fd5c4d1ec313a5af3e4ab0f1066ea5176%252Fpa%252FXN26589_ab0a5a51293c0055853056b56fdf3373.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_ab0a5a51293c0055853056b56fdf3373.jpg already downloaded
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fc4%252Fd5c4d1ec313a5af3e4ab0f1066ea5176%252Fpa%252FXN26589_cc653c4a0135addfcc80afb324a0553e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_cc653c4a0135addfcc80afb324a0553e.jpg already downloaded
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fc4%252Fd5c4d1ec313a5af3e4ab0f1066ea5176%252Fpa%252FXN26589_a6876127af8c5b92b31ffab538358e36.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_a6876127af8c5b92b31ffab538358e36.jpg already downloaded
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fc4%252Fd5c4d1ec313a5af3e4ab0f1066ea5176%252Fpa%252FXN26589_a5b81eae9523161b2568672f7124e2a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_a5b81eae9523161b2568672f7124e2a9.jpg already downloaded
2026-03-27 10:46:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74897efa-cfcb-5863-93d9-b0587ef97589, identifier: XN26589
2026-03-27 10:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74897efa-cfcb-5863-93d9-b0587ef97589 with identifier: XN26589
2026-03-27 10:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74897efa-cfcb-5863-93d9-b0587ef97589 with identifier: XN26589
2026-03-27 10:46:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74897efa-cfcb-5863-93d9-b0587ef97589 with identifier: XN26589 to the API
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XN26589>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:55:24Z',
'fuel_type': 'diesel',
'id': '74897efa-cfcb-5863-93d9-b0587ef97589',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN26589',
'listing': 'auction',
'location': 'DE, Buch',
'make': 'BMW',
'model': '3er',
'odometer': 208478,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_2a25e6de668aef677d533896423e6df0.jpg',
'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_cbd4ffa6a4b7c28ed7f81126dc4f543d.jpg',
'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_eb35d227c41841770665ffffa882c0dd.jpg',
'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_7b5f772440e405eb7b672a409d00bffe.jpg',
'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_2839516f8df9cbb0f524f6f13f5f2b23.jpg',
'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_95cd53ea96af08812da3158fb8c76088.jpg',
'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_ab0a5a51293c0055853056b56fdf3373.jpg',
'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_cc653c4a0135addfcc80afb324a0553e.jpg',
'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_a6876127af8c5b92b31ffab538358e36.jpg',
'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_a5b81eae9523161b2568672f7124e2a9.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74897efa-cfcb-5863-93d9-b0587ef97589/74897efa-cfcb-5863-93d9-b0587ef97589_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85916,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_2a25e6de668aef677d533896423e6df0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74897efa-cfcb-5863-93d9-b0587ef97589/74897efa-cfcb-5863-93d9-b0587ef97589_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87906,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_cbd4ffa6a4b7c28ed7f81126dc4f543d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74897efa-cfcb-5863-93d9-b0587ef97589/74897efa-cfcb-5863-93d9-b0587ef97589_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78433,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_eb35d227c41841770665ffffa882c0dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74897efa-cfcb-5863-93d9-b0587ef97589/74897efa-cfcb-5863-93d9-b0587ef97589_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62215,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_7b5f772440e405eb7b672a409d00bffe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74897efa-cfcb-5863-93d9-b0587ef97589/74897efa-cfcb-5863-93d9-b0587ef97589_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78112,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_2839516f8df9cbb0f524f6f13f5f2b23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74897efa-cfcb-5863-93d9-b0587ef97589/74897efa-cfcb-5863-93d9-b0587ef97589_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_95cd53ea96af08812da3158fb8c76088.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74897efa-cfcb-5863-93d9-b0587ef97589/74897efa-cfcb-5863-93d9-b0587ef97589_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_ab0a5a51293c0055853056b56fdf3373.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74897efa-cfcb-5863-93d9-b0587ef97589/74897efa-cfcb-5863-93d9-b0587ef97589_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_cc653c4a0135addfcc80afb324a0553e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74897efa-cfcb-5863-93d9-b0587ef97589/74897efa-cfcb-5863-93d9-b0587ef97589_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74987,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_a6876127af8c5b92b31ffab538358e36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74897efa-cfcb-5863-93d9-b0587ef97589/74897efa-cfcb-5863-93d9-b0587ef97589_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84074,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/c4/d5c4d1ec313a5af3e4ab0f1066ea5176/pa/XN26589_a5b81eae9523161b2568672f7124e2a9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-09-06',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 320d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2013}
2026-03-27 10:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26589%27 HTTP/1.1" 200 None
2026-03-27 10:46:41 [auto1.de] INFO: Saving data for XN26589: {'created_time': 1774608401.123056, 'last_price_update_time': 1774608401.123072, 'auction_closing_time': 1774716924.0}
2026-03-27 10:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN26589') HTTP/1.1" 204 0
2026-03-27 10:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:42 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 10551 | hits on page: 40
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: RA83567
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA83567%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for RA83567: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: XH97398
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH97398%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for XH97398: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: LW31172
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW31172%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for LW31172: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: XP10633
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP10633%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for XP10633: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: AD58563
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: JR09584
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: XT97994
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: VF30543
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF30543%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for VF30543: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: JA10385
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: ZH02957
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH02957%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for ZH02957: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: NW48345
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: YV13376
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: AT96377
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT96377%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for AT96377: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: LK23707
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: LE07247
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE07247%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for LE07247: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: DX26542
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: GD02743
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD02743%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for GD02743: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: FX70988
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX70988%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for FX70988: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: NY38671
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY38671%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for NY38671: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: ZF79650
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF79650%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for ZF79650: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: XM74841
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: SC11687
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: WH62381
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: XW64211
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: WK11079
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK11079%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for WK11079: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: AF80328
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF80328%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for AF80328: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: NT22490
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT22490%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for NT22490: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: NJ21212
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: RF82570
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF82570%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for RF82570: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: FT52767
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT52767%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for FT52767: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: MF71867
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: RR20427
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: KX24664
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24664%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for KX24664: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: XL03429
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: UU29980
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU29980%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for UU29980: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: YE43560
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE43560%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for YE43560: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: HN73886
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN73886%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for HN73886: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: SJ02901
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: VT29365
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT29365%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for VT29365: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: ME72449
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72449%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for ME72449: 0
2026-03-27 10:46:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:43 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 10551 | hits on page: 40
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: AH42647
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: KJ57811
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ57811%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Scrape type for KJ57811: 0
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: UE53576
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: FY37174
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: CX91527
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX91527%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Scrape type for CX91527: 0
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: BP26414
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: XC43362
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC43362%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Scrape type for XC43362: 0
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: AH10770
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: RE55721
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: WX65526
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: HB96099
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB96099%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Scrape type for HB96099: 0
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: YR53250
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR53250%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Scrape type for YR53250: 0
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: UT79910
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT79910%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Scrape type for UT79910: 0
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: HX17640
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: MS18045
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: BC91318
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC91318%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Scrape type for BC91318: 0
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: FT93387
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT93387%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Scrape type for FT93387: 0
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: VF93957
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: GW92568
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: FA31090
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA31090%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Scrape type for FA31090: 0
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: VU57107
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU57107%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Scrape type for VU57107: 0
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: CM51070
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM51070%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Scrape type for CM51070: 0
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: TP09714
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: UW93574
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW93574%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Scrape type for UW93574: 0
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: WH94807
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH94807%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Scrape type for WH94807: 0
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: LF70646
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: BP88986
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP88986%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Scrape type for BP88986: 0
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: UH53806
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH53806%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Scrape type for UH53806: 0
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: VR14158
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR14158%27 HTTP/1.1" 200 None
2026-03-27 10:46:44 [auto1.de] INFO: Scrape type for VR14158: 0
2026-03-27 10:46:44 [auto1.de] INFO: Found listing with ID: NS67917
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS67917%27 HTTP/1.1" 200 None
2026-03-27 10:46:44 [auto1.de] INFO: Scrape type for NS67917: 0
2026-03-27 10:46:44 [auto1.de] INFO: Found listing with ID: KV43188
2026-03-27 10:46:44 [auto1.de] INFO: Found listing with ID: PB81090
2026-03-27 10:46:44 [auto1.de] INFO: Found listing with ID: BP81382
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP81382%27 HTTP/1.1" 200 None
2026-03-27 10:46:44 [auto1.de] INFO: Scrape type for BP81382: 0
2026-03-27 10:46:44 [auto1.de] INFO: Found listing with ID: ZU52424
2026-03-27 10:46:44 [auto1.de] INFO: Found listing with ID: DF39026
2026-03-27 10:46:44 [auto1.de] INFO: Found listing with ID: MN91513
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN91513%27 HTTP/1.1" 200 None
2026-03-27 10:46:44 [auto1.de] INFO: Scrape type for MN91513: 0
2026-03-27 10:46:44 [auto1.de] INFO: Found listing with ID: WH32763
2026-03-27 10:46:44 [auto1.de] INFO: Found listing with ID: TT42996
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT42996%27 HTTP/1.1" 200 None
2026-03-27 10:46:44 [auto1.de] INFO: Scrape type for TT42996: 0
2026-03-27 10:46:44 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH00472%27 HTTP/1.1" 200 None
2026-03-27 10:46:44 [auto1.de] INFO: Scrape type for XH00472: 0
2026-03-27 10:46:44 [auto1.de] INFO: Found listing with ID: AJ87809
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ87809%27 HTTP/1.1" 200 None
2026-03-27 10:46:44 [auto1.de] INFO: Scrape type for AJ87809: 0
2026-03-27 10:46:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:48 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 10552 | hits on page: 40
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: AJ87809
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ87809%27 HTTP/1.1" 200 None
2026-03-27 10:46:48 [auto1.de] INFO: Scrape type for AJ87809: 0
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: ME62571
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: LY18860
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY18860%27 HTTP/1.1" 200 None
2026-03-27 10:46:48 [auto1.de] INFO: Scrape type for LY18860: 0
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: PD25871
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: NN70157
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN70157%27 HTTP/1.1" 200 None
2026-03-27 10:46:48 [auto1.de] INFO: Scrape type for NN70157: 0
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: XY85080
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: UT80766
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: KD57874
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD57874%27 HTTP/1.1" 200 None
2026-03-27 10:46:48 [auto1.de] INFO: Scrape type for KD57874: 0
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: HH63715
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: XS00144
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: ZF01795
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: HE15634
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: MR26269
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: HC04393
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: JE38755
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: KK41609
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK41609%27 HTTP/1.1" 200 None
2026-03-27 10:46:48 [auto1.de] INFO: Scrape type for KK41609: 0
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: FU56159
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU56159%27 HTTP/1.1" 200 None
2026-03-27 10:46:48 [auto1.de] INFO: Scrape type for FU56159: 0
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: SW90946
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: LV91095
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: LL88453
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL88453%27 HTTP/1.1" 200 None
2026-03-27 10:46:48 [auto1.de] INFO: Scrape type for LL88453: 0
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: WC03431
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC03431%27 HTTP/1.1" 200 None
2026-03-27 10:46:48 [auto1.de] INFO: Scrape type for WC03431: 0
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: ML73813
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML73813%27 HTTP/1.1" 200 None
2026-03-27 10:46:48 [auto1.de] INFO: Scrape type for ML73813: 0
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: DB54386
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB54386%27 HTTP/1.1" 200 None
2026-03-27 10:46:48 [auto1.de] INFO: Scrape type for DB54386: 0
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: GJ44071
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: PN20097
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: ND18616
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: KM40135
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: BF31155
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: NN20456
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: WX25953
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX25953%27 HTTP/1.1" 200 None
2026-03-27 10:46:48 [auto1.de] INFO: Scrape type for WX25953: 0
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: HJ90196
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ90196%27 HTTP/1.1" 200 None
2026-03-27 10:46:48 [auto1.de] INFO: Scrape type for HJ90196: 0
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: LH84474
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: HV52048
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV52048%27 HTTP/1.1" 200 None
2026-03-27 10:46:48 [auto1.de] INFO: Scrape type for HV52048: 0
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: FU38421
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU38421%27 HTTP/1.1" 200 None
2026-03-27 10:46:49 [auto1.de] INFO: Scrape type for FU38421: 0
2026-03-27 10:46:49 [auto1.de] INFO: Found listing with ID: WW07339
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW07339%27 HTTP/1.1" 200 None
2026-03-27 10:46:49 [auto1.de] INFO: Scrape type for WW07339: 0
2026-03-27 10:46:49 [auto1.de] INFO: Found listing with ID: RL91910
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL91910%27 HTTP/1.1" 200 None
2026-03-27 10:46:49 [auto1.de] INFO: Scrape type for RL91910: 0
2026-03-27 10:46:49 [auto1.de] INFO: Found listing with ID: VN40893
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN40893%27 HTTP/1.1" 200 None
2026-03-27 10:46:49 [auto1.de] INFO: Scrape type for VN40893: 0
2026-03-27 10:46:49 [auto1.de] INFO: Found listing with ID: BN05561
2026-03-27 10:46:49 [auto1.de] INFO: Found listing with ID: SD15170
2026-03-27 10:46:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:51 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 10552 | hits on page: 40
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: VC94305
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC94305%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for VC94305: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: CD20105
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: YG08011
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: HN89991
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN89991%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for HN89991: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: KW34435
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW34435%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for KW34435: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: WG72441
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG72441%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for WG72441: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: AH66368
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH66368%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for AH66368: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: UV63326
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: RT74882
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT74882%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for RT74882: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: VG28956
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: LR75634
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: UP22850
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: PX08100
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX08100%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for PX08100: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: NS95449
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: EZ91283
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ91283%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for EZ91283: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: LS02070
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS02070%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for LS02070: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: PY40149
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY40149%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for PY40149: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: MU24847
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: DP27677
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: FL24570
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: CS85382
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: EW53480
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW53480%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for EW53480: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: AW14620
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW14620%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for AW14620: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: PV43751
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV43751%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for PV43751: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: JZ03470
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ03470%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for JZ03470: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: FM76670
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: MH26074
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH26074%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for MH26074: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: WZ70999
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ70999%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for WZ70999: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: ZK41607
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: LE59540
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE59540%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for LE59540: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: JW26700
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: VC25915
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC25915%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for VC25915: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: SS89837
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89837%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for SS89837: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: GA63896
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA63896%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for GA63896: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: MR11894
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: KT50615
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT50615%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for KT50615: 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: SJ85849
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: MM64069
2026-03-27 10:46:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:54 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 10552 | hits on page: 40
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: LZ29816
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ29816%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for LZ29816: 0
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: DN70998
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN70998%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for DN70998: 0
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: DW25667
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: UM42416
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM42416%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for UM42416: 0
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: VK33233
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: PM53589
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM53589%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for PM53589: 0
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: DB31408
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB31408%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for DB31408: 0
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: MS04579
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: PH15914
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH15914%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for PH15914: 0
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: EA72382
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: NZ33655
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ33655%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for NZ33655: 0
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: ZF95436
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: RX38122
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: LB51000
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: JA21059
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: EZ23867
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ23867%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for EZ23867: 0
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: BJ18418
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: MH25393
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: FT62764
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: PY07477
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY07477%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for PY07477: 0
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: ZM05379
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM05379%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for ZM05379: 0
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: NC84547
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: KC92153
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: FS98205
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS98205%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for FS98205: 0
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: FJ42259
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: DH11465
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: DW94229
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: WR86078
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: BD50281
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD50281%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for BD50281: 0
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: MG02116
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG02116%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for MG02116: 0
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: EX80316
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX80316%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for EX80316: 0
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: YJ88627
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: YP66786
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP66786%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for YP66786: 0
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: YM49351
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM49351%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for YM49351: 0
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: PD02193
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD02193%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for PD02193: 0
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: EN59108
2026-03-27 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN59108%27 HTTP/1.1" 200 None
2026-03-27 10:46:55 [auto1.de] INFO: Scrape type for EN59108: 0
2026-03-27 10:46:55 [auto1.de] INFO: Found listing with ID: FY00951
2026-03-27 10:46:55 [auto1.de] INFO: Found listing with ID: TS97270
2026-03-27 10:46:55 [auto1.de] INFO: Found listing with ID: DX98666
2026-03-27 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX98666%27 HTTP/1.1" 200 None
2026-03-27 10:46:55 [auto1.de] INFO: Scrape type for DX98666: 0
2026-03-27 10:46:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:47:07 [scrapy.extensions.logstats] INFO: Crawled 466 pages (at 14 pages/min), scraped 930 items (at 2 items/min)
2026-03-27 10:47:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-27 10:47:28 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.194(s), this was the 1st time calling it.
2026-03-27 10:47:28 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.334144386802689 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:47:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH57189> (referer: https://www.auto1.com/v1/car-details-view/GH57189/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:47:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a452c62-5846-5434-b548-48af8e4b2f83 with identifier: GH57189
2026-03-27 10:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a452c62-5846-5434-b548-48af8e4b2f83 with scrape type 1
2026-03-27 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4a452c62-5846-5434-b548-48af8e4b2f83
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa6%252Ff7a64fbe9c54c756d53d41203d1b32f8%252Fpa%252FGH57189_d8c1de3b9f13d87952f1a416e9e76f23.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_d8c1de3b9f13d87952f1a416e9e76f23.jpg not downloaded yet
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa6%252Ff7a64fbe9c54c756d53d41203d1b32f8%252Fpa%252FGH57189_a455104b276d1724ee230cfe83e6909c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_a455104b276d1724ee230cfe83e6909c.jpg not downloaded yet
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa6%252Ff7a64fbe9c54c756d53d41203d1b32f8%252Fpa%252FGH57189_bda3aaea6b099a89167d24b476f708f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_bda3aaea6b099a89167d24b476f708f5.jpg not downloaded yet
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa6%252Ff7a64fbe9c54c756d53d41203d1b32f8%252Fpa%252FGH57189_b803ebb91a01fbba3fb016697373718e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_b803ebb91a01fbba3fb016697373718e.jpg not downloaded yet
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa6%252Ff7a64fbe9c54c756d53d41203d1b32f8%252Fpa%252FGH57189_2e42cb94b891b7fca508e72182876786.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_2e42cb94b891b7fca508e72182876786.jpg not downloaded yet
2026-03-27 10:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_b803ebb91a01fbba3fb016697373718e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_d8c1de3b9f13d87952f1a416e9e76f23.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_a455104b276d1724ee230cfe83e6909c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be208910>
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a452c62-5846-5434-b548-48af8e4b2f83/4a452c62-5846-5434-b548-48af8e4b2f83_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa6%252Ff7a64fbe9c54c756d53d41203d1b32f8%252Fpa%252FGH57189_b803ebb91a01fbba3fb016697373718e.jpg') HTTP/1.1" 204 0
2026-03-27 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_b803ebb91a01fbba3fb016697373718e.jpg saved to cache
2026-03-27 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a452c62-5846-5434-b548-48af8e4b2f83
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2d9290>
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a452c62-5846-5434-b548-48af8e4b2f83/4a452c62-5846-5434-b548-48af8e4b2f83_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa6%252Ff7a64fbe9c54c756d53d41203d1b32f8%252Fpa%252FGH57189_d8c1de3b9f13d87952f1a416e9e76f23.jpg') HTTP/1.1" 204 0
2026-03-27 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_d8c1de3b9f13d87952f1a416e9e76f23.jpg saved to cache
2026-03-27 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a452c62-5846-5434-b548-48af8e4b2f83
2026-03-27 10:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_2e42cb94b891b7fca508e72182876786.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf359d10>
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a452c62-5846-5434-b548-48af8e4b2f83/4a452c62-5846-5434-b548-48af8e4b2f83_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa6%252Ff7a64fbe9c54c756d53d41203d1b32f8%252Fpa%252FGH57189_a455104b276d1724ee230cfe83e6909c.jpg') HTTP/1.1" 204 0
2026-03-27 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_a455104b276d1724ee230cfe83e6909c.jpg saved to cache
2026-03-27 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a452c62-5846-5434-b548-48af8e4b2f83
2026-03-27 10:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_bda3aaea6b099a89167d24b476f708f5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56bf464f90>
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a452c62-5846-5434-b548-48af8e4b2f83/4a452c62-5846-5434-b548-48af8e4b2f83_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa6%252Ff7a64fbe9c54c756d53d41203d1b32f8%252Fpa%252FGH57189_2e42cb94b891b7fca508e72182876786.jpg') HTTP/1.1" 204 0
2026-03-27 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_2e42cb94b891b7fca508e72182876786.jpg saved to cache
2026-03-27 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a452c62-5846-5434-b548-48af8e4b2f83
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56be2b17d0>
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a452c62-5846-5434-b548-48af8e4b2f83/4a452c62-5846-5434-b548-48af8e4b2f83_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fa6%252Ff7a64fbe9c54c756d53d41203d1b32f8%252Fpa%252FGH57189_bda3aaea6b099a89167d24b476f708f5.jpg') HTTP/1.1" 204 0
2026-03-27 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_bda3aaea6b099a89167d24b476f708f5.jpg saved to cache
2026-03-27 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a452c62-5846-5434-b548-48af8e4b2f83
2026-03-27 10:47:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a452c62-5846-5434-b548-48af8e4b2f83, skipping ID generation
2026-03-27 10:47:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a452c62-5846-5434-b548-48af8e4b2f83 with scrape type 1
2026-03-27 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a452c62-5846-5434-b548-48af8e4b2f83 sending to next pipeline
2026-03-27 10:47:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a452c62-5846-5434-b548-48af8e4b2f83, identifier: GH57189
2026-03-27 10:47:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a452c62-5846-5434-b548-48af8e4b2f83 with identifier: GH57189
2026-03-27 10:47:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a452c62-5846-5434-b548-48af8e4b2f83 with identifier: GH57189
2026-03-27 10:47:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a452c62-5846-5434-b548-48af8e4b2f83 with identifier: GH57189 to the API
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_bda3aaea6b099a89167d24b476f708f5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.2L',
'engine_horse_power': 60,
'expiration_date': '2026-03-28T16:27:01Z',
'fuel_type': 'petrol',
'id': '4a452c62-5846-5434-b548-48af8e4b2f83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH57189',
'listing': 'auction',
'location': 'DE, Hamburg-Billstedt',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 132974,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a452c62-5846-5434-b548-48af8e4b2f83/4a452c62-5846-5434-b548-48af8e4b2f83_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_d8c1de3b9f13d87952f1a416e9e76f23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a452c62-5846-5434-b548-48af8e4b2f83/4a452c62-5846-5434-b548-48af8e4b2f83_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80195,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_a455104b276d1724ee230cfe83e6909c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a452c62-5846-5434-b548-48af8e4b2f83/4a452c62-5846-5434-b548-48af8e4b2f83_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88986,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_bda3aaea6b099a89167d24b476f708f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a452c62-5846-5434-b548-48af8e4b2f83/4a452c62-5846-5434-b548-48af8e4b2f83_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65964,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_b803ebb91a01fbba3fb016697373718e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a452c62-5846-5434-b548-48af8e4b2f83/4a452c62-5846-5434-b548-48af8e4b2f83_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74271,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/a6/f7a64fbe9c54c756d53d41203d1b32f8/pa/GH57189_2e42cb94b891b7fca508e72182876786.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-04-19',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Black Edition',
'transmission': 'manual',
'trim': 'Black Edition',
'year': 2009}
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH57189%27 HTTP/1.1" 200 None
2026-03-27 10:47:35 [auto1.de] INFO: Saving data for GH57189: {'created_time': 1774608455.447389, 'last_price_update_time': 1774608455.4474, 'auction_closing_time': 1774715221.0}
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH57189') HTTP/1.1" 204 0
2026-03-27 10:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:00 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 10558 | hits on page: 40
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: YM49351
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM49351%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for YM49351: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: PD02193
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD02193%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for PD02193: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: EN59108
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN59108%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for EN59108: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: FY00951
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: TS97270
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: DX98666
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX98666%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for DX98666: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: WB94414
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94414%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for WB94414: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: KF80227
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: KU94473
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: TA96658
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA96658%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for TA96658: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: XU12244
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: DC86459
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC86459%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for DC86459: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: VU63720
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU63720%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for VU63720: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: CZ43316
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ43316%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for CZ43316: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: GR87963
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR87963%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for GR87963: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: EL27695
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: GZ76371
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: MR49496
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: MN62141
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN62141%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for MN62141: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: BY79192
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: ZY13733
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: PK76037
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK76037%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for PK76037: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: XD99934
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD99934%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for XD99934: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: VL48750
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL48750%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for VL48750: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV77194%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for JV77194: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: CX40237
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX40237%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for CX40237: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: SW58559
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW58559%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for SW58559: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: GC23441
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC23441%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for GC23441: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: TM13225
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM13225%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for TM13225: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: SU30794
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU30794%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for SU30794: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: YS11001
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: VM08251
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: HJ41200
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ41200%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for HJ41200: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: LY72043
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY72043%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for LY72043: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: RN72483
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: MA95154
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA95154%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for MA95154: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: XA47901
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA47901%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for XA47901: 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: LF42462
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: DN24455
2026-03-27 10:48:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:04 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 10559 | hits on page: 40
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: DN24455
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: RX33159
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: FM24966
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM24966%27 HTTP/1.1" 200 None
2026-03-27 10:48:04 [auto1.de] INFO: Scrape type for FM24966: 0
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: TR03247
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR03247%27 HTTP/1.1" 200 None
2026-03-27 10:48:04 [auto1.de] INFO: Scrape type for TR03247: 0
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: KS17982
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: EP91734
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP91734%27 HTTP/1.1" 200 None
2026-03-27 10:48:04 [auto1.de] INFO: Scrape type for EP91734: 0
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: CV35288
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV35288%27 HTTP/1.1" 200 None
2026-03-27 10:48:04 [auto1.de] INFO: Scrape type for CV35288: 0
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: SE89354
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: JJ25259
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: DD35024
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD35024%27 HTTP/1.1" 200 None
2026-03-27 10:48:04 [auto1.de] INFO: Scrape type for DD35024: 0
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: YP87015
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: RH83429
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH83429%27 HTTP/1.1" 200 None
2026-03-27 10:48:04 [auto1.de] INFO: Scrape type for RH83429: 0
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: SC29196
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: YU63408
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU63408%27 HTTP/1.1" 200 None
2026-03-27 10:48:04 [auto1.de] INFO: Scrape type for YU63408: 0
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: HM06155
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM06155%27 HTTP/1.1" 200 None
2026-03-27 10:48:04 [auto1.de] INFO: Scrape type for HM06155: 0
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: LS62630
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: TS73841
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: VE04349
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: YV18372
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: VG12821
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG12821%27 HTTP/1.1" 200 None
2026-03-27 10:48:04 [auto1.de] INFO: Scrape type for VG12821: 0
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW77024%27 HTTP/1.1" 200 None
2026-03-27 10:48:04 [auto1.de] INFO: Scrape type for NW77024: 0
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: SB88077
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB88077%27 HTTP/1.1" 200 None
2026-03-27 10:48:04 [auto1.de] INFO: Scrape type for SB88077: 0
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: BX73975
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX73975%27 HTTP/1.1" 200 None
2026-03-27 10:48:04 [auto1.de] INFO: Scrape type for BX73975: 0
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: LS40625
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS40625%27 HTTP/1.1" 200 None
2026-03-27 10:48:05 [auto1.de] INFO: Scrape type for LS40625: 0
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: GB18110
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB18110%27 HTTP/1.1" 200 None
2026-03-27 10:48:05 [auto1.de] INFO: Scrape type for GB18110: 0
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: MF28588
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: NX62125
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX62125%27 HTTP/1.1" 200 None
2026-03-27 10:48:05 [auto1.de] INFO: Scrape type for NX62125: 0
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: XH85131
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: CY03369
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: ZS59678
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS59678%27 HTTP/1.1" 200 None
2026-03-27 10:48:05 [auto1.de] INFO: Scrape type for ZS59678: 0
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: SU52289
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: KD11093
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: XM97106
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM97106%27 HTTP/1.1" 200 None
2026-03-27 10:48:05 [auto1.de] INFO: Scrape type for XM97106: 0
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: AX44497
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX44497%27 HTTP/1.1" 200 None
2026-03-27 10:48:05 [auto1.de] INFO: Scrape type for AX44497: 0
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: NC92529
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC92529%27 HTTP/1.1" 200 None
2026-03-27 10:48:05 [auto1.de] INFO: Scrape type for NC92529: 0
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: YZ92306
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: HH67266
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: VS95794
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: AG42517
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: BV43542
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV43542%27 HTTP/1.1" 200 None
2026-03-27 10:48:05 [auto1.de] INFO: Scrape type for BV43542: 0
2026-03-27 10:48:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:07 [scrapy.extensions.logstats] INFO: Crawled 469 pages (at 3 pages/min), scraped 931 items (at 1 items/min)
2026-03-27 10:48:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-27 10:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:08 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 10561 | hits on page: 40
2026-03-27 10:48:08 [auto1.de] INFO: Found listing with ID: AG42517
2026-03-27 10:48:08 [auto1.de] INFO: Found listing with ID: BV43542
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV43542%27 HTTP/1.1" 200 None
2026-03-27 10:48:08 [auto1.de] INFO: Scrape type for BV43542: 0
2026-03-27 10:48:08 [auto1.de] INFO: Found listing with ID: ED87662
2026-03-27 10:48:08 [auto1.de] INFO: Found listing with ID: PP57494
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP57494%27 HTTP/1.1" 200 None
2026-03-27 10:48:08 [auto1.de] INFO: Scrape type for PP57494: 0
2026-03-27 10:48:08 [auto1.de] INFO: Found listing with ID: DF25786
2026-03-27 10:48:08 [auto1.de] INFO: Found listing with ID: FJ74023
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ74023%27 HTTP/1.1" 200 None
2026-03-27 10:48:08 [auto1.de] INFO: Scrape type for FJ74023: 0
2026-03-27 10:48:08 [auto1.de] INFO: Found listing with ID: HG90812
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG90812%27 HTTP/1.1" 200 None
2026-03-27 10:48:08 [auto1.de] INFO: Scrape type for HG90812: 0
2026-03-27 10:48:08 [auto1.de] INFO: Found listing with ID: KS19016
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS19016%27 HTTP/1.1" 200 None
2026-03-27 10:48:08 [auto1.de] INFO: Scrape type for KS19016: 0
2026-03-27 10:48:08 [auto1.de] INFO: Found listing with ID: HJ07036
2026-03-27 10:48:08 [auto1.de] INFO: Found listing with ID: WD51171
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD51171%27 HTTP/1.1" 200 None
2026-03-27 10:48:08 [auto1.de] INFO: Scrape type for WD51171: 0
2026-03-27 10:48:08 [auto1.de] INFO: Found listing with ID: TG60096
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG60096%27 HTTP/1.1" 200 None
2026-03-27 10:48:09 [auto1.de] INFO: Scrape type for TG60096: 0
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: MX10037
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: DL76971
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL76971%27 HTTP/1.1" 200 None
2026-03-27 10:48:09 [auto1.de] INFO: Scrape type for DL76971: 0
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: TU94835
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: RG71859
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: HS46985
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS46985%27 HTTP/1.1" 200 None
2026-03-27 10:48:09 [auto1.de] INFO: Scrape type for HS46985: 0
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW69940%27 HTTP/1.1" 200 None
2026-03-27 10:48:09 [auto1.de] INFO: Scrape type for BW69940: 0
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: GP39306
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: YY00897
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY00897%27 HTTP/1.1" 200 None
2026-03-27 10:48:09 [auto1.de] INFO: Scrape type for YY00897: 0
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: ZR98905
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: YT14311
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: LB33247
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB33247%27 HTTP/1.1" 200 None
2026-03-27 10:48:09 [auto1.de] INFO: Scrape type for LB33247: 0
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: WC00237
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: YT79798
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: PT02757
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT02757%27 HTTP/1.1" 200 None
2026-03-27 10:48:09 [auto1.de] INFO: Scrape type for PT02757: 0
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: WA93069
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA93069%27 HTTP/1.1" 200 None
2026-03-27 10:48:09 [auto1.de] INFO: Scrape type for WA93069: 0
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: RA28898
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28898%27 HTTP/1.1" 200 None
2026-03-27 10:48:09 [auto1.de] INFO: Scrape type for RA28898: 0
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: PB95910
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: UC67587
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: VL76600
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: KR15967
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: FK23500
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH84206%27 HTTP/1.1" 200 None
2026-03-27 10:48:09 [auto1.de] INFO: Scrape type for JH84206: 0
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: DU63733
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: EG89523
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG89523%27 HTTP/1.1" 200 None
2026-03-27 10:48:09 [auto1.de] INFO: Scrape type for EG89523: 0
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: MT37929
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT37929%27 HTTP/1.1" 200 None
2026-03-27 10:48:09 [auto1.de] INFO: Scrape type for MT37929: 0
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: EU60788
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU60788%27 HTTP/1.1" 200 None
2026-03-27 10:48:09 [auto1.de] INFO: Scrape type for EU60788: 0
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT17427%27 HTTP/1.1" 200 None
2026-03-27 10:48:09 [auto1.de] INFO: Scrape type for WT17427: 0
2026-03-27 10:48:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:17 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 10564 | hits on page: 40
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: EU60788
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU60788%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for EU60788: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT17427%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for WT17427: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: JP65265
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: AY72100
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY72100%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for AY72100: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: EL37075
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: DK59088
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK59088%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for DK59088: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: UY74553
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY74553%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for UY74553: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: SW71463
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: DE48609
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE48609%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for DE48609: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: BD44577
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD44577%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for BD44577: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: PX90608
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: PB20656
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB20656%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for PB20656: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: SW98857
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW98857%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for SW98857: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: RN29221
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN29221%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for RN29221: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: BU57910
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: RJ12896
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: TL58821
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: MS52892
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: KK20323
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK20323%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for KK20323: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: BA53965
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: XE00063
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE00063%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for XE00063: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: HU31000
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU31000%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for HU31000: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: JS22549
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS22549%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for JS22549: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: KV36658
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV36658%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for KV36658: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: AG92900
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG92900%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for AG92900: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: YZ97980
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: JP71642
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP71642%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for JP71642: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: AX75874
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX75874%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for AX75874: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: CN37277
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN37277%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for CN37277: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40951%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for TX40951: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: JD86545
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: AF95896
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF95896%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for AF95896: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: KF61768
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF61768%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for KF61768: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: XJ37654
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ37654%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for XJ37654: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: PE56791
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: XY98739
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY98739%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for XY98739: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: ZH03742
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH03742%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for ZH03742: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: UV59286
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV59286%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for UV59286: 0
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: GW56930
2026-03-27 10:48:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:27 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 10565 | hits on page: 40
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: GW56930
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: NP12620
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP12620%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for NP12620: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: VE64648
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: YL65079
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL65079%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for YL65079: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: AN60739
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: HG55526
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG55526%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for HG55526: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: KG59936
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG59936%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for KG59936: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: BE48760
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE48760%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for BE48760: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: HW40680
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW40680%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for HW40680: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: GE01801
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE01801%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for GE01801: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: ME04916
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: NT23375
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN03285%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for BN03285: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: GN02679
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN02679%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for GN02679: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: YZ96811
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ96811%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for YZ96811: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: TK89986
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK89986%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for TK89986: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: UH79601
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: CS71066
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: LK49002
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: SC39007
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: ZC80172
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC80172%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for ZC80172: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: DW10415
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: GV90609
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV90609%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for GV90609: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: VK57644
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK57644%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for VK57644: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: KS96797
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS96797%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for KS96797: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: CX40454
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: NX12512
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX12512%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for NX12512: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: FB63580
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: FU38588
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU38588%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for FU38588: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: MA30458
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: GS35122
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS35122%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for GS35122: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: NV71643
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: VM18539
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM18539%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for VM18539: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: TD86732
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: UF26861
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: FW21931
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: XV43778
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: ZH98222
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: SU97431
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU97431%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for SU97431: 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: SN70569
2026-03-27 10:48:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:29 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 10565 | hits on page: 40
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: MX60968
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: RP49857
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP49857%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for RP49857: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: PY54306
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: UW26081
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW26081%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for UW26081: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: XE97830
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: NU37498
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: WP82108
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP82108%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for WP82108: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: AA51381
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51381%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for AA51381: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: FH53275
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: AT81603
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT81603%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for AT81603: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: NY43975
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: MC31762
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: UG90469
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: GC15327
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC15327%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for GC15327: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: FZ56361
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: MD38661
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: AP83370
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP83370%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for AP83370: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: CS22386
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS22386%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for CS22386: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: CW37812
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: PL18680
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: BC71264
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC71264%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for BC71264: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: ML88986
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML88986%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for ML88986: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: AB54193
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB54193%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for AB54193: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: PX31120
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX31120%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for PX31120: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: GT12052
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT12052%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for GT12052: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: HH88396
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH88396%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for HH88396: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: BX69347
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: XA77724
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: TS91087
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: XA90478
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA90478%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for XA90478: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: KJ04555
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: DZ59899
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ59899%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for DZ59899: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: BJ01016
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ01016%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for BJ01016: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: LL49213
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: RP83269
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: XD52073
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: WT57470
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT57470%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for WT57470: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: CJ78227
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ78227%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for CJ78227: 0
2026-03-27 10:48:29 [auto1.de] INFO: Found listing with ID: TC30897
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC30897%27 HTTP/1.1" 200 None
2026-03-27 10:48:29 [auto1.de] INFO: Scrape type for TC30897: 0
2026-03-27 10:48:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:30 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 10565 | hits on page: 40
2026-03-27 10:48:30 [auto1.de] INFO: Found listing with ID: EX48924
2026-03-27 10:48:30 [auto1.de] INFO: Found listing with ID: HV42647
2026-03-27 10:48:30 [auto1.de] INFO: Found listing with ID: NK01451
2026-03-27 10:48:30 [auto1.de] INFO: Found listing with ID: BG60568
2026-03-27 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG60568%27 HTTP/1.1" 200 None
2026-03-27 10:48:30 [auto1.de] INFO: Scrape type for BG60568: 0
2026-03-27 10:48:30 [auto1.de] INFO: Found listing with ID: AM11662
2026-03-27 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM11662%27 HTTP/1.1" 200 None
2026-03-27 10:48:30 [auto1.de] INFO: Scrape type for AM11662: 0
2026-03-27 10:48:30 [auto1.de] INFO: Found listing with ID: AV28159
2026-03-27 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV28159%27 HTTP/1.1" 200 None
2026-03-27 10:48:30 [auto1.de] INFO: Scrape type for AV28159: 2
2026-03-27 10:48:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 004e921a-7f4b-52f9-8439-f3181f3e57e0 with identifier: AV28159
2026-03-27 10:48:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 004e921a-7f4b-52f9-8439-f3181f3e57e0 with scrape type 2
2026-03-27 10:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 004e921a-7f4b-52f9-8439-f3181f3e57e0 with scrape type 2
2026-03-27 10:48:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 004e921a-7f4b-52f9-8439-f3181f3e57e0, identifier: AV28159
2026-03-27 10:48:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 004e921a-7f4b-52f9-8439-f3181f3e57e0 with identifier: AV28159
2026-03-27 10:48:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 004e921a-7f4b-52f9-8439-f3181f3e57e0 with identifier: AV28159
2026-03-27 10:48:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 004e921a-7f4b-52f9-8439-f3181f3e57e0 with identifier: AV28159 to the API
2026-03-27 10:48:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 199,
'expiration_date': '2026-03-27T16:40:16Z',
'fuel_type': 'diesel',
'id': '004e921a-7f4b-52f9-8439-f3181f3e57e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV28159',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 171199,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-29',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six 4Motion',
'transmission': 'automatic',
'trim': 'Generation Six 4Motion',
'year': 2018}
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV28159%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Saving data for AV28159: {'auction_closing_time': 1774629616.0, 'created_time': 1773773697.884329, 'last_price_update_time': 1774608512.137189}
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV28159') HTTP/1.1" 204 0
2026-03-27 10:48:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: PC37120
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC37120%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for PC37120: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: HD23680
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD23680%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for HD23680: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: CC36364
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC36364%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for CC36364: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: DL87338
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL87338%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for DL87338: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: MA24981
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA24981%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for MA24981: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: JM85963
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: UC54364
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC54364%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for UC54364: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: GE71520
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: XM84350
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM84350%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for XM84350: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: NC94445
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC94445%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for NC94445: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: UN63322
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN63322%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for UN63322: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: AT57881
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: XY53001
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: GK45349
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: SA48353
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA48353%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for SA48353: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: GZ39772
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: JE29517
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE29517%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for JE29517: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: JR47796
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR47796%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for JR47796: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: PA46364
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA46364%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for PA46364: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: CL13866
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL13866%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for CL13866: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: YE85695
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: SF11618
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF11618%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for SF11618: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: TE88755
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE88755%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for TE88755: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: UB40384
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: UK26793
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: WW97819
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW97819%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for WW97819: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: XM76659
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM76659%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for XM76659: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: RY51274
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: HV78876
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV78876%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for HV78876: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: NG91703
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: CC98432
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC98432%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for CC98432: 0
2026-03-27 10:48:32 [auto1.de] INFO: Found listing with ID: JE86051
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE86051%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [auto1.de] INFO: Scrape type for JE86051: 2
2026-03-27 10:48:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f1d217d-4626-58fb-8a7a-f5257729c96b with identifier: JE86051
2026-03-27 10:48:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f1d217d-4626-58fb-8a7a-f5257729c96b with scrape type 2
2026-03-27 10:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f1d217d-4626-58fb-8a7a-f5257729c96b with scrape type 2
2026-03-27 10:48:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f1d217d-4626-58fb-8a7a-f5257729c96b, identifier: JE86051
2026-03-27 10:48:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f1d217d-4626-58fb-8a7a-f5257729c96b with identifier: JE86051
2026-03-27 10:48:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f1d217d-4626-58fb-8a7a-f5257729c96b with identifier: JE86051
2026-03-27 10:48:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f1d217d-4626-58fb-8a7a-f5257729c96b with identifier: JE86051 to the API
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-27T16:02:06Z',
'fuel_type': 'diesel',
'id': '7f1d217d-4626-58fb-8a7a-f5257729c96b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE86051',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 157642,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-06',
'seller_name': None,
'title': 'Audi A6 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2017}
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE86051%27 HTTP/1.1" 200 None
2026-03-27 10:48:33 [auto1.de] INFO: Saving data for JE86051: {'auction_closing_time': 1774627326.0, 'created_time': 1774423850.455398, 'last_price_update_time': 1774608513.207828}
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE86051') HTTP/1.1" 204 0
2026-03-27 10:48:33 [auto1.de] INFO: Found listing with ID: LW90861
2026-03-27 10:48:33 [auto1.de] INFO: Found listing with ID: FE77599
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE77599%27 HTTP/1.1" 200 None
2026-03-27 10:48:33 [auto1.de] INFO: Scrape type for FE77599: 0
2026-03-27 10:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:36 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 10566 | hits on page: 40
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: FE77599
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE77599%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for FE77599: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: ZU14135
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU14135%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for ZU14135: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: ZR53559
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: VA89984
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: CJ05951
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: BV43774
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: KK35526
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK35526%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for KK35526: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: KA93370
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA93370%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for KA93370: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: WW00125
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW00125%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for WW00125: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: BS35535
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS35535%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for BS35535: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: MH95241
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH95241%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for MH95241: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: SY11471
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY11471%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for SY11471: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: KG98578
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG98578%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for KG98578: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: ZW11631
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW11631%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for ZW11631: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: ZV99384
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV99384%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for ZV99384: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: NL67563
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: ZN07940
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: JJ67232
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ67232%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for JJ67232: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: HP60079
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP60079%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for HP60079: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: VV12952
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV12952%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for VV12952: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: BH27116
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH27116%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for BH27116: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: RE78828
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE78828%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for RE78828: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: WF84421
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: XH73530
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: AX02207
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX02207%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for AX02207: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: FU89824
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU89824%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for FU89824: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: XD56236
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD56236%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for XD56236: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: JY95651
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: KN16725
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN16725%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for KN16725: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: LB52395
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB52395%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for LB52395: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: SV33389
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: AS80209
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: RM34833
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: PY12047
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY12047%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for PY12047: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: XE03188
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: ZZ21826
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ21826%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for ZZ21826: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: AD63692
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD63692%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for AD63692: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: HR99158
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR99158%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for HR99158: 0
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: DL00356
2026-03-27 10:48:36 [auto1.de] INFO: Found listing with ID: KG90894
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG90894%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [auto1.de] INFO: Scrape type for KG90894: 0
2026-03-27 10:48:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:38 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 10567 | hits on page: 40
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: KG90894
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG90894%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [auto1.de] INFO: Scrape type for KG90894: 0
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: GT82056
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT82056%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [auto1.de] INFO: Scrape type for GT82056: 0
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: XU45940
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: ZD20410
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: FU07672
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: KG17192
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: MT39473
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT39473%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [auto1.de] INFO: Scrape type for MT39473: 0
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: VS12896
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS12896%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [auto1.de] INFO: Scrape type for VS12896: 0
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: UN09274
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: HV97019
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV97019%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [auto1.de] INFO: Scrape type for HV97019: 0
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: XP45109
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: GG60327
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: NJ00528
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ00528%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [auto1.de] INFO: Scrape type for NJ00528: 0
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: WU50689
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU50689%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [auto1.de] INFO: Scrape type for WU50689: 0
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: WU35652
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: XF29574
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF29574%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [auto1.de] INFO: Scrape type for XF29574: 0
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: WA34292
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: YT94890
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: US80699
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US80699%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [auto1.de] INFO: Scrape type for US80699: 0
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: WF46078
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: SU27774
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU27774%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [auto1.de] INFO: Scrape type for SU27774: 0
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: ZX81946
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX81946%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [auto1.de] INFO: Scrape type for ZX81946: 0
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: EW68209
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: VD60509
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD60509%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [auto1.de] INFO: Scrape type for VD60509: 0
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: EC56413
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: KD43899
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD43899%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [auto1.de] INFO: Scrape type for KD43899: 0
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: HC76504
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC76504%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [auto1.de] INFO: Scrape type for HC76504: 0
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: TR77666
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: ZG41092
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: UC16251
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC16251%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [auto1.de] INFO: Scrape type for UC16251: 0
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: PW71854
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: EH50010
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: BE71150
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE71150%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [auto1.de] INFO: Scrape type for BE71150: 0
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: HL85444
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: RP69572
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP69572%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [auto1.de] INFO: Scrape type for RP69572: 0
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: PG02615
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: PA67996
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: LZ73182
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: SC67475
2026-03-27 10:48:38 [auto1.de] INFO: Found listing with ID: PB76196
2026-03-27 10:48:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:46 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 10567 | hits on page: 40
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: ZK29969
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: UB87978
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: CF35953
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF35953%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [auto1.de] INFO: Scrape type for CF35953: 0
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: FV33642
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: NT40509
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS42902%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [auto1.de] INFO: Scrape type for PS42902: 0
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: ZF36983
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: UU93742
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU93742%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [auto1.de] INFO: Scrape type for UU93742: 0
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: TC53143
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: VE17795
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: XS52546
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: ZE38295
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: TD36384
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD36384%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [auto1.de] INFO: Scrape type for TD36384: 0
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: HL66127
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL66127%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [auto1.de] INFO: Scrape type for HL66127: 0
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: JV39568
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV39568%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [auto1.de] INFO: Scrape type for JV39568: 0
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: MF57943
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF57943%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [auto1.de] INFO: Scrape type for MF57943: 0
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: CW81112
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: CV38870
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: BC57844
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: YJ10280
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: DU54196
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: BZ50840
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: SN40522
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: WF25588
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: TE12513
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: VT95404
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT95404%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [auto1.de] INFO: Scrape type for VT95404: 0
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: NC51826
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: AK59090
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK59090%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [auto1.de] INFO: Scrape type for AK59090: 0
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: JT42607
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: JL74315
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL74315%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [auto1.de] INFO: Scrape type for JL74315: 0
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: EW00282
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: NZ13249
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ13249%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [auto1.de] INFO: Scrape type for NZ13249: 0
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: MY96813
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: LL66986
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: XE66890
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE66890%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [auto1.de] INFO: Scrape type for XE66890: 0
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: SF05653
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: XR34915
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: NZ32797
2026-03-27 10:48:46 [auto1.de] INFO: Found listing with ID: GA76856
2026-03-27 10:48:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:00 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 10573 | hits on page: 40
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: LL66986
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: XE66890
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE66890%27 HTTP/1.1" 200 None
2026-03-27 10:49:00 [auto1.de] INFO: Scrape type for XE66890: 0
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: SF05653
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: XR34915
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: NZ32797
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: GA76856
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: XX08056
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: GG55770
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: VK88134
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK88134%27 HTTP/1.1" 200 None
2026-03-27 10:49:00 [auto1.de] INFO: Scrape type for VK88134: 0
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: BC75049
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: MU80081
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: MG28733
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG28733%27 HTTP/1.1" 200 None
2026-03-27 10:49:00 [auto1.de] INFO: Scrape type for MG28733: 0
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: WM29598
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: BP97847
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97847%27 HTTP/1.1" 200 None
2026-03-27 10:49:00 [auto1.de] INFO: Scrape type for BP97847: 0
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: PF05113
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF05113%27 HTTP/1.1" 200 None
2026-03-27 10:49:00 [auto1.de] INFO: Scrape type for PF05113: 0
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: WB68702
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: SF57435
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF57435%27 HTTP/1.1" 200 None
2026-03-27 10:49:00 [auto1.de] INFO: Scrape type for SF57435: 0
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: PP65062
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: WX26579
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: FG68231
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG68231%27 HTTP/1.1" 200 None
2026-03-27 10:49:00 [auto1.de] INFO: Scrape type for FG68231: 0
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: HZ65828
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: DH93175
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: VJ09038
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: XC02401
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC02401%27 HTTP/1.1" 200 None
2026-03-27 10:49:00 [auto1.de] INFO: Scrape type for XC02401: 0
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: RP11152
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP11152%27 HTTP/1.1" 200 None
2026-03-27 10:49:00 [auto1.de] INFO: Scrape type for RP11152: 0
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: ZP20731
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: BP63027
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: BE04791
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: CT61733
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT61733%27 HTTP/1.1" 200 None
2026-03-27 10:49:00 [auto1.de] INFO: Scrape type for CT61733: 0
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: AV46184
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV46184%27 HTTP/1.1" 200 None
2026-03-27 10:49:00 [auto1.de] INFO: Scrape type for AV46184: 0
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: WU11463
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU11463%27 HTTP/1.1" 200 None
2026-03-27 10:49:00 [auto1.de] INFO: Scrape type for WU11463: 0
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: FX77489
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: YH04536
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: TD00729
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD00729%27 HTTP/1.1" 200 None
2026-03-27 10:49:00 [auto1.de] INFO: Scrape type for TD00729: 2
2026-03-27 10:49:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0c59289-a79c-58f7-8cc1-8e5cc085c1de with identifier: TD00729
2026-03-27 10:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0c59289-a79c-58f7-8cc1-8e5cc085c1de with scrape type 2
2026-03-27 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0c59289-a79c-58f7-8cc1-8e5cc085c1de with scrape type 2
2026-03-27 10:49:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0c59289-a79c-58f7-8cc1-8e5cc085c1de, identifier: TD00729
2026-03-27 10:49:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0c59289-a79c-58f7-8cc1-8e5cc085c1de with identifier: TD00729
2026-03-27 10:49:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0c59289-a79c-58f7-8cc1-8e5cc085c1de with identifier: TD00729
2026-03-27 10:49:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0c59289-a79c-58f7-8cc1-8e5cc085c1de with identifier: TD00729 to the API
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-27T16:21:02Z',
'fuel_type': 'hybrid',
'id': 'b0c59289-a79c-58f7-8cc1-8e5cc085c1de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD00729',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 65026,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-20',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 300de T 4Matic Exclusive',
'transmission': 'automatic',
'trim': 'T 4Matic Exclusive',
'year': 2020}
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD00729%27 HTTP/1.1" 200 None
2026-03-27 10:49:01 [auto1.de] INFO: Saving data for TD00729: {'auction_closing_time': 1774628462.0, 'created_time': 1773513731.079898, 'last_price_update_time': 1774608541.44211}
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD00729') HTTP/1.1" 204 0
2026-03-27 10:49:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: ZX49680
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX49680%27 HTTP/1.1" 200 None
2026-03-27 10:49:01 [auto1.de] INFO: Scrape type for ZX49680: 0
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: GV05627
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: HL68502
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: RT76696
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT76696%27 HTTP/1.1" 200 None
2026-03-27 10:49:01 [auto1.de] INFO: Scrape type for RT76696: 0
2026-03-27 10:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:03 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 10573 | hits on page: 40
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: NH59879
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: AA11983
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: NB75703
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB75703%27 HTTP/1.1" 200 None
2026-03-27 10:49:03 [auto1.de] INFO: Scrape type for NB75703: 0
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: ZV79161
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV79161%27 HTTP/1.1" 200 None
2026-03-27 10:49:03 [auto1.de] INFO: Scrape type for ZV79161: 0
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: JD91962
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD91962%27 HTTP/1.1" 200 None
2026-03-27 10:49:03 [auto1.de] INFO: Scrape type for JD91962: 0
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: GG08526
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: CY08035
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: WU48136
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU48136%27 HTTP/1.1" 200 None
2026-03-27 10:49:03 [auto1.de] INFO: Scrape type for WU48136: 0
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: KE62238
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE62238%27 HTTP/1.1" 200 None
2026-03-27 10:49:03 [auto1.de] INFO: Scrape type for KE62238: 0
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: WD61316
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: AF45716
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: JJ89633
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: AF02059
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: UD17683
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: RA78002
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: CP08433
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP08433%27 HTTP/1.1" 200 None
2026-03-27 10:49:03 [auto1.de] INFO: Scrape type for CP08433: 0
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: LL58658
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL58658%27 HTTP/1.1" 200 None
2026-03-27 10:49:03 [auto1.de] INFO: Scrape type for LL58658: 0
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: NF12246
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: KH17356
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: WD01270
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: GR85769
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR85769%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for GR85769: 0
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: SP67624
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP67624%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for SP67624: 0
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: BD76265
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: WD55827
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: LA58021
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: CA68070
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: PJ80384
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ80384%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for PJ80384: 0
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: LJ92359
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ92359%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for LJ92359: 0
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: RK37113
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK37113%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for RK37113: 0
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: ZG99162
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: NL64340
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: AY79287
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: LV79824
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV79824%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for LV79824: 0
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: DL96803
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL96803%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for DL96803: 0
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: FN85250
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: JD23265
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: WH06924
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: GP69437
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: UN87828
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN87828%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for UN87828: 0
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: NV07015
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV07015%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for NV07015: 0
2026-03-27 10:49:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:05 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 10573 | hits on page: 40
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: EZ19901
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: AW04202
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: KA23374
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA23374%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for KA23374: 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: GF71655
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF71655%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for GF71655: 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: FU98344
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: KP56505
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP56505%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for KP56505: 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: WE43939
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: JJ00785
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: GJ45514
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ45514%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for GJ45514: 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: RW58482
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW58482%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for RW58482: 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: JZ88566
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: WT62339
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: NS04442
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: FY01239
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: UC27013
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: CT23259
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: ZW02435
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: BK38735
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: LC01994
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: LN72061
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: VN56016
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: PS15350
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS15350%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for PS15350: 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: UM55631
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: GW25108
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW25108%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for GW25108: 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: JP09068
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP09068%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for JP09068: 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: FE25594
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE25594%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for FE25594: 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: TG18023
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG18023%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for TG18023: 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: PB37453
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB37453%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for PB37453: 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: AW12746
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW12746%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for AW12746: 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: YF90999
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: KL74101
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: TX27115
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX27115%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for TX27115: 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: UH63993
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: RM36813
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM36813%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for RM36813: 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: JK05015
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK05015%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for JK05015: 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: HJ31046
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ31046%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for HJ31046: 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: PE88762
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE88762%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for PE88762: 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: YU02845
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU02845%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for YU02845: 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: UE39017
2026-03-27 10:49:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:06 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 10574 | hits on page: 40
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: UE39017
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: DB10875
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: EN45788
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: PX22927
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: WP05993
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: TU46947
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU46947%27 HTTP/1.1" 200 None
2026-03-27 10:49:06 [auto1.de] INFO: Scrape type for TU46947: 0
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: MK30505
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: JA57202
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA57202%27 HTTP/1.1" 200 None
2026-03-27 10:49:06 [auto1.de] INFO: Scrape type for JA57202: 0
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: TA55344
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA55344%27 HTTP/1.1" 200 None
2026-03-27 10:49:06 [auto1.de] INFO: Scrape type for TA55344: 0
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: LP31665
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP31665%27 HTTP/1.1" 200 None
2026-03-27 10:49:06 [auto1.de] INFO: Scrape type for LP31665: 0
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: GG82433
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: VP63344
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP63344%27 HTTP/1.1" 200 None
2026-03-27 10:49:06 [auto1.de] INFO: Scrape type for VP63344: 0
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: JZ87403
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: VY52982
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY52982%27 HTTP/1.1" 200 None
2026-03-27 10:49:06 [auto1.de] INFO: Scrape type for VY52982: 0
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: YN46054
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: AK06166
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK06166%27 HTTP/1.1" 200 None
2026-03-27 10:49:06 [auto1.de] INFO: Scrape type for AK06166: 0
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: UU08337
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: FP18966
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: GL43025
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: CN80835
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: EU09282
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: VL10469
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL10469%27 HTTP/1.1" 200 None
2026-03-27 10:49:06 [auto1.de] INFO: Scrape type for VL10469: 0
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: FF06799
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: CW00084
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: AS45906
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS45906%27 HTTP/1.1" 200 None
2026-03-27 10:49:06 [auto1.de] INFO: Scrape type for AS45906: 0
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: KZ13921
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: BP08791
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: CT54176
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: PA85037
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA85037%27 HTTP/1.1" 200 None
2026-03-27 10:49:06 [auto1.de] INFO: Scrape type for PA85037: 0
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: CY11153
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: CW66506
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: JU05593
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU05593%27 HTTP/1.1" 200 None
2026-03-27 10:49:06 [auto1.de] INFO: Scrape type for JU05593: 0
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: WV76032
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: KE65935
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: NC53350
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC53350%27 HTTP/1.1" 200 None
2026-03-27 10:49:06 [auto1.de] INFO: Scrape type for NC53350: 0
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: XW74990
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: HS33780
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: XZ96479
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: RM28884
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: RB12464
2026-03-27 10:49:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:07 [scrapy.extensions.logstats] INFO: Crawled 481 pages (at 12 pages/min), scraped 934 items (at 3 items/min)
2026-03-27 10:49:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-27 10:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:07 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 10574 | hits on page: 40
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: JX47081
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX47081%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for JX47081: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: YJ97695
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: XM44045
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM44045%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for XM44045: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: RX47334
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: NC69837
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC69837%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for NC69837: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: FC39269
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: HV03375
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV03375%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for HV03375: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: ND93415
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: NY96268
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY96268%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for NY96268: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: CK76126
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK76126%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for CK76126: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: VX68221
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: HP69948
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP69948%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for HP69948: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: GY65359
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: VE89968
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: DK27317
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: BD44154
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: VF08088
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: AL65001
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: PD14492
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD14492%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for PD14492: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: BG13362
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG13362%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for BG13362: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: UV62356
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV62356%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for UV62356: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: HK93024
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK93024%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for HK93024: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: LM09625
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM09625%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for LM09625: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: XR06922
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR06922%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for XR06922: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: UR69038
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: XH30445
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: YS42401
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS42401%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for YS42401: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: EF17850
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: DY22446
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: MS92452
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: XR77658
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: NA24630
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: LE29079
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: EB61889
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB61889%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for EB61889: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: XZ40842
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ40842%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for XZ40842: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: BS08057
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS08057%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for BS08057: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: DH10709
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH10709%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for DH10709: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: LH78507
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH78507%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for LH78507: 0
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: NT96701
2026-03-27 10:49:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:10 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 10575 | hits on page: 40
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: NT96701
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: GJ43799
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: XZ18734
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: SN71189
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: GX30612
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: UH98030
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH98030%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [auto1.de] INFO: Scrape type for UH98030: 0
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: JZ28158
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: DR41029
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR41029%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [auto1.de] INFO: Scrape type for DR41029: 0
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: TA29979
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA29979%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [auto1.de] INFO: Scrape type for TA29979: 0
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: CB70018
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: GW29634
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW29634%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [auto1.de] INFO: Scrape type for GW29634: 0
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: KX20208
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: BB99757
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB99757%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [auto1.de] INFO: Scrape type for BB99757: 0
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: XS76137
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS76137%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [auto1.de] INFO: Scrape type for XS76137: 0
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: LN11625
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11625%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [auto1.de] INFO: Scrape type for LN11625: 0
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: NE18994
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: DP19065
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: ET63606
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: DL07796
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL07796%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [auto1.de] INFO: Scrape type for DL07796: 0
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: GS63097
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: XA47491
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: SN63221
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: KF09771
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF09771%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [auto1.de] INFO: Scrape type for KF09771: 0
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: VX77411
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: BA08307
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: KP51039
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: UP49597
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP49597%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [auto1.de] INFO: Scrape type for UP49597: 0
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: UL90641
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL90641%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [auto1.de] INFO: Scrape type for UL90641: 0
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: BM72646
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: JW50887
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW50887%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [auto1.de] INFO: Scrape type for JW50887: 0
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: CA47661
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: WJ34554
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ34554%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [auto1.de] INFO: Scrape type for WJ34554: 0
2026-03-27 10:49:11 [auto1.de] INFO: Found listing with ID: VL19259
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL19259%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [auto1.de] INFO: Scrape type for VL19259: 0
2026-03-27 10:49:11 [auto1.de] INFO: Found listing with ID: HW48310
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW48310%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [auto1.de] INFO: Scrape type for HW48310: 0
2026-03-27 10:49:11 [auto1.de] INFO: Found listing with ID: ZA98162
2026-03-27 10:49:11 [auto1.de] INFO: Found listing with ID: GF58377
2026-03-27 10:49:11 [auto1.de] INFO: Found listing with ID: FJ58055
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ58055%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [auto1.de] INFO: Scrape type for FJ58055: 0
2026-03-27 10:49:11 [auto1.de] INFO: Found listing with ID: SP08042
2026-03-27 10:49:11 [auto1.de] INFO: Found listing with ID: FD89715
2026-03-27 10:49:11 [auto1.de] INFO: Found listing with ID: XU85928
2026-03-27 10:49:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:15 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 10576 | hits on page: 40
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: XU85928
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: NB97562
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: DE90025
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE90025%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [auto1.de] INFO: Scrape type for DE90025: 0
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: HH17639
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH17639%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [auto1.de] INFO: Scrape type for HH17639: 0
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: CN68552
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: US88233
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US88233%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [auto1.de] INFO: Scrape type for US88233: 0
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: ZX30565
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: JZ81394
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: HY64229
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: UW78189
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW78189%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [auto1.de] INFO: Scrape type for UW78189: 0
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: TF24039
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: PV23969
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV23969%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [auto1.de] INFO: Scrape type for PV23969: 0
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: FS70562
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS70562%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [auto1.de] INFO: Scrape type for FS70562: 0
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: UP64202
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP64202%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [auto1.de] INFO: Scrape type for UP64202: 0
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: KK88906
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: EL83398
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL83398%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [auto1.de] INFO: Scrape type for EL83398: 0
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: LW41921
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW41921%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [auto1.de] INFO: Scrape type for LW41921: 0
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: JC86986
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC86986%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [auto1.de] INFO: Scrape type for JC86986: 0
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: GR60102
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR60102%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [auto1.de] INFO: Scrape type for GR60102: 0
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: FF33829
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: BR35600
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR35600%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [auto1.de] INFO: Scrape type for BR35600: 0
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: ZX35425
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK32978%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [auto1.de] INFO: Scrape type for GK32978: 0
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: LW97378
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: CL53186
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: MB60596
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: VD85153
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: DE21080
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE21080%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [auto1.de] INFO: Scrape type for DE21080: 0
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: EB35688
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: NV67877
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: KU29056
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: MP12786
2026-03-27 10:49:15 [auto1.de] INFO: Found listing with ID: KH11075
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH11075%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [auto1.de] INFO: Scrape type for KH11075: 2
2026-03-27 10:49:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a31d001e-4203-5f64-bd28-ad3bdbb8cfc6 with identifier: KH11075
2026-03-27 10:49:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a31d001e-4203-5f64-bd28-ad3bdbb8cfc6 with scrape type 2
2026-03-27 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a31d001e-4203-5f64-bd28-ad3bdbb8cfc6 with scrape type 2
2026-03-27 10:49:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a31d001e-4203-5f64-bd28-ad3bdbb8cfc6, identifier: KH11075
2026-03-27 10:49:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a31d001e-4203-5f64-bd28-ad3bdbb8cfc6 with identifier: KH11075
2026-03-27 10:49:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a31d001e-4203-5f64-bd28-ad3bdbb8cfc6 with identifier: KH11075
2026-03-27 10:49:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a31d001e-4203-5f64-bd28-ad3bdbb8cfc6 with identifier: KH11075 to the API
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-27T16:06:29Z',
'fuel_type': 'diesel',
'id': 'a31d001e-4203-5f64-bd28-ad3bdbb8cfc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH11075',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 130190,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-07',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2019}
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH11075%27 HTTP/1.1" 200 None
2026-03-27 10:49:16 [auto1.de] INFO: Saving data for KH11075: {'auction_closing_time': 1774627589.0, 'created_time': 1773830160.008608, 'last_price_update_time': 1774608556.818571}
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH11075') HTTP/1.1" 204 0
2026-03-27 10:49:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:16 [auto1.de] INFO: Found listing with ID: JP35340
2026-03-27 10:49:16 [auto1.de] INFO: Found listing with ID: WA83866
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA83866%27 HTTP/1.1" 200 None
2026-03-27 10:49:16 [auto1.de] INFO: Scrape type for WA83866: 0
2026-03-27 10:49:16 [auto1.de] INFO: Found listing with ID: UP60859
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP60859%27 HTTP/1.1" 200 None
2026-03-27 10:49:16 [auto1.de] INFO: Scrape type for UP60859: 0
2026-03-27 10:49:16 [auto1.de] INFO: Found listing with ID: BB12781
2026-03-27 10:49:16 [auto1.de] INFO: Found listing with ID: MM67286
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM67286%27 HTTP/1.1" 200 None
2026-03-27 10:49:16 [auto1.de] INFO: Scrape type for MM67286: 0
2026-03-27 10:49:16 [auto1.de] INFO: Found listing with ID: UW75870
2026-03-27 10:49:16 [auto1.de] INFO: Found listing with ID: GG54264
2026-03-27 10:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:28 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 10579 | hits on page: 40
2026-03-27 10:49:28 [auto1.de] INFO: Found listing with ID: MM67286
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM67286%27 HTTP/1.1" 200 None
2026-03-27 10:49:28 [auto1.de] INFO: Scrape type for MM67286: 0
2026-03-27 10:49:28 [auto1.de] INFO: Found listing with ID: UW75870
2026-03-27 10:49:28 [auto1.de] INFO: Found listing with ID: GG54264
2026-03-27 10:49:28 [auto1.de] INFO: Found listing with ID: ZW75307
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW75307%27 HTTP/1.1" 200 None
2026-03-27 10:49:28 [auto1.de] INFO: Scrape type for ZW75307: 0
2026-03-27 10:49:28 [auto1.de] INFO: Found listing with ID: SS89558
2026-03-27 10:49:28 [auto1.de] INFO: Found listing with ID: KM15369
2026-03-27 10:49:28 [auto1.de] INFO: Found listing with ID: UW30611
2026-03-27 10:49:28 [auto1.de] INFO: Found listing with ID: UC37330
2026-03-27 10:49:28 [auto1.de] INFO: Found listing with ID: PF74105
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF74105%27 HTTP/1.1" 200 None
2026-03-27 10:49:28 [auto1.de] INFO: Scrape type for PF74105: 0
2026-03-27 10:49:28 [auto1.de] INFO: Found listing with ID: PL06364
2026-03-27 10:49:28 [auto1.de] INFO: Found listing with ID: DB06170
2026-03-27 10:49:28 [auto1.de] INFO: Found listing with ID: JM01437
2026-03-27 10:49:28 [auto1.de] INFO: Found listing with ID: VM51267
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM51267%27 HTTP/1.1" 200 None
2026-03-27 10:49:28 [auto1.de] INFO: Scrape type for VM51267: 0
2026-03-27 10:49:28 [auto1.de] INFO: Found listing with ID: KP46159
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP46159%27 HTTP/1.1" 200 None
2026-03-27 10:49:28 [auto1.de] INFO: Scrape type for KP46159: 0
2026-03-27 10:49:28 [auto1.de] INFO: Found listing with ID: BN99234
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN99234%27 HTTP/1.1" 200 None
2026-03-27 10:49:29 [auto1.de] INFO: Scrape type for BN99234: 0
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: KB02253
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: SL85430
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: VZ02719
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ02719%27 HTTP/1.1" 200 None
2026-03-27 10:49:29 [auto1.de] INFO: Scrape type for VZ02719: 0
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: UH34281
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34281%27 HTTP/1.1" 200 None
2026-03-27 10:49:29 [auto1.de] INFO: Scrape type for UH34281: 2
2026-03-27 10:49:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1da6558-16d2-54a9-b080-6b374b459487 with identifier: UH34281
2026-03-27 10:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1da6558-16d2-54a9-b080-6b374b459487 with scrape type 2
2026-03-27 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1da6558-16d2-54a9-b080-6b374b459487 with scrape type 2
2026-03-27 10:49:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1da6558-16d2-54a9-b080-6b374b459487, identifier: UH34281
2026-03-27 10:49:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1da6558-16d2-54a9-b080-6b374b459487 with identifier: UH34281
2026-03-27 10:49:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1da6558-16d2-54a9-b080-6b374b459487 with identifier: UH34281
2026-03-27 10:49:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1da6558-16d2-54a9-b080-6b374b459487 with identifier: UH34281 to the API
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 272,
'expiration_date': '2026-03-27T16:07:28Z',
'fuel_type': 'diesel',
'id': 'a1da6558-16d2-54a9-b080-6b374b459487',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH34281',
'listing': 'auction',
'make': 'Audi',
'model': 'Q7',
'odometer': 290016,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-17',
'seller_name': None,
'title': 'Audi Q7 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2017}
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34281%27 HTTP/1.1" 200 None
2026-03-27 10:49:29 [auto1.de] INFO: Saving data for UH34281: {'auction_closing_time': 1774627648.0, 'created_time': 1773811823.548891, 'last_price_update_time': 1774608569.55812}
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH34281') HTTP/1.1" 204 0
2026-03-27 10:49:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: MG42268
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG42268%27 HTTP/1.1" 200 None
2026-03-27 10:49:29 [auto1.de] INFO: Scrape type for MG42268: 0
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: ZY51313
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY51313%27 HTTP/1.1" 200 None
2026-03-27 10:49:29 [auto1.de] INFO: Scrape type for ZY51313: 0
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: XS71103
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: PK12624
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: PY30467
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY30467%27 HTTP/1.1" 200 None
2026-03-27 10:49:29 [auto1.de] INFO: Scrape type for PY30467: 0
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: DL85923
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL85923%27 HTTP/1.1" 200 None
2026-03-27 10:49:29 [auto1.de] INFO: Scrape type for DL85923: 0
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: HV77843
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: EC31076
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: JN35186
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: BY14465
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: HJ19382
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: UL37196
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL37196%27 HTTP/1.1" 200 None
2026-03-27 10:49:29 [auto1.de] INFO: Scrape type for UL37196: 0
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: YT47833
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: ZU43867
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: LB43526
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: NM47140
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM47140%27 HTTP/1.1" 200 None
2026-03-27 10:49:29 [auto1.de] INFO: Scrape type for NM47140: 0
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: NV12597
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV12597%27 HTTP/1.1" 200 None
2026-03-27 10:49:29 [auto1.de] INFO: Scrape type for NV12597: 0
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: UZ83781
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ83781%27 HTTP/1.1" 200 None
2026-03-27 10:49:29 [auto1.de] INFO: Scrape type for UZ83781: 0
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: UZ71144
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: XK78841
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK78841%27 HTTP/1.1" 200 None
2026-03-27 10:49:29 [auto1.de] INFO: Scrape type for XK78841: 0
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: BT98780
2026-03-27 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:33 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 10580 | hits on page: 40
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: BT98780
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: HP91668
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP91668%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for HP91668: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: VH10251
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH10251%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for VH10251: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: VN21885
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN21885%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for VN21885: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: RU16238
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: LG76747
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: SN96710
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: MW52698
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW52698%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for MW52698: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: XW80989
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: DP51933
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP51933%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for DP51933: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: NE71450
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE71450%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for NE71450: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: DN68550
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: YZ27957
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ27957%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for YZ27957: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: MP81414
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: SL19665
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL19665%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for SL19665: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: CK18909
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK18909%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for CK18909: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: PM54102
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM54102%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for PM54102: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: VH89882
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH89882%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for VH89882: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: RP66796
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP66796%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for RP66796: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: ER58682
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: AP83246
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP83246%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for AP83246: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: EE99492
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: JS30913
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: RK40243
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK40243%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for RK40243: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: VX80468
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: FK92289
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: GG45079
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG45079%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for GG45079: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: NA10756
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA10756%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for NA10756: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: VR98222
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: JU00246
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU00246%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for JU00246: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: XS81837
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: KZ72468
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ72468%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for KZ72468: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: NM87427
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: WR71249
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR71249%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for WR71249: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: BH50029
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH50029%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for BH50029: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: FT76728
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: BN72510
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN72510%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for BN72510: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: XJ45397
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ45397%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for XJ45397: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: NH88126
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH88126%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for NH88126: 0
2026-03-27 10:49:33 [auto1.de] INFO: Found listing with ID: EJ76475
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ76475%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [auto1.de] INFO: Scrape type for EJ76475: 0
2026-03-27 10:49:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:38 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 10581 | hits on page: 40
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: EJ76475
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ76475%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for EJ76475: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: WM96321
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: LT23486
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: HU45094
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU45094%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for HU45094: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: UY63030
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: HH92077
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH92077%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for HH92077: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: BJ03544
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03544%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for BJ03544: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: FY34771
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY34771%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for FY34771: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: BZ84414
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ84414%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for BZ84414: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: SW03993
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW03993%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for SW03993: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: TD14056
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD14056%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for TD14056: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: AJ85429
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ85429%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for AJ85429: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: BS13662
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS13662%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for BS13662: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: WP39257
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP39257%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for WP39257: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: DC14061
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: DT89706
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT89706%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for DT89706: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: WG55926
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG55926%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for WG55926: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: SH18397
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: EZ14910
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ14910%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for EZ14910: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: GM32610
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: VG72700
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG72700%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for VG72700: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: UU48969
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: DS93671
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS93671%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for DS93671: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: GK69346
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: PH69268
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: PN40620
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN40620%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for PN40620: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: UT50255
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: CT53281
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: XG53445
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG53445%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for XG53445: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: NH41771
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: RT49576
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: RT03172
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT03172%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for RT03172: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: HR49435
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR49435%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for HR49435: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: TW05114
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW05114%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for TW05114: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: KT37297
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: JH74007
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: JE92990
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE92990%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Scrape type for JE92990: 0
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: VZ67143
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: PG37499
2026-03-27 10:49:38 [auto1.de] INFO: Found listing with ID: LC46131
2026-03-27 10:49:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:39 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 10581 | hits on page: 40
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: TH25711
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH25711%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [auto1.de] INFO: Scrape type for TH25711: 0
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: BS13684
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: LY01980
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY01980%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [auto1.de] INFO: Scrape type for LY01980: 0
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: ZT12374
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT12374%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [auto1.de] INFO: Scrape type for ZT12374: 0
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: BW18198
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: JL28573
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: WW69027
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: AY57867
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: RW07911
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: AD64899
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: HX41929
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: CF83908
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: MJ74950
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ74950%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [auto1.de] INFO: Scrape type for MJ74950: 0
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: GN89276
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN89276%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [auto1.de] INFO: Scrape type for GN89276: 0
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: CA74097
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA74097%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [auto1.de] INFO: Scrape type for CA74097: 0
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: RG17194
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG17194%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [auto1.de] INFO: Scrape type for RG17194: 0
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: DC85616
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: FV21228
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: MH03153
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH03153%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [auto1.de] INFO: Scrape type for MH03153: 0
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: UH30780
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: FH63171
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: DK32557
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK32557%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [auto1.de] INFO: Scrape type for DK32557: 0
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: HD75435
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: FP44284
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP44284%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [auto1.de] INFO: Scrape type for FP44284: 0
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: LM68672
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM68672%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [auto1.de] INFO: Scrape type for LM68672: 0
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: JU02065
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU02065%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [auto1.de] INFO: Scrape type for JU02065: 0
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: EZ97284
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ97284%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [auto1.de] INFO: Scrape type for EZ97284: 0
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: ZA82143
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA82143%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [auto1.de] INFO: Scrape type for ZA82143: 0
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: TC05555
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: HH04688
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: CH65115
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: JK59865
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK59865%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [auto1.de] INFO: Scrape type for JK59865: 0
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: VW33777
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: TD64872
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: JW60141
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW60141%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [auto1.de] INFO: Scrape type for JW60141: 0
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: WF95671
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: XY56978
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: XN63500
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: UE16674
2026-03-27 10:49:39 [auto1.de] INFO: Found listing with ID: BZ98792
2026-03-27 10:49:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:47 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 10582 | hits on page: 40
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: BZ98792
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: GZ87312
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ87312%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for GZ87312: 0
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: DK08351
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: PV22215
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV22215%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for PV22215: 0
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: ST72008
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST72008%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for ST72008: 0
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: LS52090
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS52090%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for LS52090: 0
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: UF78071
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: JR94106
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR94106%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for JR94106: 0
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: YT76473
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: GE94573
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94573%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for GE94573: 0
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: MJ50234
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: TE22896
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: AZ18369
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ18369%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for AZ18369: 0
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: UA53606
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: XW12257
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: TE29693
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: AN64049
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: VA39531
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: HH81200
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH81200%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for HH81200: 0
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: FC24298
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC24298%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for FC24298: 0
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: LH53286
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH53286%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for LH53286: 0
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: RK41317
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK41317%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for RK41317: 0
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: FL42778
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: NA97113
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA97113%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for NA97113: 0
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: VZ74394
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: GH78103
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH78103%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for GH78103: 0
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: ZN11233
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: YF83058
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF83058%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for YF83058: 0
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: XM80704
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM80704%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for XM80704: 0
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: MR91997
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: HN30434
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: CC28628
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: TM93918
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM93918%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for TM93918: 0
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: KJ62910
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: CD38469
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD38469%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for CD38469: 0
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: KK55590
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK55590%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for KK55590: 0
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: TH96479
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: GU24584
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: NU16694
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU16694%27 HTTP/1.1" 200 None
2026-03-27 10:49:48 [auto1.de] INFO: Scrape type for NU16694: 0
2026-03-27 10:49:48 [auto1.de] INFO: Found listing with ID: VT10952
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT10952%27 HTTP/1.1" 200 None
2026-03-27 10:49:48 [auto1.de] INFO: Scrape type for VT10952: 0
2026-03-27 10:49:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:51 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 10582 | hits on page: 40
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: RV28657
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: GT95785
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT95785%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Scrape type for GT95785: 0
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: MC75281
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: PC84380
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC84380%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Scrape type for PC84380: 0
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: SH57495
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH57495%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Scrape type for SH57495: 0
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: VS18201
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS18201%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Scrape type for VS18201: 0
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: NU12300
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: RT59975
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: TV93253
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: VU31960
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: FD35505
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD35505%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Scrape type for FD35505: 0
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: HS70377
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: UJ62660
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ62660%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Scrape type for UJ62660: 0
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: DE17947
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: RT19739
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT19739%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Scrape type for RT19739: 0
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: KX72487
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: HJ74961
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ74961%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Scrape type for HJ74961: 0
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: VH09784
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: HP55634
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: YM05661
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: XX85563
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: EJ36871
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ36871%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Scrape type for EJ36871: 0
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: NH92657
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: NX06422
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: CA37510
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA37510%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Scrape type for CA37510: 0
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: PX20258
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX20258%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Scrape type for PX20258: 0
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: KM05428
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: RF30152
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF30152%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Scrape type for RF30152: 0
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: JM79727
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: YS92779
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: TA53494
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA53494%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Scrape type for TA53494: 0
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: BZ20648
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ20648%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Scrape type for BZ20648: 0
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: UZ92171
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: FH49394
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH49394%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Scrape type for FH49394: 0
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: AU78717
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: PB69477
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: KM15379
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: SX71911
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX71911%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Scrape type for SX71911: 0
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: EZ87293
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ87293%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Scrape type for EZ87293: 0
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: CP02009
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP02009%27 HTTP/1.1" 200 None
2026-03-27 10:49:52 [auto1.de] INFO: Scrape type for CP02009: 0
2026-03-27 10:49:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:50:07 [scrapy.extensions.logstats] INFO: Crawled 490 pages (at 9 pages/min), scraped 936 items (at 2 items/min)
2026-03-27 10:50:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-27 10:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:50:27 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 10584 | hits on page: 40
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: EZ87293
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ87293%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for EZ87293: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: CP02009
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP02009%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for CP02009: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: RP29809
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: XW94362
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW94362%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for XW94362: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: WT89497
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: JJ50911
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: LE20823
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: GJ64200
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ64200%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for GJ64200: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: RS75435
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: HC38984
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: US36140
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: NJ80920
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ80920%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for NJ80920: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: FE77695
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: FR35172
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG67731%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for SG67731: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: LU60211
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU60211%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for LU60211: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: CY36598
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: YV86532
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: SB08616
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB08616%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for SB08616: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: UK40619
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK40619%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for UK40619: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: SD21155
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD21155%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for SD21155: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: FS10993
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: SX08307
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX08307%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for SX08307: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: MK57941
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK57941%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for MK57941: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: MS62719
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: CX66529
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: VZ15910
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: VJ83495
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ83495%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for VJ83495: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: XA31743
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA31743%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for XA31743: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: ZR85378
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR85378%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for ZR85378: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: DB03998
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB03998%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for DB03998: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: KP55286
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP55286%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for KP55286: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: HH23923
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: LW67845
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW67845%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for LW67845: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: HN93513
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN93513%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for HN93513: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: VK27409
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK27409%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for VK27409: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: YD08284
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: FG36016
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: DE61416
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE61416%27 HTTP/1.1" 200 None
2026-03-27 10:50:27 [auto1.de] INFO: Scrape type for DE61416: 0
2026-03-27 10:50:27 [auto1.de] INFO: Found listing with ID: LE56250
2026-03-27 10:50:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:51:07 [scrapy.extensions.logstats] INFO: Crawled 491 pages (at 1 pages/min), scraped 936 items (at 0 items/min)
2026-03-27 10:51:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-27 10:52:07 [scrapy.extensions.logstats] INFO: Crawled 491 pages (at 0 pages/min), scraped 936 items (at 0 items/min)
2026-03-27 10:52:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-27 10:52:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.884(s), this was the 1st time calling it.
2026-03-27 10:52:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.86670201059264 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:52:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:52:46 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 10596 | hits on page: 40
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: XA31743
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA31743%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for XA31743: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: ZR85378
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR85378%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for ZR85378: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: DB03998
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB03998%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for DB03998: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: KP55286
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP55286%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for KP55286: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: HH23923
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: LW67845
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW67845%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for LW67845: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: HN93513
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN93513%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for HN93513: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: VK27409
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK27409%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for VK27409: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: YD08284
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: FG36016
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: DE61416
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE61416%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for DE61416: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: LE56250
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: PR07624
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: XR86863
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: ZP60201
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: PP99150
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP99150%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for PP99150: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: EG52009
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: GF27594
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF27594%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for GF27594: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: TT76680
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT76680%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for TT76680: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: KX39833
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: RU30790
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: TD83761
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: VV40094
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV40094%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for VV40094: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93420%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for FK93420: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: XG52732
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: SU06848
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: EY58894
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY58894%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for EY58894: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: XA86799
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA86799%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for XA86799: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: YU64534
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU64534%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for YU64534: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: LT62829
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: SV14192
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV14192%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for SV14192: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: JC97573
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: VH37983
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: BB82002
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB82002%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for BB82002: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: DT42327
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT42327%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for DT42327: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: GJ48427
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: UB38135
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: RP40821
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP40821%27 HTTP/1.1" 200 None
2026-03-27 10:52:46 [auto1.de] INFO: Scrape type for RP40821: 0
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: CW38827
2026-03-27 10:52:46 [auto1.de] INFO: Found listing with ID: YL83790
2026-03-27 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL83790%27 HTTP/1.1" 200 None
2026-03-27 10:52:47 [auto1.de] INFO: Scrape type for YL83790: 0
2026-03-27 10:52:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:52:48 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 10598 | hits on page: 40
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: CW38827
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: YL83790
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL83790%27 HTTP/1.1" 200 None
2026-03-27 10:52:48 [auto1.de] INFO: Scrape type for YL83790: 0
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: JY72572
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY72572%27 HTTP/1.1" 200 None
2026-03-27 10:52:48 [auto1.de] INFO: Scrape type for JY72572: 0
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: KX36775
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: EZ29207
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ29207%27 HTTP/1.1" 200 None
2026-03-27 10:52:48 [auto1.de] INFO: Scrape type for EZ29207: 0
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: KL17270
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: XV69460
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV69460%27 HTTP/1.1" 200 None
2026-03-27 10:52:48 [auto1.de] INFO: Scrape type for XV69460: 0
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: CT69735
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: KU77644
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU77644%27 HTTP/1.1" 200 None
2026-03-27 10:52:48 [auto1.de] INFO: Scrape type for KU77644: 0
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: PE12481
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE12481%27 HTTP/1.1" 200 None
2026-03-27 10:52:48 [auto1.de] INFO: Scrape type for PE12481: 0
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: FJ33812
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ33812%27 HTTP/1.1" 200 None
2026-03-27 10:52:48 [auto1.de] INFO: Scrape type for FJ33812: 0
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: XE20875
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: PT35689
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT35689%27 HTTP/1.1" 200 None
2026-03-27 10:52:48 [auto1.de] INFO: Scrape type for PT35689: 0
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: GL98026
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: DD53059
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD53059%27 HTTP/1.1" 200 None
2026-03-27 10:52:48 [auto1.de] INFO: Scrape type for DD53059: 0
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: XV72544
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV72544%27 HTTP/1.1" 200 None
2026-03-27 10:52:48 [auto1.de] INFO: Scrape type for XV72544: 0
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: PE93085
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE93085%27 HTTP/1.1" 200 None
2026-03-27 10:52:48 [auto1.de] INFO: Scrape type for PE93085: 0
2026-03-27 10:52:48 [auto1.de] INFO: Found listing with ID: AW77677
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW77677%27 HTTP/1.1" 200 None
2026-03-27 10:52:48 [auto1.de] INFO: Scrape type for AW77677: 2
2026-03-27 10:52:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76af0b8c-fc52-553d-bec4-4a60425395e0 with identifier: AW77677
2026-03-27 10:52:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76af0b8c-fc52-553d-bec4-4a60425395e0 with scrape type 2
2026-03-27 10:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76af0b8c-fc52-553d-bec4-4a60425395e0 with scrape type 2
2026-03-27 10:52:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76af0b8c-fc52-553d-bec4-4a60425395e0, identifier: AW77677
2026-03-27 10:52:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76af0b8c-fc52-553d-bec4-4a60425395e0 with identifier: AW77677
2026-03-27 10:52:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76af0b8c-fc52-553d-bec4-4a60425395e0 with identifier: AW77677
2026-03-27 10:52:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76af0b8c-fc52-553d-bec4-4a60425395e0 with identifier: AW77677 to the API
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:52:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-27T16:39:40Z',
'fuel_type': 'petrol',
'id': '76af0b8c-fc52-553d-bec4-4a60425395e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW77677',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 120226,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-21',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Allstar BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Allstar BlueMotion Tech',
'year': 2016}
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW77677%27 HTTP/1.1" 200 None
2026-03-27 10:52:49 [auto1.de] INFO: Saving data for AW77677: {'auction_closing_time': 1774629580.0, 'created_time': 1774423839.934755, 'last_price_update_time': 1774608769.623336}
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW77677') HTTP/1.1" 204 0
2026-03-27 10:52:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: MY91371
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: FB21783
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB21783%27 HTTP/1.1" 200 None
2026-03-27 10:52:49 [auto1.de] INFO: Scrape type for FB21783: 0
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: SN87429
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: BJ20331
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: HG52162
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG52162%27 HTTP/1.1" 200 None
2026-03-27 10:52:49 [auto1.de] INFO: Scrape type for HG52162: 0
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: GE17394
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: JU40409
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU40409%27 HTTP/1.1" 200 None
2026-03-27 10:52:49 [auto1.de] INFO: Scrape type for JU40409: 0
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: ES43903
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES43903%27 HTTP/1.1" 200 None
2026-03-27 10:52:49 [auto1.de] INFO: Scrape type for ES43903: 0
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: XU29979
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU29979%27 HTTP/1.1" 200 None
2026-03-27 10:52:49 [auto1.de] INFO: Scrape type for XU29979: 0
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: LN43848
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN43848%27 HTTP/1.1" 200 None
2026-03-27 10:52:49 [auto1.de] INFO: Scrape type for LN43848: 0
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: BY57485
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: MW80491
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW80491%27 HTTP/1.1" 200 None
2026-03-27 10:52:49 [auto1.de] INFO: Scrape type for MW80491: 0
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: MV25141
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV25141%27 HTTP/1.1" 200 None
2026-03-27 10:52:49 [auto1.de] INFO: Scrape type for MV25141: 0
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: CE86831
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE86831%27 HTTP/1.1" 200 None
2026-03-27 10:52:49 [auto1.de] INFO: Scrape type for CE86831: 0
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: BD30878
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: GL51026
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: WH88293
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: NU50542
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: CD66904
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD66904%27 HTTP/1.1" 200 None
2026-03-27 10:52:49 [auto1.de] INFO: Scrape type for CD66904: 0
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: VB29019
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB29019%27 HTTP/1.1" 200 None
2026-03-27 10:52:49 [auto1.de] INFO: Scrape type for VB29019: 0
2026-03-27 10:52:49 [auto1.de] INFO: Found listing with ID: CW02202
2026-03-27 10:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:52:51 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 10598 | hits on page: 40
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: LM70179
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: HF92770
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF92770%27 HTTP/1.1" 200 None
2026-03-27 10:52:51 [auto1.de] INFO: Scrape type for HF92770: 0
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: EF20977
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF20977%27 HTTP/1.1" 200 None
2026-03-27 10:52:51 [auto1.de] INFO: Scrape type for EF20977: 0
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: ET24153
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET24153%27 HTTP/1.1" 200 None
2026-03-27 10:52:51 [auto1.de] INFO: Scrape type for ET24153: 0
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: XJ15035
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ15035%27 HTTP/1.1" 200 None
2026-03-27 10:52:51 [auto1.de] INFO: Scrape type for XJ15035: 0
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: WM94615
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: GE49775
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: TS14604
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS14604%27 HTTP/1.1" 200 None
2026-03-27 10:52:51 [auto1.de] INFO: Scrape type for TS14604: 0
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: LG10256
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG10256%27 HTTP/1.1" 200 None
2026-03-27 10:52:51 [auto1.de] INFO: Scrape type for LG10256: 0
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: WR08965
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR08965%27 HTTP/1.1" 200 None
2026-03-27 10:52:51 [auto1.de] INFO: Scrape type for WR08965: 0
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: UL15630
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL15630%27 HTTP/1.1" 200 None
2026-03-27 10:52:51 [auto1.de] INFO: Scrape type for UL15630: 0
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: DY50654
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY50654%27 HTTP/1.1" 200 None
2026-03-27 10:52:51 [auto1.de] INFO: Scrape type for DY50654: 0
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: DM75800
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: YS25721
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: SX58365
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: SW02532
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: SR56375
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: SS40431
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: LP13779
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: PU27308
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU27308%27 HTTP/1.1" 200 None
2026-03-27 10:52:51 [auto1.de] INFO: Scrape type for PU27308: 0
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: JT68679
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: UU45926
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU45926%27 HTTP/1.1" 200 None
2026-03-27 10:52:51 [auto1.de] INFO: Scrape type for UU45926: 0
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: XZ50534
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ50534%27 HTTP/1.1" 200 None
2026-03-27 10:52:51 [auto1.de] INFO: Scrape type for XZ50534: 0
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: HK08818
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: GZ10091
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: KB41878
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: XH94103
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: RT32909
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT32909%27 HTTP/1.1" 200 None
2026-03-27 10:52:51 [auto1.de] INFO: Scrape type for RT32909: 0
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: ZL07849
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL07849%27 HTTP/1.1" 200 None
2026-03-27 10:52:51 [auto1.de] INFO: Scrape type for ZL07849: 0
2026-03-27 10:52:51 [auto1.de] INFO: Found listing with ID: JW06785
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW06785%27 HTTP/1.1" 200 None
2026-03-27 10:52:51 [auto1.de] INFO: Scrape type for JW06785: 2
2026-03-27 10:52:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac5aa01c-d438-5f69-89db-b0360022b764 with identifier: JW06785
2026-03-27 10:52:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac5aa01c-d438-5f69-89db-b0360022b764 with scrape type 2
2026-03-27 10:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac5aa01c-d438-5f69-89db-b0360022b764 with scrape type 2
2026-03-27 10:52:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac5aa01c-d438-5f69-89db-b0360022b764, identifier: JW06785
2026-03-27 10:52:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac5aa01c-d438-5f69-89db-b0360022b764 with identifier: JW06785
2026-03-27 10:52:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac5aa01c-d438-5f69-89db-b0360022b764 with identifier: JW06785
2026-03-27 10:52:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac5aa01c-d438-5f69-89db-b0360022b764 with identifier: JW06785 to the API
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:52:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:52:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-27T16:25:59Z',
'fuel_type': 'diesel',
'id': 'ac5aa01c-d438-5f69-89db-b0360022b764',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW06785',
'listing': 'auction',
'make': 'Jaguar',
'model': 'E-Pace',
'odometer': 214019,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-15',
'seller_name': None,
'title': 'Jaguar E-Pace D240 R-Dynamic HSE AWD',
'transmission': 'automatic',
'trim': 'R-Dynamic HSE AWD',
'year': 2019}
2026-03-27 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW06785%27 HTTP/1.1" 200 None
2026-03-27 10:52:52 [auto1.de] INFO: Saving data for JW06785: {'auction_closing_time': 1774628759.0, 'created_time': 1774423842.922107, 'last_price_update_time': 1774608772.075362}
2026-03-27 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW06785') HTTP/1.1" 204 0
2026-03-27 10:52:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:52:52 [auto1.de] INFO: Found listing with ID: GB62942
2026-03-27 10:52:52 [auto1.de] INFO: Found listing with ID: VH13590
2026-03-27 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH13590%27 HTTP/1.1" 200 None
2026-03-27 10:52:52 [auto1.de] INFO: Scrape type for VH13590: 0
2026-03-27 10:52:52 [auto1.de] INFO: Found listing with ID: LR13635
2026-03-27 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR13635%27 HTTP/1.1" 200 None
2026-03-27 10:52:52 [auto1.de] INFO: Scrape type for LR13635: 0
2026-03-27 10:52:52 [auto1.de] INFO: Found listing with ID: BF07223
2026-03-27 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF07223%27 HTTP/1.1" 200 None
2026-03-27 10:52:52 [auto1.de] INFO: Scrape type for BF07223: 0
2026-03-27 10:52:52 [auto1.de] INFO: Found listing with ID: XZ07034
2026-03-27 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ07034%27 HTTP/1.1" 200 None
2026-03-27 10:52:52 [auto1.de] INFO: Scrape type for XZ07034: 0
2026-03-27 10:52:52 [auto1.de] INFO: Found listing with ID: LD96580
2026-03-27 10:52:52 [auto1.de] INFO: Found listing with ID: NF53472
2026-03-27 10:52:52 [auto1.de] INFO: Found listing with ID: WF14643
2026-03-27 10:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:52:53 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 10598 | hits on page: 40
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: UF29141
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF29141%27 HTTP/1.1" 200 None
2026-03-27 10:52:53 [auto1.de] INFO: Scrape type for UF29141: 0
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: PF91020
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF91020%27 HTTP/1.1" 200 None
2026-03-27 10:52:53 [auto1.de] INFO: Scrape type for PF91020: 0
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: LU81602
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: TR50455
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: WS70576
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS70576%27 HTTP/1.1" 200 None
2026-03-27 10:52:53 [auto1.de] INFO: Scrape type for WS70576: 0
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: DX28979
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: JJ72378
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: TS72146
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: BZ13551
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ13551%27 HTTP/1.1" 200 None
2026-03-27 10:52:53 [auto1.de] INFO: Scrape type for BZ13551: 0
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: FY91209
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: WR85565
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: ZL86875
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: NE29157
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: DL36324
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL36324%27 HTTP/1.1" 200 None
2026-03-27 10:52:53 [auto1.de] INFO: Scrape type for DL36324: 0
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: DK33868
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK33868%27 HTTP/1.1" 200 None
2026-03-27 10:52:53 [auto1.de] INFO: Scrape type for DK33868: 0
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: NP60172
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: NL79092
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: PZ85127
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ85127%27 HTTP/1.1" 200 None
2026-03-27 10:52:53 [auto1.de] INFO: Scrape type for PZ85127: 0
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: ZU35260
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU35260%27 HTTP/1.1" 200 None
2026-03-27 10:52:53 [auto1.de] INFO: Scrape type for ZU35260: 0
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: KJ21272
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ21272%27 HTTP/1.1" 200 None
2026-03-27 10:52:53 [auto1.de] INFO: Scrape type for KJ21272: 0
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: SA61100
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA61100%27 HTTP/1.1" 200 None
2026-03-27 10:52:53 [auto1.de] INFO: Scrape type for SA61100: 0
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: PX70527
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: GY70112
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY70112%27 HTTP/1.1" 200 None
2026-03-27 10:52:53 [auto1.de] INFO: Scrape type for GY70112: 0
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: PM48725
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM48725%27 HTTP/1.1" 200 None
2026-03-27 10:52:53 [auto1.de] INFO: Scrape type for PM48725: 0
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: RH52660
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: HC45326
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: GP28595
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: LU02094
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: JL42140
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: NG39570
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG39570%27 HTTP/1.1" 200 None
2026-03-27 10:52:53 [auto1.de] INFO: Scrape type for NG39570: 0
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: JF05808
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: HS50383
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: CY33592
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY33592%27 HTTP/1.1" 200 None
2026-03-27 10:52:53 [auto1.de] INFO: Scrape type for CY33592: 0
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: ZX76617
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: RT10387
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: FN85811
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: WR65399
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: XP62941
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: UZ78249
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ78249%27 HTTP/1.1" 200 None
2026-03-27 10:52:53 [auto1.de] INFO: Scrape type for UZ78249: 0
2026-03-27 10:52:53 [auto1.de] INFO: Found listing with ID: SC34211
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC34211%27 HTTP/1.1" 200 None
2026-03-27 10:52:53 [auto1.de] INFO: Scrape type for SC34211: 0
2026-03-27 10:52:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:52:54 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 10598 | hits on page: 40
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: ME08351
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: AE27507
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: RK36338
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: UE71906
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE71906%27 HTTP/1.1" 200 None
2026-03-27 10:52:54 [auto1.de] INFO: Scrape type for UE71906: 0
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: WP33305
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP33305%27 HTTP/1.1" 200 None
2026-03-27 10:52:54 [auto1.de] INFO: Scrape type for WP33305: 0
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: VE41227
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41227%27 HTTP/1.1" 200 None
2026-03-27 10:52:54 [auto1.de] INFO: Scrape type for VE41227: 0
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: MU10500
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: HF62089
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: TW27373
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: HD53184
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: RX22945
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: CP46186
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: FT74133
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT74133%27 HTTP/1.1" 200 None
2026-03-27 10:52:54 [auto1.de] INFO: Scrape type for FT74133: 0
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: WJ75594
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: MM40978
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM40978%27 HTTP/1.1" 200 None
2026-03-27 10:52:54 [auto1.de] INFO: Scrape type for MM40978: 0
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: TR81218
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: JV02966
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: KA31515
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA31515%27 HTTP/1.1" 200 None
2026-03-27 10:52:54 [auto1.de] INFO: Scrape type for KA31515: 0
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: NS68918
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: KF01282
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: VL29200
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN99222%27 HTTP/1.1" 200 None
2026-03-27 10:52:54 [auto1.de] INFO: Scrape type for JN99222: 0
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: YE13468
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: RG64089
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: ZR88631
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR88631%27 HTTP/1.1" 200 None
2026-03-27 10:52:54 [auto1.de] INFO: Scrape type for ZR88631: 0
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: VG76144
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG76144%27 HTTP/1.1" 200 None
2026-03-27 10:52:54 [auto1.de] INFO: Scrape type for VG76144: 0
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: SP71936
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP71936%27 HTTP/1.1" 200 None
2026-03-27 10:52:54 [auto1.de] INFO: Scrape type for SP71936: 0
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: AJ07817
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ07817%27 HTTP/1.1" 200 None
2026-03-27 10:52:54 [auto1.de] INFO: Scrape type for AJ07817: 0
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: KD09526
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD09526%27 HTTP/1.1" 200 None
2026-03-27 10:52:54 [auto1.de] INFO: Scrape type for KD09526: 0
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: WB48893
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB48893%27 HTTP/1.1" 200 None
2026-03-27 10:52:54 [auto1.de] INFO: Scrape type for WB48893: 0
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: KS41685
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: LD74655
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD74655%27 HTTP/1.1" 200 None
2026-03-27 10:52:54 [auto1.de] INFO: Scrape type for LD74655: 0
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: XN23462
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: WW69328
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW69328%27 HTTP/1.1" 200 None
2026-03-27 10:52:54 [auto1.de] INFO: Scrape type for WW69328: 0
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: EW37624
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW37624%27 HTTP/1.1" 200 None
2026-03-27 10:52:54 [auto1.de] INFO: Scrape type for EW37624: 0
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: XB82791
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: CX89908
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: MC16369
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC16369%27 HTTP/1.1" 200 None
2026-03-27 10:52:54 [auto1.de] INFO: Scrape type for MC16369: 0
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: FP76124
2026-03-27 10:52:54 [auto1.de] INFO: Found listing with ID: EA51834
2026-03-27 10:52:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:52:55 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 10598 | hits on page: 40
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: KZ67688
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ67688%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for KZ67688: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: GZ14972
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: KX50009
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: FC82550
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: TK97766
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: WK00710
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK00710%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for WK00710: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: GK36833
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: KE58425
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE58425%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for KE58425: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: LW40462
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW40462%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for LW40462: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: EB82059
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB82059%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for EB82059: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: CZ24918
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: SG45173
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG45173%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for SG45173: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: DR25105
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR25105%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for DR25105: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: HH83846
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH83846%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for HH83846: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: KY77386
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: BV18724
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: FL34122
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: LC23112
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC23112%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for LC23112: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: YV33202
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: HP04846
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP04846%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for HP04846: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: VW14529
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: EU16436
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: XM78612
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM78612%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for XM78612: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: HL37424
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL37424%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for HL37424: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: SV40404
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV40404%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for SV40404: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: LT67236
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT67236%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for LT67236: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: GC35405
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: PC42250
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96721%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for YA96721: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: JW69458
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW69458%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for JW69458: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: GT39794
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT39794%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for GT39794: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: LB77088
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: CW58984
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: LC10044
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC10044%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for LC10044: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: LW16241
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW16241%27 HTTP/1.1" 200 None
2026-03-27 10:52:55 [auto1.de] INFO: Scrape type for LW16241: 0
2026-03-27 10:52:55 [auto1.de] INFO: Found listing with ID: NP02044
2026-03-27 10:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP02044%27 HTTP/1.1" 200 None
2026-03-27 10:52:56 [auto1.de] INFO: Scrape type for NP02044: 0
2026-03-27 10:52:56 [auto1.de] INFO: Found listing with ID: CA83659
2026-03-27 10:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA83659%27 HTTP/1.1" 200 None
2026-03-27 10:52:56 [auto1.de] INFO: Scrape type for CA83659: 0
2026-03-27 10:52:56 [auto1.de] INFO: Found listing with ID: WP19217
2026-03-27 10:52:56 [auto1.de] INFO: Found listing with ID: DL24086
2026-03-27 10:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL24086%27 HTTP/1.1" 200 None
2026-03-27 10:52:56 [auto1.de] INFO: Scrape type for DL24086: 0
2026-03-27 10:52:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:52:57 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 10598 | hits on page: 40
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: LR55805
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR55805%27 HTTP/1.1" 200 None
2026-03-27 10:52:57 [auto1.de] INFO: Scrape type for LR55805: 0
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: CR26660
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26660%27 HTTP/1.1" 200 None
2026-03-27 10:52:57 [auto1.de] INFO: Scrape type for CR26660: 0
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: JY21076
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: FD98026
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD98026%27 HTTP/1.1" 200 None
2026-03-27 10:52:57 [auto1.de] INFO: Scrape type for FD98026: 0
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: TD00489
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD00489%27 HTTP/1.1" 200 None
2026-03-27 10:52:57 [auto1.de] INFO: Scrape type for TD00489: 0
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: LT89325
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT89325%27 HTTP/1.1" 200 None
2026-03-27 10:52:57 [auto1.de] INFO: Scrape type for LT89325: 0
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: TU60505
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU60505%27 HTTP/1.1" 200 None
2026-03-27 10:52:57 [auto1.de] INFO: Scrape type for TU60505: 0
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: ZS42305
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: ZX24460
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX24460%27 HTTP/1.1" 200 None
2026-03-27 10:52:57 [auto1.de] INFO: Scrape type for ZX24460: 0
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: XN03179
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: ZS93402
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: SP79690
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: MV74977
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: AT89439
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: VH66319
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: ZM28041
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: RW72684
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: HV23751
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV23751%27 HTTP/1.1" 200 None
2026-03-27 10:52:57 [auto1.de] INFO: Scrape type for HV23751: 0
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: UP47374
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: JD69912
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD69912%27 HTTP/1.1" 200 None
2026-03-27 10:52:57 [auto1.de] INFO: Scrape type for JD69912: 0
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: LA56471
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: LA42525
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: XT31458
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: XN13180
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: JG32595
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG32595%27 HTTP/1.1" 200 None
2026-03-27 10:52:57 [auto1.de] INFO: Scrape type for JG32595: 0
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: CS67228
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: FT79731
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: UJ67578
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: JX93926
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: SA54039
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: HC90704
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC90704%27 HTTP/1.1" 200 None
2026-03-27 10:52:57 [auto1.de] INFO: Scrape type for HC90704: 0
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: LT86298
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: JR21052
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: ND90480
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND90480%27 HTTP/1.1" 200 None
2026-03-27 10:52:57 [auto1.de] INFO: Scrape type for ND90480: 0
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: WE02156
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: ZC73485
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC73485%27 HTTP/1.1" 200 None
2026-03-27 10:52:57 [auto1.de] INFO: Scrape type for ZC73485: 0
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: EJ03111
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: RD07943
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD07943%27 HTTP/1.1" 200 None
2026-03-27 10:52:57 [auto1.de] INFO: Scrape type for RD07943: 0
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: BB60777
2026-03-27 10:52:57 [auto1.de] INFO: Found listing with ID: FE00822
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE00822%27 HTTP/1.1" 200 None
2026-03-27 10:52:57 [auto1.de] INFO: Scrape type for FE00822: 0
2026-03-27 10:52:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:52:59 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 10598 | hits on page: 40
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: LB18006
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB18006%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for LB18006: 0
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: YW60751
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: EG62319
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: NM38216
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM38216%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for NM38216: 0
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: FK66572
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: DP65043
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP65043%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for DP65043: 0
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: SF52194
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: FP09706
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: JS17929
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS17929%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for JS17929: 0
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: AX70348
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX70348%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for AX70348: 0
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: DS28927
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS28927%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for DS28927: 0
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: MZ87966
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ87966%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for MZ87966: 0
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: DG13652
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: TV32684
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: PH13713
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: SK87000
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK87000%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for SK87000: 0
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF63409%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for YF63409: 0
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: JF93651
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: CG98534
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: WN08657
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: MM42561
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM42561%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for MM42561: 0
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: VF27221
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF27221%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for VF27221: 0
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: UN02057
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: BC87695
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC87695%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for BC87695: 0
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: RS85257
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS85257%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for RS85257: 0
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: AJ86686
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: TL57176
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: PJ24227
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ24227%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for PJ24227: 0
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: CF86336
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF86336%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for CF86336: 0
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: MV92075
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: GS55217
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: DP83839
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: PB76080
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB76080%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for PB76080: 0
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: GM94647
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: RN54961
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN54961%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for RN54961: 0
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: MJ40039
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ40039%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for MJ40039: 0
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: VH72223
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: FE09717
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: AF05877
2026-03-27 10:52:59 [auto1.de] INFO: Found listing with ID: UH83431
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH83431%27 HTTP/1.1" 200 None
2026-03-27 10:52:59 [auto1.de] INFO: Scrape type for UH83431: 0
2026-03-27 10:52:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:00 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 10598 | hits on page: 40
2026-03-27 10:53:00 [auto1.de] INFO: Found listing with ID: AF34629
2026-03-27 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF34629%27 HTTP/1.1" 200 None
2026-03-27 10:53:00 [auto1.de] INFO: Scrape type for AF34629: 0
2026-03-27 10:53:00 [auto1.de] INFO: Found listing with ID: ZC11343
2026-03-27 10:53:00 [auto1.de] INFO: Found listing with ID: BD98911
2026-03-27 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD98911%27 HTTP/1.1" 200 None
2026-03-27 10:53:00 [auto1.de] INFO: Scrape type for BD98911: 0
2026-03-27 10:53:00 [auto1.de] INFO: Found listing with ID: RY65536
2026-03-27 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY65536%27 HTTP/1.1" 200 None
2026-03-27 10:53:01 [auto1.de] INFO: Scrape type for RY65536: 0
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: ZR59772
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: RB95028
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: PX60465
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: DF85076
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: DN14078
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN14078%27 HTTP/1.1" 200 None
2026-03-27 10:53:01 [auto1.de] INFO: Scrape type for DN14078: 0
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: ZF37712
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: VC14600
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC14600%27 HTTP/1.1" 200 None
2026-03-27 10:53:01 [auto1.de] INFO: Scrape type for VC14600: 0
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: CD24326
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: UN26673
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: AC23286
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: RL19876
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL19876%27 HTTP/1.1" 200 None
2026-03-27 10:53:01 [auto1.de] INFO: Scrape type for RL19876: 0
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: RY31078
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: GF50389
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF50389%27 HTTP/1.1" 200 None
2026-03-27 10:53:01 [auto1.de] INFO: Scrape type for GF50389: 0
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: GR51738
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR51738%27 HTTP/1.1" 200 None
2026-03-27 10:53:01 [auto1.de] INFO: Scrape type for GR51738: 0
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: SU91626
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB75617%27 HTTP/1.1" 200 None
2026-03-27 10:53:01 [auto1.de] INFO: Scrape type for JB75617: 0
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: WL37593
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: VW16070
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: LF22482
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: PF58362
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: JJ69636
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ69636%27 HTTP/1.1" 200 None
2026-03-27 10:53:01 [auto1.de] INFO: Scrape type for JJ69636: 0
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: UN85261
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN85261%27 HTTP/1.1" 200 None
2026-03-27 10:53:01 [auto1.de] INFO: Scrape type for UN85261: 0
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: GZ48275
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: BR69412
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR69412%27 HTTP/1.1" 200 None
2026-03-27 10:53:01 [auto1.de] INFO: Scrape type for BR69412: 0
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: WA11944
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA11944%27 HTTP/1.1" 200 None
2026-03-27 10:53:01 [auto1.de] INFO: Scrape type for WA11944: 0
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: TX92372
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92372%27 HTTP/1.1" 200 None
2026-03-27 10:53:01 [auto1.de] INFO: Scrape type for TX92372: 0
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: UD72248
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD72248%27 HTTP/1.1" 200 None
2026-03-27 10:53:01 [auto1.de] INFO: Scrape type for UD72248: 0
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: HG99428
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG99428%27 HTTP/1.1" 200 None
2026-03-27 10:53:01 [auto1.de] INFO: Scrape type for HG99428: 0
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: JK54144
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK54144%27 HTTP/1.1" 200 None
2026-03-27 10:53:01 [auto1.de] INFO: Scrape type for JK54144: 0
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: CB34821
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: YW93482
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: UZ08397
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: XB91426
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB91426%27 HTTP/1.1" 200 None
2026-03-27 10:53:01 [auto1.de] INFO: Scrape type for XB91426: 0
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: AV64350
2026-03-27 10:53:01 [auto1.de] INFO: Found listing with ID: FT25652
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT25652%27 HTTP/1.1" 200 None
2026-03-27 10:53:01 [auto1.de] INFO: Scrape type for FT25652: 0
2026-03-27 10:53:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:07 [scrapy.extensions.logstats] INFO: Crawled 500 pages (at 9 pages/min), scraped 938 items (at 2 items/min)
2026-03-27 10:53:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-27 10:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:11 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 10598 | hits on page: 40
2026-03-27 10:53:11 [auto1.de] INFO: Found listing with ID: EH05548
2026-03-27 10:53:11 [auto1.de] INFO: Found listing with ID: VA45757
2026-03-27 10:53:11 [auto1.de] INFO: Found listing with ID: SF40238
2026-03-27 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF40238%27 HTTP/1.1" 200 None
2026-03-27 10:53:11 [auto1.de] INFO: Scrape type for SF40238: 0
2026-03-27 10:53:11 [auto1.de] INFO: Found listing with ID: XT10731
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT10731%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for XT10731: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: XJ35206
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: LX91307
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX91307%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for LX91307: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: YT12471
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: LS25990
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS25990%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for LS25990: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: GG55912
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG55912%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for GG55912: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: VT79224
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT79224%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for VT79224: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: KR27506
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR27506%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for KR27506: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: MP72809
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP72809%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for MP72809: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: PC02777
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC02777%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for PC02777: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: YG65894
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: EZ32213
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ32213%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for EZ32213: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: LK97780
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK97780%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for LK97780: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: ZE55341
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: DB67096
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: AF76763
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: PA64301
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA64301%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for PA64301: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: CC62895
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: ZJ50870
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: SX42326
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: MY20439
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY20439%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for MY20439: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: LR09206
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR09206%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for LR09206: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: TX14113
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX14113%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for TX14113: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: VV39146
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV39146%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for VV39146: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: PY78932
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY78932%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for PY78932: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: FA30463
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: MG58953
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: WE17641
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: SC14784
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: KK91301
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: MC30685
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: VA67850
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: CS22727
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS22727%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for CS22727: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: UN03775
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: LF50472
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF50472%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for LF50472: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: UW28786
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW28786%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for UW28786: 0
2026-03-27 10:53:12 [auto1.de] INFO: Found listing with ID: BY81005
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY81005%27 HTTP/1.1" 200 None
2026-03-27 10:53:12 [auto1.de] INFO: Scrape type for BY81005: 0
2026-03-27 10:53:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:13 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 10598 | hits on page: 40
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: LH15693
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: LT28781
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: TL45380
2026-03-27 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL45380%27 HTTP/1.1" 200 None
2026-03-27 10:53:13 [auto1.de] INFO: Scrape type for TL45380: 0
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: JU90963
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: PD39203
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: ZM65799
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: EX94695
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: RA32966
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: RT31572
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: YM41627
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: HS18111
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: BV83779
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: UY83192
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: RU14902
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: JN14565
2026-03-27 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN14565%27 HTTP/1.1" 200 None
2026-03-27 10:53:13 [auto1.de] INFO: Scrape type for JN14565: 0
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: AV44518
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: WM77148
2026-03-27 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM77148%27 HTTP/1.1" 200 None
2026-03-27 10:53:13 [auto1.de] INFO: Scrape type for WM77148: 0
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: KK79364
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: LR25618
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: SD22522
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: DA75370
2026-03-27 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA75370%27 HTTP/1.1" 200 None
2026-03-27 10:53:13 [auto1.de] INFO: Scrape type for DA75370: 0
2026-03-27 10:53:13 [auto1.de] INFO: Found listing with ID: XH14540
2026-03-27 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH14540%27 HTTP/1.1" 200 None
2026-03-27 10:53:13 [auto1.de] INFO: Scrape type for XH14540: 2
2026-03-27 10:53:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae613548-640b-5023-b665-3b2cf8b20069 with identifier: XH14540
2026-03-27 10:53:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae613548-640b-5023-b665-3b2cf8b20069 with scrape type 2
2026-03-27 10:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae613548-640b-5023-b665-3b2cf8b20069 with scrape type 2
2026-03-27 10:53:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae613548-640b-5023-b665-3b2cf8b20069, identifier: XH14540
2026-03-27 10:53:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae613548-640b-5023-b665-3b2cf8b20069 with identifier: XH14540
2026-03-27 10:53:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae613548-640b-5023-b665-3b2cf8b20069 with identifier: XH14540
2026-03-27 10:53:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae613548-640b-5023-b665-3b2cf8b20069 with identifier: XH14540 to the API
2026-03-27 10:53:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:53:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-27T16:43:24Z',
'fuel_type': 'diesel',
'id': 'ae613548-640b-5023-b665-3b2cf8b20069',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH14540',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 226697,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-23',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Elegance',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Elegance',
'year': 2013}
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH14540%27 HTTP/1.1" 200 None
2026-03-27 10:53:15 [auto1.de] INFO: Saving data for XH14540: {'auction_closing_time': 1774629804.0, 'created_time': 1774423840.387758, 'last_price_update_time': 1774608795.156135}
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH14540') HTTP/1.1" 204 0
2026-03-27 10:53:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:15 [auto1.de] INFO: Found listing with ID: DL58213
2026-03-27 10:53:15 [auto1.de] INFO: Found listing with ID: BV23508
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV23508%27 HTTP/1.1" 200 None
2026-03-27 10:53:15 [auto1.de] INFO: Scrape type for BV23508: 0
2026-03-27 10:53:15 [auto1.de] INFO: Found listing with ID: PM35721
2026-03-27 10:53:15 [auto1.de] INFO: Found listing with ID: VA30007
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA30007%27 HTTP/1.1" 200 None
2026-03-27 10:53:15 [auto1.de] INFO: Scrape type for VA30007: 0
2026-03-27 10:53:15 [auto1.de] INFO: Found listing with ID: AX05143
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX05143%27 HTTP/1.1" 200 None
2026-03-27 10:53:15 [auto1.de] INFO: Scrape type for AX05143: 0
2026-03-27 10:53:15 [auto1.de] INFO: Found listing with ID: DF79170
2026-03-27 10:53:15 [auto1.de] INFO: Found listing with ID: HY81815
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY81815%27 HTTP/1.1" 200 None
2026-03-27 10:53:15 [auto1.de] INFO: Scrape type for HY81815: 0
2026-03-27 10:53:15 [auto1.de] INFO: Found listing with ID: UW85251
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW85251%27 HTTP/1.1" 200 None
2026-03-27 10:53:15 [auto1.de] INFO: Scrape type for UW85251: 0
2026-03-27 10:53:15 [auto1.de] INFO: Found listing with ID: VP32594
2026-03-27 10:53:15 [auto1.de] INFO: Found listing with ID: SL14548
2026-03-27 10:53:15 [auto1.de] INFO: Found listing with ID: MK96538
2026-03-27 10:53:15 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-27 10:53:15 [auto1.de] INFO: Found listing with ID: ZB43592
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB43592%27 HTTP/1.1" 200 None
2026-03-27 10:53:15 [auto1.de] INFO: Scrape type for ZB43592: 0
2026-03-27 10:53:15 [auto1.de] INFO: Found listing with ID: KL49615
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL49615%27 HTTP/1.1" 200 None
2026-03-27 10:53:15 [auto1.de] INFO: Scrape type for KL49615: 0
2026-03-27 10:53:15 [auto1.de] INFO: Found listing with ID: LU77113
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU77113%27 HTTP/1.1" 200 None
2026-03-27 10:53:15 [auto1.de] INFO: Scrape type for LU77113: 0
2026-03-27 10:53:15 [auto1.de] INFO: Found listing with ID: SJ63843
2026-03-27 10:53:15 [auto1.de] INFO: Found listing with ID: LY36951
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY36951%27 HTTP/1.1" 200 None
2026-03-27 10:53:15 [auto1.de] INFO: Scrape type for LY36951: 0
2026-03-27 10:53:15 [auto1.de] INFO: Found listing with ID: HK32751
2026-03-27 10:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:16 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 10598 | hits on page: 40
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: WL63965
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL63965%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for WL63965: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: JV13466
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV13466%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for JV13466: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: XA64266
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA64266%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for XA64266: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: UU63359
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU63359%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for UU63359: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: MF18301
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF18301%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for MF18301: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: SL64623
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL64623%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for SL64623: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: KP66478
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP66478%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for KP66478: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: MK32086
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK32086%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for MK32086: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: ZS98527
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: US44067
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: UJ61618
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: RD59857
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: RK01073
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK01073%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for RK01073: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: FA60427
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: RN93387
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN93387%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for RN93387: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: AP69664
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: ZT65198
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT65198%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for ZT65198: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: FW94459
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW94459%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for FW94459: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: HD76685
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: DD53809
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD53809%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for DD53809: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: GZ91789
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ91789%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for GZ91789: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: RU36508
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH36335%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for VH36335: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: WR52929
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: PH10965
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: YK76722
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK76722%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for YK76722: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP90284%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for DP90284: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: DY66816
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: TK31423
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK31423%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for TK31423: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: FG34327
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: SB18455
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB18455%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for SB18455: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: DG64932
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG64932%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for DG64932: 0
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: SL62735
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: TK01358
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: WV99125
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: DE69503
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: YF52750
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: ZA03295
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: PT38806
2026-03-27 10:53:16 [auto1.de] INFO: Found listing with ID: TD89084
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD89084%27 HTTP/1.1" 200 None
2026-03-27 10:53:16 [auto1.de] INFO: Scrape type for TD89084: 0
2026-03-27 10:53:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:17 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 10598 | hits on page: 40
2026-03-27 10:53:17 [auto1.de] INFO: Found listing with ID: RU39744
2026-03-27 10:53:17 [auto1.de] INFO: Found listing with ID: CG10227
2026-03-27 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG10227%27 HTTP/1.1" 200 None
2026-03-27 10:53:17 [auto1.de] INFO: Scrape type for CG10227: 0
2026-03-27 10:53:17 [auto1.de] INFO: Found listing with ID: DV22671
2026-03-27 10:53:17 [auto1.de] INFO: Found listing with ID: XB15869
2026-03-27 10:53:17 [auto1.de] INFO: Found listing with ID: JY81419
2026-03-27 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY81419%27 HTTP/1.1" 200 None
2026-03-27 10:53:17 [auto1.de] INFO: Scrape type for JY81419: 0
2026-03-27 10:53:17 [auto1.de] INFO: Found listing with ID: RY13097
2026-03-27 10:53:17 [auto1.de] INFO: Found listing with ID: SP61181
2026-03-27 10:53:17 [auto1.de] INFO: Found listing with ID: ZF31779
2026-03-27 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF31779%27 HTTP/1.1" 200 None
2026-03-27 10:53:17 [auto1.de] INFO: Scrape type for ZF31779: 0
2026-03-27 10:53:17 [auto1.de] INFO: Found listing with ID: RX71725
2026-03-27 10:53:17 [auto1.de] INFO: Found listing with ID: RS99660
2026-03-27 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS99660%27 HTTP/1.1" 200 None
2026-03-27 10:53:17 [auto1.de] INFO: Scrape type for RS99660: 0
2026-03-27 10:53:17 [auto1.de] INFO: Found listing with ID: PN08038
2026-03-27 10:53:17 [auto1.de] INFO: Found listing with ID: WT98226
2026-03-27 10:53:17 [auto1.de] INFO: Found listing with ID: GE10245
2026-03-27 10:53:17 [auto1.de] INFO: Found listing with ID: YP63801
2026-03-27 10:53:17 [auto1.de] INFO: Found listing with ID: YS82849
2026-03-27 10:53:17 [auto1.de] INFO: Found listing with ID: NP13175
2026-03-27 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP13175%27 HTTP/1.1" 200 None
2026-03-27 10:53:17 [auto1.de] INFO: Scrape type for NP13175: 0
2026-03-27 10:53:17 [auto1.de] INFO: Found listing with ID: KE84614
2026-03-27 10:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE84614%27 HTTP/1.1" 200 None
2026-03-27 10:53:18 [auto1.de] INFO: Scrape type for KE84614: 0
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: YL58691
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL58691%27 HTTP/1.1" 200 None
2026-03-27 10:53:18 [auto1.de] INFO: Scrape type for YL58691: 0
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: XC28848
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC28848%27 HTTP/1.1" 200 None
2026-03-27 10:53:18 [auto1.de] INFO: Scrape type for XC28848: 0
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: AF58203
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: VJ93745
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: SB26210
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB26210%27 HTTP/1.1" 200 None
2026-03-27 10:53:18 [auto1.de] INFO: Scrape type for SB26210: 0
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: YH51203
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: KJ32312
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ32312%27 HTTP/1.1" 200 None
2026-03-27 10:53:18 [auto1.de] INFO: Scrape type for KJ32312: 0
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: KN86570
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: ZN33524
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: WZ62947
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ62947%27 HTTP/1.1" 200 None
2026-03-27 10:53:18 [auto1.de] INFO: Scrape type for WZ62947: 0
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: XB67892
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: LN73232
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: XH65764
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH65764%27 HTTP/1.1" 200 None
2026-03-27 10:53:18 [auto1.de] INFO: Scrape type for XH65764: 0
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: XH17587
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: RD87783
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: RV54211
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV54211%27 HTTP/1.1" 200 None
2026-03-27 10:53:18 [auto1.de] INFO: Scrape type for RV54211: 0
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: VV41845
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV41845%27 HTTP/1.1" 200 None
2026-03-27 10:53:18 [auto1.de] INFO: Scrape type for VV41845: 0
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: UL81798
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: VC48066
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC48066%27 HTTP/1.1" 200 None
2026-03-27 10:53:18 [auto1.de] INFO: Scrape type for VC48066: 0
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: SD77911
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD77911%27 HTTP/1.1" 200 None
2026-03-27 10:53:18 [auto1.de] INFO: Scrape type for SD77911: 0
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: LB09989
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB09989%27 HTTP/1.1" 200 None
2026-03-27 10:53:18 [auto1.de] INFO: Scrape type for LB09989: 0
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: SS47444
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS47444%27 HTTP/1.1" 200 None
2026-03-27 10:53:18 [auto1.de] INFO: Scrape type for SS47444: 0
2026-03-27 10:53:18 [auto1.de] INFO: Found listing with ID: VS41929
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS41929%27 HTTP/1.1" 200 None
2026-03-27 10:53:18 [auto1.de] INFO: Scrape type for VS41929: 0
2026-03-27 10:53:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:19 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 10598 | hits on page: 40
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: PF21402
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: NK11674
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: HK56220
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK56220%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for HK56220: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: JB65350
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB65350%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for JB65350: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: US16012
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US16012%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for US16012: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: LM34765
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM34765%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for LM34765: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: UN20797
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: TN32839
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: BA95862
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: JL97889
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL97889%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for JL97889: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: VC10379
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC10379%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for VC10379: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: AZ88481
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: BE00022
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: XT48956
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT48956%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for XT48956: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: DC48587
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC48587%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for DC48587: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: MP50807
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: JP66704
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP66704%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for JP66704: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: RX82529
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: BJ62941
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ62941%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for BJ62941: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: MP85459
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: HX10510
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: SC69057
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: TD14857
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD14857%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for TD14857: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: CC84922
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: BF67305
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: EN14758
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN14758%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for EN14758: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: EV47698
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV47698%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for EV47698: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: DC40385
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC40385%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for DC40385: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: RL08857
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL08857%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for RL08857: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: RU20200
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU20200%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for RU20200: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: MA62044
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA62044%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for MA62044: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: DS40784
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: WL25764
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL25764%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for WL25764: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: HG60353
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: SA61025
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA61025%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for SA61025: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: MK52280
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: MW79572
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW79572%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for MW79572: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: XA59462
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59462%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for XA59462: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: SC92395
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC92395%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for SC92395: 0
2026-03-27 10:53:19 [auto1.de] INFO: Found listing with ID: CN04574
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN04574%27 HTTP/1.1" 200 None
2026-03-27 10:53:19 [auto1.de] INFO: Scrape type for CN04574: 0
2026-03-27 10:53:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:21 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 10598 | hits on page: 40
2026-03-27 10:53:21 [auto1.de] INFO: Found listing with ID: YD41840
2026-03-27 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD41840%27 HTTP/1.1" 200 None
2026-03-27 10:53:21 [auto1.de] INFO: Scrape type for YD41840: 0
2026-03-27 10:53:21 [auto1.de] INFO: Found listing with ID: AS63846
2026-03-27 10:53:21 [auto1.de] INFO: Found listing with ID: CM42971
2026-03-27 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM42971%27 HTTP/1.1" 200 None
2026-03-27 10:53:21 [auto1.de] INFO: Scrape type for CM42971: 0
2026-03-27 10:53:21 [auto1.de] INFO: Found listing with ID: YN88329
2026-03-27 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN88329%27 HTTP/1.1" 200 None
2026-03-27 10:53:21 [auto1.de] INFO: Scrape type for YN88329: 0
2026-03-27 10:53:21 [auto1.de] INFO: Found listing with ID: GP48651
2026-03-27 10:53:21 [auto1.de] INFO: Found listing with ID: TK74975
2026-03-27 10:53:21 [auto1.de] INFO: Found listing with ID: VY35567
2026-03-27 10:53:21 [auto1.de] INFO: Found listing with ID: PM10590
2026-03-27 10:53:21 [auto1.de] INFO: Found listing with ID: HS45664
2026-03-27 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS45664%27 HTTP/1.1" 200 None
2026-03-27 10:53:21 [auto1.de] INFO: Scrape type for HS45664: 0
2026-03-27 10:53:21 [auto1.de] INFO: Found listing with ID: YT61577
2026-03-27 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT61577%27 HTTP/1.1" 200 None
2026-03-27 10:53:21 [auto1.de] INFO: Scrape type for YT61577: 2
2026-03-27 10:53:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e0355f6-8612-5e68-bddb-afee3bc7a2ab with identifier: YT61577
2026-03-27 10:53:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e0355f6-8612-5e68-bddb-afee3bc7a2ab with scrape type 2
2026-03-27 10:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e0355f6-8612-5e68-bddb-afee3bc7a2ab with scrape type 2
2026-03-27 10:53:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e0355f6-8612-5e68-bddb-afee3bc7a2ab, identifier: YT61577
2026-03-27 10:53:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e0355f6-8612-5e68-bddb-afee3bc7a2ab with identifier: YT61577
2026-03-27 10:53:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e0355f6-8612-5e68-bddb-afee3bc7a2ab with identifier: YT61577
2026-03-27 10:53:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e0355f6-8612-5e68-bddb-afee3bc7a2ab with identifier: YT61577 to the API
2026-03-27 10:53:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:53:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:53:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 178,
'expiration_date': '2026-03-27T16:32:35Z',
'fuel_type': 'petrol',
'id': '4e0355f6-8612-5e68-bddb-afee3bc7a2ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT61577',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 38864,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-28',
'seller_name': None,
'title': 'MINI Countryman Cooper S Classic Trim',
'transmission': 'manual',
'trim': 'Classic Trim',
'year': 2022}
2026-03-27 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT61577%27 HTTP/1.1" 200 None
2026-03-27 10:53:21 [auto1.de] INFO: Saving data for YT61577: {'auction_closing_time': 1774629155.0, 'created_time': 1773303590.409206, 'last_price_update_time': 1774608801.89676}
2026-03-27 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT61577') HTTP/1.1" 204 0
2026-03-27 10:53:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: UG35230
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG35230%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for UG35230: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: XC35709
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC35709%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for XC35709: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: WK49047
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK49047%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for WK49047: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: PM61322
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: ZN74052
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: WV66360
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: TM46597
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: YR45696
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR45696%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for YR45696: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: PR75210
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR75210%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for PR75210: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: ZH86268
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH86268%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for ZH86268: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: EJ11673
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: JS18572
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS18572%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for JS18572: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: KB43616
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB43616%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for KB43616: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: KH18492
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: CK03122
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: CB57025
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB57025%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for CB57025: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: CR24268
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR24268%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for CR24268: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: AW32080
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: BK82151
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK82151%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for BK82151: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: YG98793
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: DL83760
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL83760%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for DL83760: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: PH55867
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH55867%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for PH55867: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: UJ91538
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: RN76659
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN76659%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for RN76659: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: PG90972
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: VX85374
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: VJ89653
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: JT67196
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT67196%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for JT67196: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: SS03319
2026-03-27 10:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:24 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 10599 | hits on page: 40
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: SS03319
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: VA69580
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: CL49552
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: YG51105
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: KR30389
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR30389%27 HTTP/1.1" 200 None
2026-03-27 10:53:24 [auto1.de] INFO: Scrape type for KR30389: 0
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD56842%27 HTTP/1.1" 200 None
2026-03-27 10:53:24 [auto1.de] INFO: Scrape type for TD56842: 0
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: FH96221
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH96221%27 HTTP/1.1" 200 None
2026-03-27 10:53:24 [auto1.de] INFO: Scrape type for FH96221: 0
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: LJ59261
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: NE09834
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: MU08811
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU08811%27 HTTP/1.1" 200 None
2026-03-27 10:53:24 [auto1.de] INFO: Scrape type for MU08811: 0
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: PG24106
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24106%27 HTTP/1.1" 200 None
2026-03-27 10:53:24 [auto1.de] INFO: Scrape type for PG24106: 0
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: TF26845
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: AL49500
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: HE72355
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: LP81758
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP81758%27 HTTP/1.1" 200 None
2026-03-27 10:53:24 [auto1.de] INFO: Scrape type for LP81758: 0
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: SP32768
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP32768%27 HTTP/1.1" 200 None
2026-03-27 10:53:24 [auto1.de] INFO: Scrape type for SP32768: 0
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: JB57903
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB57903%27 HTTP/1.1" 200 None
2026-03-27 10:53:24 [auto1.de] INFO: Scrape type for JB57903: 0
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: EM16254
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: HR29759
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR29759%27 HTTP/1.1" 200 None
2026-03-27 10:53:24 [auto1.de] INFO: Scrape type for HR29759: 2
2026-03-27 10:53:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeb33fa1-2df9-5c86-b23a-d4f2f3e6fd6c with identifier: HR29759
2026-03-27 10:53:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeb33fa1-2df9-5c86-b23a-d4f2f3e6fd6c with scrape type 2
2026-03-27 10:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aeb33fa1-2df9-5c86-b23a-d4f2f3e6fd6c with scrape type 2
2026-03-27 10:53:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aeb33fa1-2df9-5c86-b23a-d4f2f3e6fd6c, identifier: HR29759
2026-03-27 10:53:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aeb33fa1-2df9-5c86-b23a-d4f2f3e6fd6c with identifier: HR29759
2026-03-27 10:53:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aeb33fa1-2df9-5c86-b23a-d4f2f3e6fd6c with identifier: HR29759
2026-03-27 10:53:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aeb33fa1-2df9-5c86-b23a-d4f2f3e6fd6c with identifier: HR29759 to the API
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:53:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-27T16:26:36Z',
'fuel_type': 'diesel',
'id': 'aeb33fa1-2df9-5c86-b23a-d4f2f3e6fd6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR29759',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 231552,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-06',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 250 d lang BlueTEC Avantgarde Edition',
'transmission': 'automatic',
'trim': 'lang BlueTEC Avantgarde Edition',
'year': 2016}
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR29759%27 HTTP/1.1" 200 None
2026-03-27 10:53:25 [auto1.de] INFO: Saving data for HR29759: {'auction_closing_time': 1774628796.0, 'created_time': 1773132172.933046, 'last_price_update_time': 1774608805.522169}
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR29759') HTTP/1.1" 204 0
2026-03-27 10:53:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: PE82086
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: XX09000
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX09000%27 HTTP/1.1" 200 None
2026-03-27 10:53:25 [auto1.de] INFO: Scrape type for XX09000: 0
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: RA13957
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: BY66745
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY66745%27 HTTP/1.1" 200 None
2026-03-27 10:53:25 [auto1.de] INFO: Scrape type for BY66745: 0
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: CR26579
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: RZ82466
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: KX40917
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX40917%27 HTTP/1.1" 200 None
2026-03-27 10:53:25 [auto1.de] INFO: Scrape type for KX40917: 0
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: ZC45709
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC45709%27 HTTP/1.1" 200 None
2026-03-27 10:53:25 [auto1.de] INFO: Scrape type for ZC45709: 0
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: XV11651
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: LW52263
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW52263%27 HTTP/1.1" 200 None
2026-03-27 10:53:25 [auto1.de] INFO: Scrape type for LW52263: 0
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: BW22563
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW22563%27 HTTP/1.1" 200 None
2026-03-27 10:53:25 [auto1.de] INFO: Scrape type for BW22563: 0
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: MT13851
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: PM62830
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: AE50962
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE50962%27 HTTP/1.1" 200 None
2026-03-27 10:53:25 [auto1.de] INFO: Scrape type for AE50962: 0
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: SK17684
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: DM70532
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: GS24649
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: KZ06018
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: SK33918
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK33918%27 HTTP/1.1" 200 None
2026-03-27 10:53:25 [auto1.de] INFO: Scrape type for SK33918: 0
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: XK62781
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK62781%27 HTTP/1.1" 200 None
2026-03-27 10:53:25 [auto1.de] INFO: Scrape type for XK62781: 0
2026-03-27 10:53:25 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-27 10:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:29 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 10600 | hits on page: 40
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: GY77163
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: WR22975
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR22975%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for WR22975: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: DD03238
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD03238%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for DD03238: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: RL59137
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: FP89516
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: KU80170
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: KU48323
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: FT33295
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: CT48596
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT48596%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for CT48596: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: PP69489
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP69489%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for PP69489: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: SX57791
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: DU40633
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU40633%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for DU40633: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: EG33141
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG33141%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for EG33141: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: BW90089
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: RP81387
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP81387%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for RP81387: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: PF96203
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: FX96074
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: GE82925
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE82925%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for GE82925: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: DD23364
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: TP88372
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP88372%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for TP88372: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: VH83950
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: RV71441
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: DH94169
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH94169%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for DH94169: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: ZN72098
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN72098%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for ZN72098: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: CA90460
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA90460%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for CA90460: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: PK00537
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK00537%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for PK00537: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: VC19862
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC19862%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for VC19862: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: ZJ94991
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: TA51797
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: SA53556
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA53556%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for SA53556: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: JB49732
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: VK99504
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: NB15408
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB15408%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for NB15408: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: ZM18653
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: WD57497
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD57497%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for WD57497: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: EM73701
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM73701%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for EM73701: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: EL01882
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: MR31095
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR31095%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for MR31095: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: TD39885
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD39885%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for TD39885: 0
2026-03-27 10:53:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:30 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 10600 | hits on page: 40
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: VZ64604
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ64604%27 HTTP/1.1" 200 None
2026-03-27 10:53:30 [auto1.de] INFO: Scrape type for VZ64604: 0
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: VT56580
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT56580%27 HTTP/1.1" 200 None
2026-03-27 10:53:30 [auto1.de] INFO: Scrape type for VT56580: 0
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: SX62483
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: VH89235
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: XJ79433
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: NY45531
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45531%27 HTTP/1.1" 200 None
2026-03-27 10:53:30 [auto1.de] INFO: Scrape type for NY45531: 0
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: SF95135
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: XS67739
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS67739%27 HTTP/1.1" 200 None
2026-03-27 10:53:30 [auto1.de] INFO: Scrape type for XS67739: 0
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: HN86226
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: LF99231
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: LW15180
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW15180%27 HTTP/1.1" 200 None
2026-03-27 10:53:30 [auto1.de] INFO: Scrape type for LW15180: 0
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: WC76278
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: UM76934
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: LR81962
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: PY46778
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: SL45224
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: FD77261
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD77261%27 HTTP/1.1" 200 None
2026-03-27 10:53:30 [auto1.de] INFO: Scrape type for FD77261: 0
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: LX19863
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX19863%27 HTTP/1.1" 200 None
2026-03-27 10:53:30 [auto1.de] INFO: Scrape type for LX19863: 0
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: UH58426
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: SJ01249
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: ZX04970
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX04970%27 HTTP/1.1" 200 None
2026-03-27 10:53:30 [auto1.de] INFO: Scrape type for ZX04970: 0
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: BY01569
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY01569%27 HTTP/1.1" 200 None
2026-03-27 10:53:30 [auto1.de] INFO: Scrape type for BY01569: 0
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: XV80159
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: EC98631
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC98631%27 HTTP/1.1" 200 None
2026-03-27 10:53:30 [auto1.de] INFO: Scrape type for EC98631: 0
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: GU42707
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: XL21584
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL21584%27 HTTP/1.1" 200 None
2026-03-27 10:53:30 [auto1.de] INFO: Scrape type for XL21584: 0
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: KU34355
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU34355%27 HTTP/1.1" 200 None
2026-03-27 10:53:30 [auto1.de] INFO: Scrape type for KU34355: 0
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: UA33739
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: BD52113
2026-03-27 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD52113%27 HTTP/1.1" 200 None
2026-03-27 10:53:31 [auto1.de] INFO: Scrape type for BD52113: 0
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: TY80313
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: DV30882
2026-03-27 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV30882%27 HTTP/1.1" 200 None
2026-03-27 10:53:31 [auto1.de] INFO: Scrape type for DV30882: 0
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: ZY59187
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: SC88489
2026-03-27 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC88489%27 HTTP/1.1" 200 None
2026-03-27 10:53:31 [auto1.de] INFO: Scrape type for SC88489: 0
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: JU71873
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: LN90671
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: LS73551
2026-03-27 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS73551%27 HTTP/1.1" 200 None
2026-03-27 10:53:31 [auto1.de] INFO: Scrape type for LS73551: 0
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: WU62760
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: XE48983
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: CX96201
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: EY31164
2026-03-27 10:53:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:34 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 10601 | hits on page: 40
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: EY31164
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: BA71155
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA71155%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for BA71155: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: BS18924
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: RF93136
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: GS07550
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: CL19450
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: WH52152
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: CY80853
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY80853%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for CY80853: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: FD71544
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD71544%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for FD71544: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: PD98711
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: RU37876
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU37876%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for RU37876: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: RY60901
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY60901%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for RY60901: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: ND88059
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: KA05188
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: HF65480
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF65480%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for HF65480: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: EM35134
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: EU54911
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU54911%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for EU54911: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: JL52757
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: AW57612
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW57612%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for AW57612: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: JJ41566
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ41566%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for JJ41566: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: RS30233
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS30233%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for RS30233: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: ZU35501
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: UG79449
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG79449%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for UG79449: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: RC73620
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: FZ44341
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: SL30101
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL30101%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for SL30101: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: TY90085
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY90085%27 HTTP/1.1" 200 None
2026-03-27 10:53:35 [auto1.de] INFO: Scrape type for TY90085: 0
2026-03-27 10:53:35 [auto1.de] INFO: Found listing with ID: NA05551
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA05551%27 HTTP/1.1" 200 None
2026-03-27 10:53:35 [auto1.de] INFO: Scrape type for NA05551: 0
2026-03-27 10:53:35 [auto1.de] INFO: Found listing with ID: TT17310
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT17310%27 HTTP/1.1" 200 None
2026-03-27 10:53:35 [auto1.de] INFO: Scrape type for TT17310: 0
2026-03-27 10:53:35 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM64010%27 HTTP/1.1" 200 None
2026-03-27 10:53:35 [auto1.de] INFO: Scrape type for LM64010: 0
2026-03-27 10:53:35 [auto1.de] INFO: Found listing with ID: CV85999
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV85999%27 HTTP/1.1" 200 None
2026-03-27 10:53:35 [auto1.de] INFO: Scrape type for CV85999: 0
2026-03-27 10:53:35 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX73478%27 HTTP/1.1" 200 None
2026-03-27 10:53:35 [auto1.de] INFO: Scrape type for WX73478: 0
2026-03-27 10:53:35 [auto1.de] INFO: Found listing with ID: XT11627
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT11627%27 HTTP/1.1" 200 None
2026-03-27 10:53:35 [auto1.de] INFO: Scrape type for XT11627: 0
2026-03-27 10:53:35 [auto1.de] INFO: Found listing with ID: VH78331
2026-03-27 10:53:35 [auto1.de] INFO: Found listing with ID: XY75153
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY75153%27 HTTP/1.1" 200 None
2026-03-27 10:53:35 [auto1.de] INFO: Scrape type for XY75153: 0
2026-03-27 10:53:35 [auto1.de] INFO: Found listing with ID: ZJ77365
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ77365%27 HTTP/1.1" 200 None
2026-03-27 10:53:35 [auto1.de] INFO: Scrape type for ZJ77365: 0
2026-03-27 10:53:35 [auto1.de] INFO: Found listing with ID: ZE11257
2026-03-27 10:53:35 [auto1.de] INFO: Found listing with ID: RY43567
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY43567%27 HTTP/1.1" 200 None
2026-03-27 10:53:35 [auto1.de] INFO: Scrape type for RY43567: 0
2026-03-27 10:53:35 [auto1.de] INFO: Found listing with ID: WH24270
2026-03-27 10:53:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:36 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 10601 | hits on page: 40
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: AP12446
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP12446%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for AP12446: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: SE51657
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: BC32553
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: XZ20082
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: AF31278
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF31278%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for AF31278: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: CU41994
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU41994%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for CU41994: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: AB54939
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: YY19012
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY19012%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for YY19012: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: WK50134
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK50134%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for WK50134: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: VC25421
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: AF05413
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF05413%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for AF05413: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: NH48302
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH48302%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for NH48302: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: GV04450
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: ET42367
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET42367%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for ET42367: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: HR52949
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: TR18149
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: TU13190
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: ZX15203
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: NB79280
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB79280%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for NB79280: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: HP20518
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: TT92421
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT92421%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for TT92421: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: DV16657
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV16657%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for DV16657: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: LK21823
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK21823%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for LK21823: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: TZ04033
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ04033%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for TZ04033: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: TH95550
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH95550%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for TH95550: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: EJ26253
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ26253%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for EJ26253: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: FA12964
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA12964%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for FA12964: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: KG05257
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG05257%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for KG05257: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: NJ15905
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ15905%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for NJ15905: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: EF06566
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: LB19367
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: NZ20734
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: CU91826
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU91826%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for CU91826: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: SG96859
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG96859%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for SG96859: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: YG27675
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG27675%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for YG27675: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: JW33556
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: BE42770
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE42770%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for BE42770: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: YL30393
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: RS35479
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: TG09191
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG09191%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for TG09191: 0
2026-03-27 10:53:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:37 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 10601 | hits on page: 40
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: UR67543
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR67543%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for UR67543: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: CP09804
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP09804%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for CP09804: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: FY00774
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY00774%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for FY00774: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: WJ62953
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: KH44896
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH44896%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for KH44896: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: ZX12399
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: WZ42371
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: HH37576
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: BR62242
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: UV13467
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: YG27171
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG27171%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for YG27171: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: YA12310
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: KT31788
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT31788%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for KT31788: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: ES32816
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES32816%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for ES32816: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: SZ79532
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: PF85631
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF85631%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for PF85631: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: BD69992
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: BG47316
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: RB22775
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB22775%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for RB22775: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: MX24097
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: YK99793
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK99793%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for YK99793: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: XW91244
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: VY06306
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: MW86699
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW86699%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for MW86699: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: JP78451
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: AL03330
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL03330%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for AL03330: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: JA10787
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: JR80478
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR80478%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for JR80478: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: FR49421
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR49421%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for FR49421: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: VP49829
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP49829%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for VP49829: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: GX28379
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: ZW87373
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: KJ03468
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ03468%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for KJ03468: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: KF35020
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: LR04011
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR04011%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for LR04011: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: VZ90380
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ90380%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for VZ90380: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: KR63483
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR63483%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for KR63483: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: DN55210
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: RJ23692
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ23692%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for RJ23692: 0
2026-03-27 10:53:37 [auto1.de] INFO: Found listing with ID: VP44882
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP44882%27 HTTP/1.1" 200 None
2026-03-27 10:53:37 [auto1.de] INFO: Scrape type for VP44882: 0
2026-03-27 10:53:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:38 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 10602 | hits on page: 40
2026-03-27 10:53:38 [auto1.de] INFO: Found listing with ID: VP44882
2026-03-27 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP44882%27 HTTP/1.1" 200 None
2026-03-27 10:53:38 [auto1.de] INFO: Scrape type for VP44882: 0
2026-03-27 10:53:38 [auto1.de] INFO: Found listing with ID: MX11677
2026-03-27 10:53:38 [auto1.de] INFO: Found listing with ID: TR96772
2026-03-27 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR96772%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for TR96772: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: HF94002
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF94002%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for HF94002: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: MS18756
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: VP81164
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: CH49236
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: CJ03121
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: ZT91493
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: CL04690
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: RL82017
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL82017%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for RL82017: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: LE17323
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE17323%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for LE17323: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: VP95925
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: JU51054
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: KW13573
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW13573%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for KW13573: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: KX05344
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: YG95815
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG95815%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for YG95815: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: WV35399
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: ZA48754
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA48754%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for ZA48754: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: DD64809
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD64809%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for DD64809: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: XJ94036
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: WL60087
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL60087%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for WL60087: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: BV07882
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV07882%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for BV07882: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: RP55300
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: MP71247
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR74072%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for XR74072: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: DR46257
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: FN87515
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN87515%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for FN87515: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: PS69268
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: UJ13570
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: NA68427
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: NB36369
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB36369%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for NB36369: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: TG18980
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG18980%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for TG18980: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: GA97720
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: UX41831
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX41831%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for UX41831: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: XP46744
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP46744%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for XP46744: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: HU69919
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: WG93037
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: ZK64597
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK64597%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for ZK64597: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: AD00479
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD00479%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for AD00479: 0
2026-03-27 10:53:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:40 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 10602 | hits on page: 40
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: JT31602
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT31602%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for JT31602: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: PA49455
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA49455%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for PA49455: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: WP32637
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP32637%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for WP32637: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: FB62548
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: DE25074
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: ZU66278
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: BX93358
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: HX25760
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: BH79030
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH79030%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for BH79030: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: XW73625
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: BE61644
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: BE84221
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: GN20551
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: VD55079
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: FD10319
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: PV86472
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV86472%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for PV86472: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: AV36949
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: VG80520
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG80520%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for VG80520: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: HZ20849
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ20849%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for HZ20849: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: AV59132
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV59132%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for AV59132: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: FD77628
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD77628%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for FD77628: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: TW63650
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: DB98628
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB98628%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for DB98628: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: WG34535
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG34535%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for WG34535: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: EG37222
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: BE31678
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: GJ42826
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: UJ65232
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: SY47720
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: BH72065
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: AH65951
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65951%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for AH65951: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: NJ97251
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ97251%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for NJ97251: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: TV42528
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV42528%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for TV42528: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: DV16479
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV16479%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for DV16479: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: DL39221
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: VV51818
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: BJ16226
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: TA25179
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: NG71684
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: KF94492
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF94492%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for KF94492: 0
2026-03-27 10:53:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:41 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 10602 | hits on page: 40
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: XH96014
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: HD03620
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: YF37634
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: RW82237
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW82237%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for RW82237: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: JN01808
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN01808%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for JN01808: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: DN18269
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN18269%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for DN18269: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: KB71899
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: VE85769
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: WX19864
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: BV34042
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: TF12551
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF12551%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for TF12551: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: UJ05143
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ05143%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for UJ05143: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: HY91641
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: YN56792
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: ZT70228
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT70228%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for ZT70228: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: ZC99377
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: GF20039
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: ES20413
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: HX09713
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: BY53674
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY53674%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for BY53674: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: DR53843
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: CR32781
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: JE43996
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: GM71398
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: XE17582
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: CL77716
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL77716%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for CL77716: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: LL46180
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: JX39487
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: FC72279
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC72279%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for FC72279: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: RZ45087
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ45087%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for RZ45087: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: WL34020
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL34020%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for WL34020: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: NB01116
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-27 10:53:42 [auto1.de] INFO: Found listing with ID: GK62232
2026-03-27 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK62232%27 HTTP/1.1" 200 None
2026-03-27 10:53:42 [auto1.de] INFO: Scrape type for GK62232: 0
2026-03-27 10:53:42 [auto1.de] INFO: Found listing with ID: JB09111
2026-03-27 10:53:42 [auto1.de] INFO: Found listing with ID: NY69120
2026-03-27 10:53:42 [auto1.de] INFO: Found listing with ID: EE94897
2026-03-27 10:53:42 [auto1.de] INFO: Found listing with ID: AG19353
2026-03-27 10:53:42 [auto1.de] INFO: Found listing with ID: JM30411
2026-03-27 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM30411%27 HTTP/1.1" 200 None
2026-03-27 10:53:42 [auto1.de] INFO: Scrape type for JM30411: 0
2026-03-27 10:53:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:43 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 10602 | hits on page: 40
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: RW79290
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: YR17987
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR17987%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for YR17987: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: UK33318
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK33318%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for UK33318: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC19539%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for ZC19539: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: PP05974
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP05974%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for PP05974: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: SN29778
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN29778%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for SN29778: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: FY53654
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: YY13791
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY13791%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for YY13791: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: EX72075
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72075%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for EX72075: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: UG79939
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: JS64304
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: UA49331
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA49331%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for UA49331: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: VD67383
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD67383%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for VD67383: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: JU72191
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: FX38179
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX38179%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for FX38179: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: RA48340
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: TJ80177
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: AD99636
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD99636%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for AD99636: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: WT95105
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT95105%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for WT95105: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: YN05095
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: ZC12806
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: YE96502
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: LK91672
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK91672%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for LK91672: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: KN21474
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: SG28912
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: CV85765
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV85765%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for CV85765: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: CN22310
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN22310%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for CN22310: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: MM41381
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM41381%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for MM41381: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: KD91632
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD91632%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for KD91632: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: DW40061
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW40061%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for DW40061: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: NK69314
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK69314%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for NK69314: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: KG64303
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG64303%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for KG64303: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: JK78478
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: VS91117
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS91117%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for VS91117: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: ES63389
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES63389%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for ES63389: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: JF05347
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF05347%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for JF05347: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: YX64853
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX64853%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for YX64853: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT09686%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for JT09686: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: HE60226
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE60226%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for HE60226: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: HU03787
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU03787%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for HU03787: 0
2026-03-27 10:53:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:44 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 10602 | hits on page: 40
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: DR78688
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR78688%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for DR78688: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: KF94036
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF94036%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for KF94036: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: UN95806
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: RW07323
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: UV04779
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV04779%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for UV04779: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: AP13517
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: PV24261
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: WK72065
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR31322%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for DR31322: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: YC00540
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: KA01913
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: WZ89922
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ89922%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for WZ89922: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: AL34825
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL34825%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for AL34825: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: BP13198
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP13198%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for BP13198: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: VW77341
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: HX51661
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: FT12781
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: CV04289
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV04289%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for CV04289: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: XW75197
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW75197%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for XW75197: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: RX16022
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: WX30683
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: RZ67048
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: JC54567
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: GM14403
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM14403%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for GM14403: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: BV45977
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV45977%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for BV45977: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: ES90262
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES90262%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for ES90262: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: VX44094
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: GS25653
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS25653%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for GS25653: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: GU38218
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: CT19621
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT19621%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for CT19621: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: KT67254
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT67254%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for KT67254: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: UD97315
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD97315%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for UD97315: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: TS90843
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: EF37274
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF37274%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for EF37274: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: LZ37842
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: VF92951
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF92951%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for VF92951: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: KW73679
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW73679%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for KW73679: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: GF83151
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: MS74297
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: UM65045
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM65045%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for UM65045: 0
2026-03-27 10:53:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:46 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 10603 | hits on page: 40
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: UM65045
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM65045%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for UM65045: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: FM68959
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: UP04235
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: DG66548
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: YL21525
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: SE74775
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE74775%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for SE74775: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: HX35257
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: GJ17420
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: GE45288
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: GD02495
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD02495%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for GD02495: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: BH77652
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: EG23428
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG23428%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for EG23428: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: EY99757
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY99757%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for EY99757: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: PC83497
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: UC67308
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: FD73392
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: LB62140
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: KA96977
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA96977%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for KA96977: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: ND32607
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND32607%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for ND32607: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: SL68511
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: FR24268
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: GG24255
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: RD24777
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD24777%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for RD24777: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: MM34283
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: CC70846
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: BM72660
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: PB37282
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: WL29620
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL29620%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for WL29620: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: ZF15605
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: UK82813
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: FK98396
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: ZR95094
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: FP63780
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV50908%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for FV50908: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: VG50922
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: BU33854
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: FG17963
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG17963%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for FG17963: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: XK53444
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: PS14610
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: YU07668
2026-03-27 10:53:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:47 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 10603 | hits on page: 40
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: ZN92027
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: RW72092
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72092%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for RW72092: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: TL19983
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL19983%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for TL19983: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: BM83002
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: VT99201
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT99201%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for VT99201: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: LC22080
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: BY41560
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: BV91761
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: BS54687
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS54687%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for BS54687: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: XW55257
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW55257%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for XW55257: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: SZ17598
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ17598%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for SZ17598: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: DR48053
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR48053%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for DR48053: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: XP97772
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP97772%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for XP97772: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: RS25965
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS25965%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for RS25965: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: TE51742
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: HZ27782
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ27782%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for HZ27782: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: LW98251
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW98251%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for LW98251: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS86297%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for AS86297: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: MC08207
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC08207%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for MC08207: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: GH70383
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: CC31467
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC31467%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for CC31467: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: JR79964
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: DM27402
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: ZH99212
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH99212%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for ZH99212: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: SR07530
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: CS95663
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS95663%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for CS95663: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: KU76096
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: KK74048
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: FM34812
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM34812%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for FM34812: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: AZ98687
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: RR62010
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR62010%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for RR62010: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: DS79921
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS79921%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for DS79921: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: JX05743
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: NW61921
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: JN73492
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: HZ13557
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: YY27100
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY27100%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for YY27100: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: GG58124
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG58124%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for GG58124: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: RX10275
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: SU53309
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU53309%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for SU53309: 0
2026-03-27 10:53:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:48 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 10603 | hits on page: 40
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: BZ25882
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX89684%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for BX89684: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: JW40764
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW40764%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for JW40764: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: LH57585
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: NM07920
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM07920%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for NM07920: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: AF72986
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: TB76582
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB76582%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for TB76582: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: PN91954
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: LX13795
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: EB21377
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: WV50385
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV50385%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for WV50385: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: VF58468
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF58468%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for VF58468: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: EL21875
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: AD89648
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: CL50469
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: CS62800
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: VX30414
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX30414%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for VX30414: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: JB77026
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: RH70764
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH70764%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for RH70764: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: JW61268
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: GR83523
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: CF23775
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: RG32051
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG32051%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for RG32051: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: UR62816
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: DZ60663
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ60663%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for DZ60663: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: JK90168
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: VU23200
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: HY48738
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: UN81742
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN81742%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for UN81742: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: SP65722
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP65722%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for SP65722: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: RL02084
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL02084%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for RL02084: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: SW30333
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: YN03957
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN03957%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for YN03957: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: CB00446
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB00446%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for CB00446: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: ZA73263
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: MY02609
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: KL79977
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: EK84177
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK84177%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for EK84177: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-27 10:53:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:49 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 10603 | hits on page: 40
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: GL08454
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL08454%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for GL08454: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: NJ32517
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ32517%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for NJ32517: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: VN46123
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: SU78317
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: LD10656
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: PK27483
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: NS28302
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS28302%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for NS28302: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: SA90137
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA90137%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for SA90137: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: VC92798
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC92798%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for VC92798: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: XL53719
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: RJ02288
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: YX50554
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: LY44491
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY44491%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for LY44491: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: JV32870
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV32870%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for JV32870: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: JZ59846
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ59846%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for JZ59846: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: TR42945
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: ET75266
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET75266%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for ET75266: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: TC16779
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: ZF09358
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: YS83554
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS83554%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for YS83554: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: XC77974
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC77974%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for XC77974: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: SY14600
2026-03-27 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY14600%27 HTTP/1.1" 200 None
2026-03-27 10:53:50 [auto1.de] INFO: Scrape type for SY14600: 2
2026-03-27 10:53:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 172a9ba7-a50b-504d-bcc9-62530a0b61a8 with identifier: SY14600
2026-03-27 10:53:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 172a9ba7-a50b-504d-bcc9-62530a0b61a8 with scrape type 2
2026-03-27 10:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 172a9ba7-a50b-504d-bcc9-62530a0b61a8 with scrape type 2
2026-03-27 10:53:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 172a9ba7-a50b-504d-bcc9-62530a0b61a8, identifier: SY14600
2026-03-27 10:53:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 172a9ba7-a50b-504d-bcc9-62530a0b61a8 with identifier: SY14600
2026-03-27 10:53:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 172a9ba7-a50b-504d-bcc9-62530a0b61a8 with identifier: SY14600
2026-03-27 10:53:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 172a9ba7-a50b-504d-bcc9-62530a0b61a8 with identifier: SY14600 to the API
2026-03-27 10:53:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:53:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:53:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-27T16:26:27Z',
'fuel_type': 'petrol',
'id': '172a9ba7-a50b-504d-bcc9-62530a0b61a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY14600',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 104589,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-26',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.5 TSI ACT Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2020}
2026-03-27 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY14600%27 HTTP/1.1" 200 None
2026-03-27 10:53:50 [auto1.de] INFO: Saving data for SY14600: {'auction_closing_time': 1774628787.0, 'created_time': 1773860972.761966, 'last_price_update_time': 1774608830.819451}
2026-03-27 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY14600') HTTP/1.1" 204 0
2026-03-27 10:53:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:50 [auto1.de] INFO: Found listing with ID: MM98410
2026-03-27 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM98410%27 HTTP/1.1" 200 None
2026-03-27 10:53:51 [auto1.de] INFO: Scrape type for MM98410: 0
2026-03-27 10:53:51 [auto1.de] INFO: Found listing with ID: LF00427
2026-03-27 10:53:51 [auto1.de] INFO: Found listing with ID: AT55034
2026-03-27 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT55034%27 HTTP/1.1" 200 None
2026-03-27 10:53:51 [auto1.de] INFO: Scrape type for AT55034: 0
2026-03-27 10:53:51 [auto1.de] INFO: Found listing with ID: LH02136
2026-03-27 10:53:51 [auto1.de] INFO: Found listing with ID: PW87460
2026-03-27 10:53:51 [auto1.de] INFO: Found listing with ID: HH84290
2026-03-27 10:53:51 [auto1.de] INFO: Found listing with ID: NY16629
2026-03-27 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY16629%27 HTTP/1.1" 200 None
2026-03-27 10:53:51 [auto1.de] INFO: Scrape type for NY16629: 0
2026-03-27 10:53:51 [auto1.de] INFO: Found listing with ID: DA63905
2026-03-27 10:53:51 [auto1.de] INFO: Found listing with ID: VR30275
2026-03-27 10:53:51 [auto1.de] INFO: Found listing with ID: PZ57242
2026-03-27 10:53:51 [auto1.de] INFO: Found listing with ID: NK94072
2026-03-27 10:53:51 [auto1.de] INFO: Found listing with ID: WW75764
2026-03-27 10:53:51 [auto1.de] INFO: Found listing with ID: UL25580
2026-03-27 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL25580%27 HTTP/1.1" 200 None
2026-03-27 10:53:51 [auto1.de] INFO: Scrape type for UL25580: 0
2026-03-27 10:53:51 [auto1.de] INFO: Found listing with ID: TV25506
2026-03-27 10:53:51 [auto1.de] INFO: Found listing with ID: AK82908
2026-03-27 10:53:51 [auto1.de] INFO: Found listing with ID: EJ87927
2026-03-27 10:53:51 [auto1.de] INFO: Found listing with ID: DN67284
2026-03-27 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN67284%27 HTTP/1.1" 200 None
2026-03-27 10:53:51 [auto1.de] INFO: Scrape type for DN67284: 2
2026-03-27 10:53:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3ff579a-98db-549a-ac20-b29dd6882384 with identifier: DN67284
2026-03-27 10:53:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3ff579a-98db-549a-ac20-b29dd6882384 with scrape type 2
2026-03-27 10:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3ff579a-98db-549a-ac20-b29dd6882384 with scrape type 2
2026-03-27 10:53:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3ff579a-98db-549a-ac20-b29dd6882384, identifier: DN67284
2026-03-27 10:53:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3ff579a-98db-549a-ac20-b29dd6882384 with identifier: DN67284
2026-03-27 10:53:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3ff579a-98db-549a-ac20-b29dd6882384 with identifier: DN67284
2026-03-27 10:53:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3ff579a-98db-549a-ac20-b29dd6882384 with identifier: DN67284 to the API
2026-03-27 10:53:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:53:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:53:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 114,
'expiration_date': '2026-03-27T16:15:26Z',
'fuel_type': 'petrol',
'id': 'b3ff579a-98db-549a-ac20-b29dd6882384',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN67284',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 73241,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-01',
'seller_name': None,
'title': 'Volkswagen Caddy 1.5 TSI',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-03-27 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN67284%27 HTTP/1.1" 200 None
2026-03-27 10:53:51 [auto1.de] INFO: Saving data for DN67284: {'auction_closing_time': 1774628126.0, 'created_time': 1774423849.588449, 'last_price_update_time': 1774608831.484998}
2026-03-27 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN67284') HTTP/1.1" 204 0
2026-03-27 10:53:51 [auto1.de] INFO: Found listing with ID: JP52122
2026-03-27 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP52122%27 HTTP/1.1" 200 None
2026-03-27 10:53:51 [auto1.de] INFO: Scrape type for JP52122: 0
2026-03-27 10:53:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:58 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 10603 | hits on page: 40
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX09216%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for BX09216: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: PF14762
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: EZ01332
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ01332%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for EZ01332: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: HC12239
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC12239%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for HC12239: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: ES78783
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: FY31029
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY31029%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for FY31029: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: FK20948
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK20948%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for FK20948: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: AN16579
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN16579%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for AN16579: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: FU26438
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU26438%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for FU26438: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: ZV14288
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV14288%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for ZV14288: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: WR44415
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR44415%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for WR44415: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: CM46139
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM46139%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for CM46139: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: PK49409
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: AL53534
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: GJ54117
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: JF38647
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF38647%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for JF38647: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: AP70373
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: BK48500
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK48500%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for BK48500: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: YA30730
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA30730%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for YA30730: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: BH90512
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH90512%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for BH90512: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: CL57591
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: UE81207
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: TB55378
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: GG80957
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: LS78763
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: BT59614
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT59614%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for BT59614: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: TC03935
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: TD37503
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: PD00491
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD00491%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for PD00491: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: PA10623
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA10623%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for PA10623: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: RY67208
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: ND85219
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND85219%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for ND85219: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: KS12062
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS12062%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for KS12062: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: UA60453
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: LB61549
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB61549%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for LB61549: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: TY52919
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY52919%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for TY52919: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: GK30038
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: ZS61944
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS61944%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for ZS61944: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: NJ70051
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ70051%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for NJ70051: 0
2026-03-27 10:53:58 [auto1.de] INFO: Found listing with ID: BK00548
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK00548%27 HTTP/1.1" 200 None
2026-03-27 10:53:58 [auto1.de] INFO: Scrape type for BK00548: 0
2026-03-27 10:53:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:01 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 10603 | hits on page: 40
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: PJ28903
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ28903%27 HTTP/1.1" 200 None
2026-03-27 10:54:01 [auto1.de] INFO: Scrape type for PJ28903: 0
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: KJ51588
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: DL48053
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: DZ51927
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ51927%27 HTTP/1.1" 200 None
2026-03-27 10:54:02 [auto1.de] INFO: Scrape type for DZ51927: 0
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: NP48335
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP48335%27 HTTP/1.1" 200 None
2026-03-27 10:54:02 [auto1.de] INFO: Scrape type for NP48335: 0
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: LU87802
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU87802%27 HTTP/1.1" 200 None
2026-03-27 10:54:02 [auto1.de] INFO: Scrape type for LU87802: 0
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD74109%27 HTTP/1.1" 200 None
2026-03-27 10:54:02 [auto1.de] INFO: Scrape type for FD74109: 0
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: SP65010
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP65010%27 HTTP/1.1" 200 None
2026-03-27 10:54:02 [auto1.de] INFO: Scrape type for SP65010: 0
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: BU12505
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU12505%27 HTTP/1.1" 200 None
2026-03-27 10:54:02 [auto1.de] INFO: Scrape type for BU12505: 0
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: SB33889
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: AG20717
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: WU98918
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU98918%27 HTTP/1.1" 200 None
2026-03-27 10:54:02 [auto1.de] INFO: Scrape type for WU98918: 0
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: DY62455
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: VV73959
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV73959%27 HTTP/1.1" 200 None
2026-03-27 10:54:02 [auto1.de] INFO: Scrape type for VV73959: 0
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: NC61383
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: DM27876
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27876%27 HTTP/1.1" 200 None
2026-03-27 10:54:02 [auto1.de] INFO: Scrape type for DM27876: 0
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: PM90514
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: HC41617
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC41617%27 HTTP/1.1" 200 None
2026-03-27 10:54:02 [auto1.de] INFO: Scrape type for HC41617: 0
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: ZX49243
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: FZ35057
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: PC62388
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62388%27 HTTP/1.1" 200 None
2026-03-27 10:54:02 [auto1.de] INFO: Scrape type for PC62388: 0
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: XJ22163
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: BU12170
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: AR53844
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR53844%27 HTTP/1.1" 200 None
2026-03-27 10:54:02 [auto1.de] INFO: Scrape type for AR53844: 0
2026-03-27 10:54:02 [auto1.de] INFO: Found listing with ID: LU32216
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU32216%27 HTTP/1.1" 200 None
2026-03-27 10:54:02 [auto1.de] INFO: Scrape type for LU32216: 2
2026-03-27 10:54:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6442a5ef-56ed-58a7-ae3d-3f03e8d99efd with identifier: LU32216
2026-03-27 10:54:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6442a5ef-56ed-58a7-ae3d-3f03e8d99efd with scrape type 2
2026-03-27 10:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6442a5ef-56ed-58a7-ae3d-3f03e8d99efd with scrape type 2
2026-03-27 10:54:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6442a5ef-56ed-58a7-ae3d-3f03e8d99efd, identifier: LU32216
2026-03-27 10:54:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6442a5ef-56ed-58a7-ae3d-3f03e8d99efd with identifier: LU32216
2026-03-27 10:54:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6442a5ef-56ed-58a7-ae3d-3f03e8d99efd with identifier: LU32216
2026-03-27 10:54:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6442a5ef-56ed-58a7-ae3d-3f03e8d99efd with identifier: LU32216 to the API
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:54:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-27T16:29:37Z',
'fuel_type': 'petrol',
'id': '6442a5ef-56ed-58a7-ae3d-3f03e8d99efd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU32216',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 121559,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-12',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
'transmission': 'manual',
'trim': 'BlueEfficiency Style',
'year': 2017}
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU32216%27 HTTP/1.1" 200 None
2026-03-27 10:54:02 [auto1.de] INFO: Saving data for LU32216: {'auction_closing_time': 1774628977.0, 'created_time': 1773773430.582641, 'last_price_update_time': 1774608842.828415}
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU32216') HTTP/1.1" 204 0
2026-03-27 10:54:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: RK75566
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK75566%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for RK75566: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: EX64798
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: LN75717
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: CL99107
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: BK49695
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK49695%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for BK49695: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: DL52557
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: KV40147
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: SV70858
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV70858%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for SV70858: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: UN52342
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN52342%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for UN52342: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: KV09163
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV09163%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for KV09163: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: NP20797
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: XE20861
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: YF97500
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: RE74937
2026-03-27 10:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:04 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 10604 | hits on page: 40
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: RE74937
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: XX78799
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: WH09433
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH09433%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for WH09433: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: EV87086
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV87086%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for EV87086: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: DD41075
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: WT87490
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT87490%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for WT87490: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: FD74208
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD74208%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for FD74208: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: HR39540
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: JF45279
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: YA96951
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96951%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for YA96951: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: RK34860
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: XS40942
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS40942%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for XS40942: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: VD18185
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: RU45291
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: NG85198
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG85198%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for NG85198: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: SA38471
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: GP74205
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP74205%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for GP74205: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: TK44057
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK44057%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for TK44057: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: NS90051
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: UZ22488
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: AT13824
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT13824%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for AT13824: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: VT96946
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: TX29096
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX29096%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for TX29096: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: YB47144
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB47144%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for YB47144: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: HZ35623
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: FP43907
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP43907%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for FP43907: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: AC62471
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC62471%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for AC62471: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: FC08101
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC08101%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for FC08101: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: KD44846
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD44846%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for KD44846: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: MK52879
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK52879%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for MK52879: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: XF35654
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: EM09093
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: CP28896
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP28896%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for CP28896: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: JD16678
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD16678%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for JD16678: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: VG95526
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: TW48266
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: LL62028
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL62028%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for LL62028: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: AT18561
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT18561%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for AT18561: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: KU60138
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU60138%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for KU60138: 0
2026-03-27 10:54:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:06 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 10604 | hits on page: 40
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: PB12749
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB12749%27 HTTP/1.1" 200 None
2026-03-27 10:54:06 [auto1.de] INFO: Scrape type for PB12749: 0
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: AG44550
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: DY53680
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: LP42404
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: BJ65767
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ65767%27 HTTP/1.1" 200 None
2026-03-27 10:54:06 [auto1.de] INFO: Scrape type for BJ65767: 0
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: AX52249
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX52249%27 HTTP/1.1" 200 None
2026-03-27 10:54:06 [auto1.de] INFO: Scrape type for AX52249: 0
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: JM14799
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: XE13119
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: SH94739
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH94739%27 HTTP/1.1" 200 None
2026-03-27 10:54:06 [auto1.de] INFO: Scrape type for SH94739: 0
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: RZ65813
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: RE36292
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE36292%27 HTTP/1.1" 200 None
2026-03-27 10:54:06 [auto1.de] INFO: Scrape type for RE36292: 0
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: YJ74621
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: FT98608
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: GB35925
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB35925%27 HTTP/1.1" 200 None
2026-03-27 10:54:06 [auto1.de] INFO: Scrape type for GB35925: 0
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: GB55666
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB55666%27 HTTP/1.1" 200 None
2026-03-27 10:54:06 [auto1.de] INFO: Scrape type for GB55666: 0
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC55438%27 HTTP/1.1" 200 None
2026-03-27 10:54:06 [auto1.de] INFO: Scrape type for CC55438: 0
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: VL85345
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL85345%27 HTTP/1.1" 200 None
2026-03-27 10:54:06 [auto1.de] INFO: Scrape type for VL85345: 0
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: HH32152
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: AK97541
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK97541%27 HTTP/1.1" 200 None
2026-03-27 10:54:06 [auto1.de] INFO: Scrape type for AK97541: 0
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: CW48443
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: MY93423
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: BT88026
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: BT20350
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT20350%27 HTTP/1.1" 200 None
2026-03-27 10:54:06 [auto1.de] INFO: Scrape type for BT20350: 0
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: WA51646
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: SC80674
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: DD14977
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD14977%27 HTTP/1.1" 200 None
2026-03-27 10:54:06 [auto1.de] INFO: Scrape type for DD14977: 0
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: VK27516
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: NZ42181
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ42181%27 HTTP/1.1" 200 None
2026-03-27 10:54:06 [auto1.de] INFO: Scrape type for NZ42181: 0
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: LC00841
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: LH00123
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH00123%27 HTTP/1.1" 200 None
2026-03-27 10:54:06 [auto1.de] INFO: Scrape type for LH00123: 0
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: KW20728
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW20728%27 HTTP/1.1" 200 None
2026-03-27 10:54:06 [auto1.de] INFO: Scrape type for KW20728: 0
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: VN84329
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN84329%27 HTTP/1.1" 200 None
2026-03-27 10:54:06 [auto1.de] INFO: Scrape type for VN84329: 0
2026-03-27 10:54:06 [auto1.de] INFO: Found listing with ID: DD79201
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD79201%27 HTTP/1.1" 200 None
2026-03-27 10:54:06 [auto1.de] INFO: Scrape type for DD79201: 2
2026-03-27 10:54:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa0cb9e9-3745-5a9f-9241-4a6cca8314da with identifier: DD79201
2026-03-27 10:54:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa0cb9e9-3745-5a9f-9241-4a6cca8314da with scrape type 2
2026-03-27 10:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa0cb9e9-3745-5a9f-9241-4a6cca8314da with scrape type 2
2026-03-27 10:54:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa0cb9e9-3745-5a9f-9241-4a6cca8314da, identifier: DD79201
2026-03-27 10:54:07 [scrapy.extensions.logstats] INFO: Crawled 525 pages (at 25 pages/min), scraped 944 items (at 6 items/min)
2026-03-27 10:54:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-27 10:54:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa0cb9e9-3745-5a9f-9241-4a6cca8314da with identifier: DD79201
2026-03-27 10:54:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa0cb9e9-3745-5a9f-9241-4a6cca8314da with identifier: DD79201
2026-03-27 10:54:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa0cb9e9-3745-5a9f-9241-4a6cca8314da with identifier: DD79201 to the API
2026-03-27 10:54:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:54:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:54:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 105,
'expiration_date': '2026-03-27T16:14:10Z',
'fuel_type': 'petrol',
'id': 'fa0cb9e9-3745-5a9f-9241-4a6cca8314da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD79201',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 126114,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-09',
'seller_name': None,
'title': 'Volkswagen Beetle 1.2 TSI Design',
'transmission': 'automatic',
'trim': 'Design',
'year': 2013}
2026-03-27 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD79201%27 HTTP/1.1" 200 None
2026-03-27 10:54:07 [auto1.de] INFO: Saving data for DD79201: {'auction_closing_time': 1774628050.0, 'created_time': 1773344286.513151, 'last_price_update_time': 1774608847.619363}
2026-03-27 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD79201') HTTP/1.1" 204 0
2026-03-27 10:54:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:07 [auto1.de] INFO: Found listing with ID: HU68643
2026-03-27 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU68643%27 HTTP/1.1" 200 None
2026-03-27 10:54:07 [auto1.de] INFO: Scrape type for HU68643: 0
2026-03-27 10:54:07 [auto1.de] INFO: Found listing with ID: RE71424
2026-03-27 10:54:07 [auto1.de] INFO: Found listing with ID: DK90123
2026-03-27 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK90123%27 HTTP/1.1" 200 None
2026-03-27 10:54:07 [auto1.de] INFO: Scrape type for DK90123: 0
2026-03-27 10:54:07 [auto1.de] INFO: Found listing with ID: EG83317
2026-03-27 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG83317%27 HTTP/1.1" 200 None
2026-03-27 10:54:07 [auto1.de] INFO: Scrape type for EG83317: 0
2026-03-27 10:54:07 [auto1.de] INFO: Found listing with ID: SU75801
2026-03-27 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU75801%27 HTTP/1.1" 200 None
2026-03-27 10:54:07 [auto1.de] INFO: Scrape type for SU75801: 0
2026-03-27 10:54:07 [auto1.de] INFO: Found listing with ID: LN37721
2026-03-27 10:54:07 [auto1.de] INFO: Found listing with ID: WD13175
2026-03-27 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD13175%27 HTTP/1.1" 200 None
2026-03-27 10:54:07 [auto1.de] INFO: Scrape type for WD13175: 0
2026-03-27 10:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:14 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 10605 | hits on page: 40
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: WD13175
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD13175%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for WD13175: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: PB92284
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: AS97650
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: RJ65711
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: VZ49069
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ49069%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for VZ49069: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: HH26503
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH26503%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for HH26503: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: VZ69122
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: RR06501
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR06501%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for RR06501: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: GG32216
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG32216%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for GG32216: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: UA55919
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA55919%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for UA55919: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: XK43796
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK43796%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for XK43796: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: AU05759
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU05759%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for AU05759: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: JD69388
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD69388%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for JD69388: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: UC51546
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC51546%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for UC51546: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: SU13954
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU13954%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for SU13954: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: FM20316
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM20316%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for FM20316: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: EC94378
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: PW66424
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW66424%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for PW66424: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: YH29601
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: HZ87755
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ87755%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for HZ87755: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: BN35753
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN35753%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for BN35753: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: UF14922
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: FK98108
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK98108%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for FK98108: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: YF69717
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: BG27502
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27502%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for BG27502: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: PR73222
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR73222%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for PR73222: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: GN12649
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: RE00725
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: KD88399
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD88399%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for KD88399: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: LZ81605
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ81605%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for LZ81605: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: ND37325
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND37325%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for ND37325: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: JE85586
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: KX87155
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: GM22494
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM22494%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for GM22494: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: ZR68100
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR68100%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for ZR68100: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: JH57349
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH57349%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for JH57349: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: VD54257
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW05751%27 HTTP/1.1" 200 None
2026-03-27 10:54:14 [auto1.de] INFO: Scrape type for BW05751: 0
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: PC47475
2026-03-27 10:54:14 [auto1.de] INFO: Found listing with ID: PL37483
2026-03-27 10:54:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:18 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 10605 | hits on page: 40
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: RV72867
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV72867%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for RV72867: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: JY16460
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY16460%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for JY16460: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: MG02873
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: JM29526
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: JG98331
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG98331%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for JG98331: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: EP32297
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP32297%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for EP32297: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: JB42175
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: CH37782
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH37782%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for CH37782: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: VJ14955
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: LJ09333
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ09333%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for LJ09333: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: BF84298
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF84298%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for BF84298: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB95370%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for JB95370: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: GX87864
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: WJ35456
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: VL69924
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: HE16433
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: KG91640
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG91640%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for KG91640: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: DH73043
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH73043%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for DH73043: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: ZZ68403
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ68403%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for ZZ68403: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: DP90714
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: JL65516
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL65516%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for JL65516: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: BE73867
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE73867%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for BE73867: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: KD35022
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: NR70794
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: BY78150
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: ZA57423
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA57423%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for ZA57423: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: SC80606
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC80606%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for SC80606: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: XS81054
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS81054%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for XS81054: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: YX52841
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: CY91689
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY91689%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for CY91689: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: PT76912
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT76912%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for PT76912: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: LC41774
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: RS00302
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: FL70928
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: VF90818
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: GT42047
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT42047%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for GT42047: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: UA27287
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: RU06451
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU06451%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for RU06451: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: YN95671
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN95671%27 HTTP/1.1" 200 None
2026-03-27 10:54:18 [auto1.de] INFO: Scrape type for YN95671: 0
2026-03-27 10:54:18 [auto1.de] INFO: Found listing with ID: EK46666
2026-03-27 10:54:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:36 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 10605 | hits on page: 40
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: MK42970
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: FF38346
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF38346%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for FF38346: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: MS10711
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS10711%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for MS10711: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: XW43121
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: CB59188
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: VY77073
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: GB55517
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB55517%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for GB55517: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: MA84823
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA84823%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for MA84823: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: GZ46428
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ46428%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for GZ46428: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: ZH47187
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: RE05344
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE05344%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for RE05344: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: PV96474
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: ZG66499
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG66499%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for ZG66499: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: YR12178
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR12178%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for YR12178: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX04560%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for RX04560: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: PW87912
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: LE88532
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: EZ76361
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: UM54862
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: LM54060
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM54060%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for LM54060: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: GX57450
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: UC69607
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: UZ16181
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ16181%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for UZ16181: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: CM85827
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: HX61505
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX61505%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for HX61505: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: PF96796
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF96796%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for PF96796: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: FA28026
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA28026%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for FA28026: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: SY54244
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY54244%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for SY54244: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: FC56838
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC56838%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for FC56838: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: NZ09394
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ09394%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for NZ09394: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: GU26871
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU26871%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for GU26871: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: UD44631
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD44631%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for UD44631: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: VX61126
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: NT47334
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: XS36937
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: NF06054
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: VS61751
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: RL57383
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL57383%27 HTTP/1.1" 200 None
2026-03-27 10:54:36 [auto1.de] INFO: Scrape type for RL57383: 0
2026-03-27 10:54:36 [auto1.de] INFO: Found listing with ID: XX53475
2026-03-27 10:54:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:37 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 10605 | hits on page: 40
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: LU87387
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU87387%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for LU87387: 0
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: AY28505
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY28505%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for AY28505: 0
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: CZ93275
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: JT12808
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT12808%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for JT12808: 0
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: AJ15335
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: UM96054
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: CN59781
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN59781%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for CN59781: 0
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: PS78942
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS78942%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for PS78942: 0
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: RE90038
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: JA70507
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA70507%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for JA70507: 0
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: UV70266
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: PS89246
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS89246%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for PS89246: 0
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: DS45291
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS45291%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for DS45291: 0
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: YT32498
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: JE14755
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: PM11705
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM11705%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for PM11705: 0
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: MV92470
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: BU11433
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: NY36854
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY36854%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for NY36854: 0
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: JL60461
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: MC21805
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: TL05421
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL05421%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for TL05421: 0
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: DF27439
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF27439%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for DF27439: 0
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: PU73316
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: HM05656
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: XL28930
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: KN88175
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN88175%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for KN88175: 0
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: AB82349
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: AR85090
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR85090%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for AR85090: 0
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: SK99128
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: RC95645
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: ZP84126
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: ZZ70410
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ70410%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for ZZ70410: 0
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: KP50687
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP50687%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for KP50687: 0
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: XS50208
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: VF88904
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF88904%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for VF88904: 0
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: VF10193
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF10193%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for VF10193: 0
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: SF44435
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: WP06272
2026-03-27 10:54:37 [auto1.de] INFO: Found listing with ID: JX30335
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX30335%27 HTTP/1.1" 200 None
2026-03-27 10:54:37 [auto1.de] INFO: Scrape type for JX30335: 0
2026-03-27 10:54:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:38 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 10605 | hits on page: 40
2026-03-27 10:54:38 [auto1.de] INFO: Found listing with ID: NY47734
2026-03-27 10:54:38 [auto1.de] INFO: Found listing with ID: LZ19661
2026-03-27 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ19661%27 HTTP/1.1" 200 None
2026-03-27 10:54:38 [auto1.de] INFO: Scrape type for LZ19661: 0
2026-03-27 10:54:38 [auto1.de] INFO: Found listing with ID: WS21373
2026-03-27 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS21373%27 HTTP/1.1" 200 None
2026-03-27 10:54:38 [auto1.de] INFO: Scrape type for WS21373: 0
2026-03-27 10:54:38 [auto1.de] INFO: Found listing with ID: NR20309
2026-03-27 10:54:38 [auto1.de] INFO: Found listing with ID: DN95746
2026-03-27 10:54:38 [auto1.de] INFO: Found listing with ID: MR37320
2026-03-27 10:54:38 [auto1.de] INFO: Found listing with ID: XR37747
2026-03-27 10:54:38 [auto1.de] INFO: Found listing with ID: JJ18730
2026-03-27 10:54:38 [auto1.de] INFO: Found listing with ID: SV49639
2026-03-27 10:54:38 [auto1.de] INFO: Found listing with ID: MS15340
2026-03-27 10:54:38 [auto1.de] INFO: Found listing with ID: HB05476
2026-03-27 10:54:38 [auto1.de] INFO: Found listing with ID: JM96313
2026-03-27 10:54:38 [auto1.de] INFO: Found listing with ID: KJ27126
2026-03-27 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ27126%27 HTTP/1.1" 200 None
2026-03-27 10:54:38 [auto1.de] INFO: Scrape type for KJ27126: 2
2026-03-27 10:54:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 502d316f-dc25-5bdc-abbd-8f0feff640da with identifier: KJ27126
2026-03-27 10:54:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 502d316f-dc25-5bdc-abbd-8f0feff640da with scrape type 2
2026-03-27 10:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 502d316f-dc25-5bdc-abbd-8f0feff640da with scrape type 2
2026-03-27 10:54:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 502d316f-dc25-5bdc-abbd-8f0feff640da, identifier: KJ27126
2026-03-27 10:54:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 502d316f-dc25-5bdc-abbd-8f0feff640da with identifier: KJ27126
2026-03-27 10:54:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 502d316f-dc25-5bdc-abbd-8f0feff640da with identifier: KJ27126
2026-03-27 10:54:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 502d316f-dc25-5bdc-abbd-8f0feff640da with identifier: KJ27126 to the API
2026-03-27 10:54:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:54:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-27T16:36:53Z',
'fuel_type': 'petrol',
'id': '502d316f-dc25-5bdc-abbd-8f0feff640da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ27126',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 42586,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-18',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.5 TSI ACT Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2021}
2026-03-27 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ27126%27 HTTP/1.1" 200 None
2026-03-27 10:54:39 [auto1.de] INFO: Saving data for KJ27126: {'auction_closing_time': 1774629413.0, 'created_time': 1773385535.633309, 'last_price_update_time': 1774608879.788133}
2026-03-27 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ27126') HTTP/1.1" 204 0
2026-03-27 10:54:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:39 [auto1.de] INFO: Found listing with ID: EX39495
2026-03-27 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX39495%27 HTTP/1.1" 200 None
2026-03-27 10:54:39 [auto1.de] INFO: Scrape type for EX39495: 0
2026-03-27 10:54:39 [auto1.de] INFO: Found listing with ID: WR22738
2026-03-27 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR22738%27 HTTP/1.1" 200 None
2026-03-27 10:54:39 [auto1.de] INFO: Scrape type for WR22738: 0
2026-03-27 10:54:39 [auto1.de] INFO: Found listing with ID: CC88338
2026-03-27 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC88338%27 HTTP/1.1" 200 None
2026-03-27 10:54:39 [auto1.de] INFO: Scrape type for CC88338: 0
2026-03-27 10:54:39 [auto1.de] INFO: Found listing with ID: EG60860
2026-03-27 10:54:39 [auto1.de] INFO: Found listing with ID: BK74871
2026-03-27 10:54:39 [auto1.de] INFO: Found listing with ID: XM71416
2026-03-27 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM71416%27 HTTP/1.1" 200 None
2026-03-27 10:54:39 [auto1.de] INFO: Scrape type for XM71416: 0
2026-03-27 10:54:39 [auto1.de] INFO: Found listing with ID: DB12378
2026-03-27 10:54:39 [auto1.de] INFO: Found listing with ID: ZE00456
2026-03-27 10:54:39 [auto1.de] INFO: Found listing with ID: ZT91138
2026-03-27 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT91138%27 HTTP/1.1" 200 None
2026-03-27 10:54:39 [auto1.de] INFO: Scrape type for ZT91138: 0
2026-03-27 10:54:39 [auto1.de] INFO: Found listing with ID: TP52390
2026-03-27 10:54:39 [auto1.de] INFO: Found listing with ID: SZ88186
2026-03-27 10:54:39 [auto1.de] INFO: Found listing with ID: SA11397
2026-03-27 10:54:39 [auto1.de] INFO: Found listing with ID: KS00518
2026-03-27 10:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS00518%27 HTTP/1.1" 200 None
2026-03-27 10:54:40 [auto1.de] INFO: Scrape type for KS00518: 0
2026-03-27 10:54:40 [auto1.de] INFO: Found listing with ID: YL84618
2026-03-27 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL84618%27 HTTP/1.1" 200 None
2026-03-27 10:54:40 [auto1.de] INFO: Scrape type for YL84618: 0
2026-03-27 10:54:40 [auto1.de] INFO: Found listing with ID: PU96006
2026-03-27 10:54:40 [auto1.de] INFO: Found listing with ID: FJ76970
2026-03-27 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ76970%27 HTTP/1.1" 200 None
2026-03-27 10:54:40 [auto1.de] INFO: Scrape type for FJ76970: 0
2026-03-27 10:54:40 [auto1.de] INFO: Found listing with ID: VA46995
2026-03-27 10:54:40 [auto1.de] INFO: Found listing with ID: WX92371
2026-03-27 10:54:40 [auto1.de] INFO: Found listing with ID: DK15420
2026-03-27 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK15420%27 HTTP/1.1" 200 None
2026-03-27 10:54:40 [auto1.de] INFO: Scrape type for DK15420: 0
2026-03-27 10:54:40 [auto1.de] INFO: Found listing with ID: XS27147
2026-03-27 10:54:40 [auto1.de] INFO: Found listing with ID: NA81558
2026-03-27 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA81558%27 HTTP/1.1" 200 None
2026-03-27 10:54:40 [auto1.de] INFO: Scrape type for NA81558: 0
2026-03-27 10:54:40 [auto1.de] INFO: Found listing with ID: MM77489
2026-03-27 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM77489%27 HTTP/1.1" 200 None
2026-03-27 10:54:40 [auto1.de] INFO: Scrape type for MM77489: 0
2026-03-27 10:54:40 [auto1.de] INFO: Found listing with ID: PR94578
2026-03-27 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR94578%27 HTTP/1.1" 200 None
2026-03-27 10:54:40 [auto1.de] INFO: Scrape type for PR94578: 0
2026-03-27 10:54:40 [auto1.de] INFO: Found listing with ID: KC00860
2026-03-27 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC00860%27 HTTP/1.1" 200 None
2026-03-27 10:54:40 [auto1.de] INFO: Scrape type for KC00860: 0
2026-03-27 10:54:40 [auto1.de] INFO: Found listing with ID: RX19676
2026-03-27 10:54:40 [auto1.de] INFO: Found listing with ID: NF69216
2026-03-27 10:54:40 [auto1.de] INFO: Found listing with ID: CS82090
2026-03-27 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS82090%27 HTTP/1.1" 200 None
2026-03-27 10:54:40 [auto1.de] INFO: Scrape type for CS82090: 0
2026-03-27 10:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:44 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 10606 | hits on page: 40
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: CS82090
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS82090%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for CS82090: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: SK62932
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: RB55254
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB55254%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for RB55254: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: UH59685
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: LS81640
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: YY00170
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: PP35153
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: YG60561
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG60561%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for YG60561: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: YZ28815
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: FD13282
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: CU35296
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: NU87000
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU87000%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for NU87000: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK88230%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for GK88230: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: YX39486
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: ZU12280
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: YR13244
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR13244%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for YR13244: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14864%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for JT14864: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: CB42474
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB42474%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for CB42474: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: KP08574
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP08574%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for KP08574: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: TJ08431
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ08431%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for TJ08431: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: DL48307
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL48307%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for DL48307: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: RC52936
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: AJ11776
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ11776%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for AJ11776: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: JA02894
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA02894%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for JA02894: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: LX10413
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: NV66174
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV66174%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for NV66174: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: WG53526
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG53526%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for WG53526: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: MF78675
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: XS65767
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS65767%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for XS65767: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: FN83221
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: DB02068
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB02068%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for DB02068: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: JM94296
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM94296%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for JM94296: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: DD53443
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD53443%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for DD53443: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: EL20809
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL20809%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for EL20809: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: VR19710
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: KT16474
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: SR67538
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR67538%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for SR67538: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: WY54467
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: MN64369
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN64369%27 HTTP/1.1" 200 None
2026-03-27 10:54:44 [auto1.de] INFO: Scrape type for MN64369: 0
2026-03-27 10:54:44 [auto1.de] INFO: Found listing with ID: JG22521
2026-03-27 10:54:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:49 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 10606 | hits on page: 40
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: CW02492
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: KA78171
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA78171%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for KA78171: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: UZ60931
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ60931%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for UZ60931: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: FB23073
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB23073%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for FB23073: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: MK13186
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK13186%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for MK13186: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: KH64272
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: YF88736
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: JT25631
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT25631%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for JT25631: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: TC09665
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: YE38551
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE38551%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for YE38551: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: AC78646
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: SV38598
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV38598%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for SV38598: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: DT00140
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: DV44550
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV44550%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for DV44550: 2
2026-03-27 10:54:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e8f348b-991d-56ec-b3d7-78c3f62b6472 with identifier: DV44550
2026-03-27 10:54:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e8f348b-991d-56ec-b3d7-78c3f62b6472 with scrape type 2
2026-03-27 10:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e8f348b-991d-56ec-b3d7-78c3f62b6472 with scrape type 2
2026-03-27 10:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e8f348b-991d-56ec-b3d7-78c3f62b6472, identifier: DV44550
2026-03-27 10:54:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e8f348b-991d-56ec-b3d7-78c3f62b6472 with identifier: DV44550
2026-03-27 10:54:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e8f348b-991d-56ec-b3d7-78c3f62b6472 with identifier: DV44550
2026-03-27 10:54:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e8f348b-991d-56ec-b3d7-78c3f62b6472 with identifier: DV44550 to the API
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:54:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-27T16:59:57Z',
'fuel_type': 'diesel',
'id': '7e8f348b-991d-56ec-b3d7-78c3f62b6472',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV44550',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 111987,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-14',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d 4Matic Progressive',
'transmission': 'automatic',
'trim': '4Matic Progressive',
'year': 2021}
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV44550%27 HTTP/1.1" 200 None
2026-03-27 10:54:50 [auto1.de] INFO: Saving data for DV44550: {'auction_closing_time': 1774630797.0, 'created_time': 1774467208.899292, 'last_price_update_time': 1774608890.49411}
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV44550') HTTP/1.1" 204 0
2026-03-27 10:54:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: LS45558
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: XW98427
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: NF90345
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF90345%27 HTTP/1.1" 200 None
2026-03-27 10:54:50 [auto1.de] INFO: Scrape type for NF90345: 0
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: PA05830
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: VK81470
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: VH72276
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH72276%27 HTTP/1.1" 200 None
2026-03-27 10:54:50 [auto1.de] INFO: Scrape type for VH72276: 0
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: SS34696
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS34696%27 HTTP/1.1" 200 None
2026-03-27 10:54:50 [auto1.de] INFO: Scrape type for SS34696: 0
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: GN50341
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN50341%27 HTTP/1.1" 200 None
2026-03-27 10:54:50 [auto1.de] INFO: Scrape type for GN50341: 0
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: HF95625
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: RP15985
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15985%27 HTTP/1.1" 200 None
2026-03-27 10:54:50 [auto1.de] INFO: Scrape type for RP15985: 0
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: EY50037
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY50037%27 HTTP/1.1" 200 None
2026-03-27 10:54:50 [auto1.de] INFO: Scrape type for EY50037: 0
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: GW73936
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW73936%27 HTTP/1.1" 200 None
2026-03-27 10:54:50 [auto1.de] INFO: Scrape type for GW73936: 0
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: UA31862
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA31862%27 HTTP/1.1" 200 None
2026-03-27 10:54:50 [auto1.de] INFO: Scrape type for UA31862: 0
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: TP35873
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP35873%27 HTTP/1.1" 200 None
2026-03-27 10:54:50 [auto1.de] INFO: Scrape type for TP35873: 0
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: YP80343
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP80343%27 HTTP/1.1" 200 None
2026-03-27 10:54:50 [auto1.de] INFO: Scrape type for YP80343: 0
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: DT65148
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: GR50767
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: XU78449
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: PB88478
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB88478%27 HTTP/1.1" 200 None
2026-03-27 10:54:50 [auto1.de] INFO: Scrape type for PB88478: 0
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: EW51447
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: UE74557
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: XX87217
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX87217%27 HTTP/1.1" 200 None
2026-03-27 10:54:50 [auto1.de] INFO: Scrape type for XX87217: 0
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: TL28504
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL28504%27 HTTP/1.1" 200 None
2026-03-27 10:54:50 [auto1.de] INFO: Scrape type for TL28504: 0
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: WA53567
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA53567%27 HTTP/1.1" 200 None
2026-03-27 10:54:50 [auto1.de] INFO: Scrape type for WA53567: 0
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: YX71503
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX71503%27 HTTP/1.1" 200 None
2026-03-27 10:54:50 [auto1.de] INFO: Scrape type for YX71503: 0
2026-03-27 10:54:50 [auto1.de] INFO: Found listing with ID: TH64703
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH64703%27 HTTP/1.1" 200 None
2026-03-27 10:54:50 [auto1.de] INFO: Scrape type for TH64703: 0
2026-03-27 10:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:56 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 10606 | hits on page: 40
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: CW94912
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: PH91659
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: DL11207
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: US98158
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US98158%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for US98158: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: ZS42490
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: KS95343
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS95343%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for KS95343: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: DS13004
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: YG64486
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: DM43280
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM43280%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for DM43280: 2
2026-03-27 10:54:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4db2785-491d-542c-aa80-63a32bf58d8b with identifier: DM43280
2026-03-27 10:54:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4db2785-491d-542c-aa80-63a32bf58d8b with scrape type 2
2026-03-27 10:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4db2785-491d-542c-aa80-63a32bf58d8b with scrape type 2
2026-03-27 10:54:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4db2785-491d-542c-aa80-63a32bf58d8b, identifier: DM43280
2026-03-27 10:54:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4db2785-491d-542c-aa80-63a32bf58d8b with identifier: DM43280
2026-03-27 10:54:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4db2785-491d-542c-aa80-63a32bf58d8b with identifier: DM43280
2026-03-27 10:54:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4db2785-491d-542c-aa80-63a32bf58d8b with identifier: DM43280 to the API
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 195,
'expiration_date': '2026-03-27T16:13:58Z',
'fuel_type': 'diesel',
'id': 'c4db2785-491d-542c-aa80-63a32bf58d8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM43280',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 149070,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-05',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 d T 4Matic Avantgarde',
'transmission': 'automatic',
'trim': 'T 4Matic Avantgarde',
'year': 2017}
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM43280%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Saving data for DM43280: {'auction_closing_time': 1774628038.0, 'created_time': 1774423845.465519, 'last_price_update_time': 1774608897.27463}
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM43280') HTTP/1.1" 204 0
2026-03-27 10:54:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: AK65293
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK65293%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for AK65293: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: VM29679
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: KS45394
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: CE06320
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE06320%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for CE06320: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: ZR46884
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR46884%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for ZR46884: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: ZS46534
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS46534%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for ZS46534: 2
2026-03-27 10:54:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9d6c682-0d4b-56ef-882d-5fb3bde75003 with identifier: ZS46534
2026-03-27 10:54:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9d6c682-0d4b-56ef-882d-5fb3bde75003 with scrape type 2
2026-03-27 10:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9d6c682-0d4b-56ef-882d-5fb3bde75003 with scrape type 2
2026-03-27 10:54:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9d6c682-0d4b-56ef-882d-5fb3bde75003, identifier: ZS46534
2026-03-27 10:54:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9d6c682-0d4b-56ef-882d-5fb3bde75003 with identifier: ZS46534
2026-03-27 10:54:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9d6c682-0d4b-56ef-882d-5fb3bde75003 with identifier: ZS46534
2026-03-27 10:54:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9d6c682-0d4b-56ef-882d-5fb3bde75003 with identifier: ZS46534 to the API
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-27T16:44:58Z',
'fuel_type': 'diesel',
'id': 'c9d6c682-0d4b-56ef-882d-5fb3bde75003',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS46534',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 99747,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-29',
'seller_name': None,
'title': 'Jeep Renegade 2.0 M-Jet Limited 4WD',
'transmission': 'manual',
'trim': 'Limited 4WD',
'year': 2014}
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS46534%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Saving data for ZS46534: {'auction_closing_time': 1774629898.0, 'created_time': 1773662048.185123, 'last_price_update_time': 1774608897.870053}
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS46534') HTTP/1.1" 204 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: VM56295
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM56295%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for VM56295: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: VN30253
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: CW66270
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: MK76692
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: EL87499
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: NR21254
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR21254%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for NR21254: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: NA57032
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: XE21854
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: ZH66047
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: SM94755
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM94755%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for SM94755: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: DD19418
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD19418%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for DD19418: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: GR07934
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR07934%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for GR07934: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: WP16305
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: KA83204
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83204%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for KA83204: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: LV57105
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV57105%27 HTTP/1.1" 200 None
2026-03-27 10:54:58 [auto1.de] INFO: Scrape type for LV57105: 0
2026-03-27 10:54:58 [auto1.de] INFO: Found listing with ID: PC47555
2026-03-27 10:54:58 [auto1.de] INFO: Found listing with ID: UD83708
2026-03-27 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD83708%27 HTTP/1.1" 200 None
2026-03-27 10:54:58 [auto1.de] INFO: Scrape type for UD83708: 0
2026-03-27 10:54:58 [auto1.de] INFO: Found listing with ID: FW71930
2026-03-27 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW71930%27 HTTP/1.1" 200 None
2026-03-27 10:54:58 [auto1.de] INFO: Scrape type for FW71930: 0
2026-03-27 10:54:58 [auto1.de] INFO: Found listing with ID: CA15258
2026-03-27 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA15258%27 HTTP/1.1" 200 None
2026-03-27 10:54:58 [auto1.de] INFO: Scrape type for CA15258: 0
2026-03-27 10:54:58 [auto1.de] INFO: Found listing with ID: VW00524
2026-03-27 10:54:58 [auto1.de] INFO: Found listing with ID: GV92310
2026-03-27 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV92310%27 HTTP/1.1" 200 None
2026-03-27 10:54:58 [auto1.de] INFO: Scrape type for GV92310: 0
2026-03-27 10:54:58 [auto1.de] INFO: Found listing with ID: TA71788
2026-03-27 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA71788%27 HTTP/1.1" 200 None
2026-03-27 10:54:58 [auto1.de] INFO: Scrape type for TA71788: 0
2026-03-27 10:54:58 [auto1.de] INFO: Found listing with ID: MC82373
2026-03-27 10:54:58 [auto1.de] INFO: Found listing with ID: RT14045
2026-03-27 10:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:59 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 10606 | hits on page: 40
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: GF01666
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF01666%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for GF01666: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: CE24177
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: PZ06712
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: BK75790
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: TX55902
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: TS84249
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: VT28358
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT28358%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for VT28358: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: US56828
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US56828%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for US56828: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: LU81393
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: CE41474
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: GT13246
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: MH30608
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH30608%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for MH30608: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: RC77177
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC77177%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for RC77177: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ52204%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for NJ52204: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: EM89370
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM89370%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for EM89370: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: NY37542
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY37542%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for NY37542: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: MY00361
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: UR23354
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR23354%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for UR23354: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: DT51004
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT51004%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for DT51004: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: YD09450
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: CR93470
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR93470%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for CR93470: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: PH74270
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: WM78978
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM78978%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for WM78978: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: LC82989
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC82989%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for LC82989: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: PV10962
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV10962%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for PV10962: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: EV18023
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV18023%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for EV18023: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: TW00393
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: NN10939
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: PN06461
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: GE10648
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE10648%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for GE10648: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: TD10276
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: GR79404
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR79404%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for GR79404: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: XZ84287
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ84287%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for XZ84287: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: VZ80726
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: KZ96576
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: AD32766
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD32766%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for AD32766: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: SN64642
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN64642%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for SN64642: 0
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: WV67912
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: VG94776
2026-03-27 10:54:59 [auto1.de] INFO: Found listing with ID: KY82766
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY82766%27 HTTP/1.1" 200 None
2026-03-27 10:54:59 [auto1.de] INFO: Scrape type for KY82766: 0
2026-03-27 10:54:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:00 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 10606 | hits on page: 40
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: VK17893
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK17893%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for VK17893: 0
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: DV49614
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: TW50865
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: UN09381
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN09381%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for UN09381: 0
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: VA23337
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA23337%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for VA23337: 0
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: ZG92530
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG92530%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for ZG92530: 0
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: LS15583
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS15583%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for LS15583: 0
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: UF86507
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: BM71069
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: BY18801
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: BR45216
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR45216%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for BR45216: 0
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: NF90581
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: KZ90725
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ90725%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for KZ90725: 0
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: LY07442
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY07442%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for LY07442: 0
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: WB03440
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB03440%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for WB03440: 0
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: TM84077
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: BF71090
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: GV75599
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: SS53525
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: EV57019
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: CP51565
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: PP60696
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP60696%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for PP60696: 0
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: FJ72421
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ72421%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for FJ72421: 0
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: JP07657
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: ZF52516
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: AM57263
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM57263%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for AM57263: 0
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: MU42832
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: JD92059
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD92059%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for JD92059: 0
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: MC27583
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC27583%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for MC27583: 0
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: UE20946
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE20946%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for UE20946: 0
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: UY94864
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: FF65657
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF65657%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for FF65657: 0
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: WB38416
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: ZV97129
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: RC71799
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: PC11757
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC11757%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for PC11757: 0
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: WC34570
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC34570%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for WC34570: 0
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: CN81534
2026-03-27 10:55:00 [auto1.de] INFO: Found listing with ID: DM53620
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM53620%27 HTTP/1.1" 200 None
2026-03-27 10:55:00 [auto1.de] INFO: Scrape type for DM53620: 0
2026-03-27 10:55:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:02 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 10606 | hits on page: 40
2026-03-27 10:55:02 [auto1.de] INFO: Found listing with ID: CJ47476
2026-03-27 10:55:02 [auto1.de] INFO: Found listing with ID: NB19149
2026-03-27 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB19149%27 HTTP/1.1" 200 None
2026-03-27 10:55:02 [auto1.de] INFO: Scrape type for NB19149: 0
2026-03-27 10:55:02 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-27 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND35935%27 HTTP/1.1" 200 None
2026-03-27 10:55:02 [auto1.de] INFO: Scrape type for ND35935: 0
2026-03-27 10:55:02 [auto1.de] INFO: Found listing with ID: KE96769
2026-03-27 10:55:02 [auto1.de] INFO: Found listing with ID: ST36704
2026-03-27 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST36704%27 HTTP/1.1" 200 None
2026-03-27 10:55:02 [auto1.de] INFO: Scrape type for ST36704: 0
2026-03-27 10:55:02 [auto1.de] INFO: Found listing with ID: GD20981
2026-03-27 10:55:02 [auto1.de] INFO: Found listing with ID: KS49041
2026-03-27 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS49041%27 HTTP/1.1" 200 None
2026-03-27 10:55:02 [auto1.de] INFO: Scrape type for KS49041: 0
2026-03-27 10:55:02 [auto1.de] INFO: Found listing with ID: GY36191
2026-03-27 10:55:02 [auto1.de] INFO: Found listing with ID: AX98840
2026-03-27 10:55:02 [auto1.de] INFO: Found listing with ID: GH09079
2026-03-27 10:55:02 [auto1.de] INFO: Found listing with ID: WL01890
2026-03-27 10:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL01890%27 HTTP/1.1" 200 None
2026-03-27 10:55:03 [auto1.de] INFO: Scrape type for WL01890: 0
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: FH24252
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH24252%27 HTTP/1.1" 200 None
2026-03-27 10:55:03 [auto1.de] INFO: Scrape type for FH24252: 0
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: CV90861
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV90861%27 HTTP/1.1" 200 None
2026-03-27 10:55:03 [auto1.de] INFO: Scrape type for CV90861: 0
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: DY58878
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: ZZ39888
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: TH58497
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: ER30681
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: TL75240
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL75240%27 HTTP/1.1" 200 None
2026-03-27 10:55:03 [auto1.de] INFO: Scrape type for TL75240: 0
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: TS09948
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: XF01324
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF01324%27 HTTP/1.1" 200 None
2026-03-27 10:55:03 [auto1.de] INFO: Scrape type for XF01324: 0
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: TH04354
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH04354%27 HTTP/1.1" 200 None
2026-03-27 10:55:03 [auto1.de] INFO: Scrape type for TH04354: 0
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: UN47464
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN47464%27 HTTP/1.1" 200 None
2026-03-27 10:55:03 [auto1.de] INFO: Scrape type for UN47464: 0
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: JJ12232
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: UY48646
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: UX06727
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX06727%27 HTTP/1.1" 200 None
2026-03-27 10:55:03 [auto1.de] INFO: Scrape type for UX06727: 0
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: NJ45071
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: YM33158
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM33158%27 HTTP/1.1" 200 None
2026-03-27 10:55:03 [auto1.de] INFO: Scrape type for YM33158: 0
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: WX81960
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: NE88394
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: DX08468
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: WG82326
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG82326%27 HTTP/1.1" 200 None
2026-03-27 10:55:03 [auto1.de] INFO: Scrape type for WG82326: 0
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: ZP97267
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: FH51774
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: BB62931
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB62931%27 HTTP/1.1" 200 None
2026-03-27 10:55:03 [auto1.de] INFO: Scrape type for BB62931: 0
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: SA60451
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: VG22858
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: UX22346
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX22346%27 HTTP/1.1" 200 None
2026-03-27 10:55:03 [auto1.de] INFO: Scrape type for UX22346: 0
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: HA89318
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: FW04904
2026-03-27 10:55:03 [auto1.de] INFO: Found listing with ID: CL69426
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL69426%27 HTTP/1.1" 200 None
2026-03-27 10:55:03 [auto1.de] INFO: Scrape type for CL69426: 0
2026-03-27 10:55:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:07 [scrapy.extensions.logstats] INFO: Crawled 536 pages (at 11 pages/min), scraped 949 items (at 5 items/min)
2026-03-27 10:55:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-27 10:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:09 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 10606 | hits on page: 40
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: JZ88133
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: ET53588
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: KW21361
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW21361%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for KW21361: 0
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: YC46871
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: EY69917
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY69917%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for EY69917: 0
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: WD56041
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD56041%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for WD56041: 0
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: SC15486
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: ZK43312
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK43312%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for ZK43312: 0
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: CR96910
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR96910%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for CR96910: 0
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: YH01782
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: LL77007
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: FG10184
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG10184%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for FG10184: 0
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: CH66916
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX98591%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for VX98591: 0
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: XY65669
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY65669%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for XY65669: 0
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: UV74950
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: UU82281
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU82281%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for UU82281: 0
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: BK85524
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK85524%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for BK85524: 0
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: FK01435
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK01435%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for FK01435: 0
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: RY30617
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: DU95569
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU95569%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for DU95569: 0
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: FX79800
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB64458%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for NB64458: 0
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: ND00067
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: EW75184
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: XU56057
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: HV43954
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: AC43250
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: KW54654
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW54654%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for KW54654: 0
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: RM09243
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: DX70553
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX70553%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for DX70553: 0
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: FL68688
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL68688%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for FL68688: 0
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: YH14948
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: VU02651
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: WA18225
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: HM56678
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM56678%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for HM56678: 0
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: KL40189
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: JY59533
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY59533%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for JY59533: 0
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: JJ76956
2026-03-27 10:55:09 [auto1.de] INFO: Found listing with ID: KT42001
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT42001%27 HTTP/1.1" 200 None
2026-03-27 10:55:09 [auto1.de] INFO: Scrape type for KT42001: 0
2026-03-27 10:55:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:10 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 10607 | hits on page: 40
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: KT42001
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT42001%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for KT42001: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: UM76329
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: NW01608
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01608%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for NW01608: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: WN03807
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: UY94475
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: FD42571
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD42571%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for FD42571: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: XP88597
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP88597%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for XP88597: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: CR90100
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR90100%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for CR90100: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: HY95420
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: ZA81194
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: JM68743
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: RE64912
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE64912%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for RE64912: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: DG38505
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG38505%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for DG38505: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: HE70736
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: BJ62056
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ62056%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for BJ62056: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: PY86398
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: HH46084
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH46084%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for HH46084: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: ZN42603
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: BK72669
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: SB57558
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB57558%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for SB57558: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: DB03654
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: TP68313
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: YU79688
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU79688%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for YU79688: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: TW16812
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW16812%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for TW16812: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: US30386
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: YC48203
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: UD38277
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD38277%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for UD38277: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: UV91231
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: MH95521
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH95521%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for MH95521: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: KP93453
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: LT64510
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT64510%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for LT64510: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: UM70587
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: TM51786
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM51786%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for TM51786: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: DE00247
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE00247%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for DE00247: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: HC23327
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC23327%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for HC23327: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: XN24576
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: TE00128
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE00128%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for TE00128: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: AJ12624
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ12624%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for AJ12624: 0
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: RX73377
2026-03-27 10:55:10 [auto1.de] INFO: Found listing with ID: ME37510
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME37510%27 HTTP/1.1" 200 None
2026-03-27 10:55:10 [auto1.de] INFO: Scrape type for ME37510: 0
2026-03-27 10:55:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:11 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 10607 | hits on page: 40
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: AV36611
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV36611%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Scrape type for AV36611: 0
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: JU56361
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU56361%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Scrape type for JU56361: 0
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: HY25182
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY25182%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Scrape type for HY25182: 0
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: GB84908
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: LL58580
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL58580%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Scrape type for LL58580: 0
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: JZ57355
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ57355%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Scrape type for JZ57355: 0
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: GK17867
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: PP04784
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: DP32451
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP32451%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Scrape type for DP32451: 0
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: ZT09373
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT09373%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Scrape type for ZT09373: 0
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: ZR29667
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR29667%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Scrape type for ZR29667: 0
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: WP68659
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: ET02524
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: RC17718
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC17718%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Scrape type for RC17718: 0
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: XT96782
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT96782%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Scrape type for XT96782: 0
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: JN60731
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: XE63092
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE63092%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Scrape type for XE63092: 0
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: HW30039
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: AU19422
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU19422%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Scrape type for AU19422: 0
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: VL59137
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: BN17260
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: GB19740
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB19740%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Scrape type for GB19740: 0
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: TF56080
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: CN49074
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN49074%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Scrape type for CN49074: 0
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: BA46324
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: BH54798
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: LR89229
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: YB11592
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB11592%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Scrape type for YB11592: 0
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: SZ29379
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: XV66059
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV66059%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Scrape type for XV66059: 0
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: RB98965
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB98965%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Scrape type for RB98965: 0
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: HC87215
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC87215%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for HC87215: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: UX34233
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: WC50601
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC50601%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for WC50601: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: LS17715
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: DB79259
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: DH62820
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: KE22848
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE22848%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for KE22848: 0
2026-03-27 10:55:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:13 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 10607 | hits on page: 40
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: XH29629
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: FW12178
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW12178%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for FW12178: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: PR18701
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: MG11664
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: XK45819
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK45819%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for XK45819: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: GB40015
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: RL13206
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: FB64910
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB64910%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for FB64910: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: RV11848
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV11848%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for RV11848: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: CU73818
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU73818%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for CU73818: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: WK69880
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: ML46855
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: MW50067
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: ZH11790
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: CU51755
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: HE37410
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: NU57672
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU57672%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for NU57672: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: GW32993
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: TG31378
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: JP66680
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: CB60323
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB60323%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for CB60323: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: WP53621
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: PJ59933
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: AA02702
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA02702%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for AA02702: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: ZT59384
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT59384%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for ZT59384: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: TC76143
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC76143%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for TC76143: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: LS25336
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS25336%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for LS25336: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: GN33962
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN33962%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for GN33962: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: RG13558
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG13558%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for RG13558: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: DP86097
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: MN62628
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: ZE34717
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: EG28758
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG28758%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for EG28758: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: KX24759
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24759%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for KX24759: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: GC11554
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC11554%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for GC11554: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: TB35174
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB35174%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for TB35174: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: BP68912
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP68912%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for BP68912: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: UZ20743
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ20743%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for UZ20743: 0
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: NC35073
2026-03-27 10:55:13 [auto1.de] INFO: Found listing with ID: YR67686
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR67686%27 HTTP/1.1" 200 None
2026-03-27 10:55:13 [auto1.de] INFO: Scrape type for YR67686: 0
2026-03-27 10:55:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:14 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 10607 | hits on page: 40
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: BN04520
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: PD38264
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD38264%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for PD38264: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: HT70874
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT70874%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for HT70874: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: BW91385
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: VF29678
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: RD82198
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: CL91899
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: NM74138
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM74138%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for NM74138: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: XC72019
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: HE50023
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE50023%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for HE50023: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: HU58633
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: CB03549
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB03549%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for CB03549: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: YR22562
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: ZM52158
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM52158%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for ZM52158: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: DB47248
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: AD61123
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: RE97546
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE97546%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for RE97546: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: UY74069
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: BS21339
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: VT62851
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: UF15161
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: BK98649
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK98649%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for BK98649: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: FE98948
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE98948%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for FE98948: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: BL76191
2026-03-27 10:55:15 [auto1.de] INFO: Found listing with ID: KN35431
2026-03-27 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN35431%27 HTTP/1.1" 200 None
2026-03-27 10:55:15 [auto1.de] INFO: Scrape type for KN35431: 0
2026-03-27 10:55:15 [auto1.de] INFO: Found listing with ID: PR12884
2026-03-27 10:55:15 [auto1.de] INFO: Found listing with ID: CG56804
2026-03-27 10:55:15 [auto1.de] INFO: Found listing with ID: CP21456
2026-03-27 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP21456%27 HTTP/1.1" 200 None
2026-03-27 10:55:15 [auto1.de] INFO: Scrape type for CP21456: 0
2026-03-27 10:55:15 [auto1.de] INFO: Found listing with ID: GU21129
2026-03-27 10:55:15 [auto1.de] INFO: Found listing with ID: DS18768
2026-03-27 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS18768%27 HTTP/1.1" 200 None
2026-03-27 10:55:15 [auto1.de] INFO: Scrape type for DS18768: 0
2026-03-27 10:55:15 [auto1.de] INFO: Found listing with ID: KH43150
2026-03-27 10:55:15 [auto1.de] INFO: Found listing with ID: TA51177
2026-03-27 10:55:15 [auto1.de] INFO: Found listing with ID: GC53073
2026-03-27 10:55:15 [auto1.de] INFO: Found listing with ID: MT32670
2026-03-27 10:55:15 [auto1.de] INFO: Found listing with ID: MV81221
2026-03-27 10:55:15 [auto1.de] INFO: Found listing with ID: YL92048
2026-03-27 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL92048%27 HTTP/1.1" 200 None
2026-03-27 10:55:15 [auto1.de] INFO: Scrape type for YL92048: 0
2026-03-27 10:55:15 [auto1.de] INFO: Found listing with ID: HD85457
2026-03-27 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD85457%27 HTTP/1.1" 200 None
2026-03-27 10:55:15 [auto1.de] INFO: Scrape type for HD85457: 0
2026-03-27 10:55:15 [auto1.de] INFO: Found listing with ID: BX01019
2026-03-27 10:55:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:19 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 10607 | hits on page: 40
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: AB71807
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: HN95943
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: RM36299
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM36299%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for RM36299: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: LN55732
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN55732%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for LN55732: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: HX68002
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: YZ92189
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ92189%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for YZ92189: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: ZW96978
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW96978%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for ZW96978: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: ST79736
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: UB06797
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: JF89335
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF89335%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for JF89335: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: NP57126
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: SV97177
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: TC11139
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC11139%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for TC11139: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: NX49590
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX49590%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for NX49590: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: NX05955
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: KW02770
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW02770%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for KW02770: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: JA95391
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA95391%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for JA95391: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: MM26769
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM26769%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for MM26769: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: ZU63901
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: XN97050
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: XK43305
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: KV44298
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: YE23414
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE23414%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for YE23414: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: ZZ49819
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ49819%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for ZZ49819: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: SK78109
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK78109%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for SK78109: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: BT66227
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT66227%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for BT66227: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: LK69228
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK69228%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for LK69228: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: HB99974
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB99974%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for HB99974: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: SN35212
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN35212%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for SN35212: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: NX84743
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX84743%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for NX84743: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: MR54336
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: VN46065
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN46065%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for VN46065: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: SD48131
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: NR80587
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: LC36947
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: CX13675
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: VS58629
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: JC51889
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC51889%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for JC51889: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: SH15635
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH15635%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for SH15635: 0
2026-03-27 10:55:19 [auto1.de] INFO: Found listing with ID: VC66912
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC66912%27 HTTP/1.1" 200 None
2026-03-27 10:55:19 [auto1.de] INFO: Scrape type for VC66912: 0
2026-03-27 10:55:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:20 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 10607 | hits on page: 40
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: TM56515
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM56515%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for TM56515: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: PR12496
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: DG73763
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: WA27160
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA27160%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for WA27160: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: NF62451
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF62451%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for NF62451: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: DF46066
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: JV58210
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: DP83508
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ08081%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for VJ08081: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: TS77331
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS77331%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for TS77331: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: CY68154
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: KC84817
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: PG04042
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: UB37420
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: EY95977
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95977%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for EY95977: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: CP67844
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP67844%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for CP67844: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: BN04464
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN04464%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for BN04464: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: DW90423
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW90423%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for DW90423: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: PS83792
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: FZ21407
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: ZP94489
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP94489%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for ZP94489: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: AL79898
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: CW96220
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW96220%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for CW96220: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: WY46685
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY46685%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for WY46685: 0
2026-03-27 10:55:21 [auto1.de] INFO: Found listing with ID: DS74769
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS74769%27 HTTP/1.1" 200 None
2026-03-27 10:55:21 [auto1.de] INFO: Scrape type for DS74769: 0
2026-03-27 10:55:21 [auto1.de] INFO: Found listing with ID: JF44958
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF44958%27 HTTP/1.1" 200 None
2026-03-27 10:55:21 [auto1.de] INFO: Scrape type for JF44958: 0
2026-03-27 10:55:21 [auto1.de] INFO: Found listing with ID: SY15259
2026-03-27 10:55:21 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG07111%27 HTTP/1.1" 200 None
2026-03-27 10:55:21 [auto1.de] INFO: Scrape type for GG07111: 0
2026-03-27 10:55:21 [auto1.de] INFO: Found listing with ID: NV48400
2026-03-27 10:55:21 [auto1.de] INFO: Found listing with ID: SJ64601
2026-03-27 10:55:21 [auto1.de] INFO: Found listing with ID: NS01283
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS01283%27 HTTP/1.1" 200 None
2026-03-27 10:55:21 [auto1.de] INFO: Scrape type for NS01283: 0
2026-03-27 10:55:21 [auto1.de] INFO: Found listing with ID: ML79860
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML79860%27 HTTP/1.1" 200 None
2026-03-27 10:55:21 [auto1.de] INFO: Scrape type for ML79860: 0
2026-03-27 10:55:21 [auto1.de] INFO: Found listing with ID: TN06340
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN06340%27 HTTP/1.1" 200 None
2026-03-27 10:55:21 [auto1.de] INFO: Scrape type for TN06340: 0
2026-03-27 10:55:21 [auto1.de] INFO: Found listing with ID: EC42355
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC42355%27 HTTP/1.1" 200 None
2026-03-27 10:55:21 [auto1.de] INFO: Scrape type for EC42355: 0
2026-03-27 10:55:21 [auto1.de] INFO: Found listing with ID: BS50452
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS50452%27 HTTP/1.1" 200 None
2026-03-27 10:55:21 [auto1.de] INFO: Scrape type for BS50452: 0
2026-03-27 10:55:21 [auto1.de] INFO: Found listing with ID: JD73338
2026-03-27 10:55:21 [auto1.de] INFO: Found listing with ID: JF93037
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF93037%27 HTTP/1.1" 200 None
2026-03-27 10:55:21 [auto1.de] INFO: Scrape type for JF93037: 0
2026-03-27 10:55:21 [auto1.de] INFO: Found listing with ID: RL32447
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL32447%27 HTTP/1.1" 200 None
2026-03-27 10:55:21 [auto1.de] INFO: Scrape type for RL32447: 0
2026-03-27 10:55:21 [auto1.de] INFO: Found listing with ID: UD93265
2026-03-27 10:55:21 [auto1.de] INFO: Found listing with ID: KH68440
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH68440%27 HTTP/1.1" 200 None
2026-03-27 10:55:21 [auto1.de] INFO: Scrape type for KH68440: 0
2026-03-27 10:55:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:22 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 10607 | hits on page: 40
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: UH76939
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: LC48893
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC48893%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for LC48893: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: ZB54489
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: AU07521
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: NX98463
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98463%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for NX98463: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: NP40069
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: EN53778
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: DC75837
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC75837%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for DC75837: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: YR16927
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: KD74504
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD74504%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for KD74504: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: EN76399
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: EB80315
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: DL80467
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: MD28081
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: ED14712
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED14712%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for ED14712: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: KB53133
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB53133%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for KB53133: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: TB48945
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: HZ36583
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: CZ59156
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ59156%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for CZ59156: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: ZF59355
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: EA50597
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA50597%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for EA50597: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: GC08040
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC08040%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for GC08040: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: AK76136
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK76136%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for AK76136: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: MK06365
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: VN58412
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: XL61450
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL61450%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for XL61450: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: WP25478
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: TP89237
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP89237%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for TP89237: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: WM33738
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: ZP20879
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: FT09783
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT09783%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for FT09783: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: NZ71829
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: AH41759
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH41759%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for AH41759: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: MV84683
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV84683%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for MV84683: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: YU90808
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU90808%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for YU90808: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: ZP64735
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP64735%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for ZP64735: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: NF21329
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF21329%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for NF21329: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: FF57158
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: GZ67786
2026-03-27 10:55:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:26 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 10607 | hits on page: 40
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: TZ87798
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ87798%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for TZ87798: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: MR24892
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: TE34583
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: YB72786
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27093%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for PJ27093: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: FZ97744
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ97744%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for FZ97744: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: TP64554
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: PT12721
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: LE52779
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: FT73137
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT73137%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for FT73137: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: AB18320
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB18320%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for AB18320: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: VE76243
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: UE09477
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: JK08938
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: LV13893
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: AL17067
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: AH35551
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: RE14454
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: XP15110
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: TS18866
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: TW29404
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: FF47276
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF47276%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for FF47276: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: KF34969
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: WZ73407
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ73407%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for WZ73407: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: UX81688
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: EL91919
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91919%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for EL91919: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: GA83394
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: HB55504
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: GT72696
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT72696%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for GT72696: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: FL38962
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: XT77229
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT77229%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for XT77229: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: KE28324
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: TU13960
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: PH00246
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00246%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for PH00246: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: AD85372
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD85372%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for AD85372: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: CJ89630
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: ZB28652
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: FW67106
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW67106%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for FW67106: 0
2026-03-27 10:55:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:28 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 10607 | hits on page: 40
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: TR08832
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: RJ38519
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: FR82494
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR82494%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for FR82494: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: SV83384
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV83384%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for SV83384: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: VB81192
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: XR23222
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR23222%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for XR23222: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: ZD81952
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD81952%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for ZD81952: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: SP79691
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: CK82561
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: NC10753
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: AA21269
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: DR99675
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: KZ84912
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: YC07614
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC07614%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for YC07614: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: AN57238
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: ZP05972
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP05972%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for ZP05972: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: BV90927
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: HX49125
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: NV35238
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: WT43265
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT43265%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for WT43265: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: PL22285
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: UY11294
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY11294%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for UY11294: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: TC91223
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC91223%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for TC91223: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: CD78722
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: KF51408
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: PF70269
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF70269%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for PF70269: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: YP19637
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: SG73532
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG73532%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for SG73532: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: RY10355
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: GW05981
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: ZB62380
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: VJ67162
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: NG64881
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: XC12317
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC12317%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for XC12317: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: LG34778
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG34778%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for LG34778: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: SP10962
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: JR52924
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: PE04478
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: GU34646
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: LU79813
2026-03-27 10:55:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:35 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 10608 | hits on page: 40
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: LU79813
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: PV07453
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: RT55405
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT55405%27 HTTP/1.1" 200 None
2026-03-27 10:55:35 [auto1.de] INFO: Scrape type for RT55405: 0
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: KY88001
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY88001%27 HTTP/1.1" 200 None
2026-03-27 10:55:35 [auto1.de] INFO: Scrape type for KY88001: 0
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: EP09152
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: VP80711
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: HX20102
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: DN50713
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN50713%27 HTTP/1.1" 200 None
2026-03-27 10:55:35 [auto1.de] INFO: Scrape type for DN50713: 0
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: XH67268
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: RH56856
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: JG94045
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG94045%27 HTTP/1.1" 200 None
2026-03-27 10:55:35 [auto1.de] INFO: Scrape type for JG94045: 0
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: MP29574
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: KP40091
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP40091%27 HTTP/1.1" 200 None
2026-03-27 10:55:35 [auto1.de] INFO: Scrape type for KP40091: 0
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: ZS20777
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS20777%27 HTTP/1.1" 200 None
2026-03-27 10:55:35 [auto1.de] INFO: Scrape type for ZS20777: 0
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: MJ05239
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: EY91378
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: ZY01103
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: CC77808
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: AA51268
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51268%27 HTTP/1.1" 200 None
2026-03-27 10:55:35 [auto1.de] INFO: Scrape type for AA51268: 0
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: TU83793
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: BK73994
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: YD84326
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD84326%27 HTTP/1.1" 200 None
2026-03-27 10:55:35 [auto1.de] INFO: Scrape type for YD84326: 0
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: RM29704
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: VV35001
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: CU82641
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: NA98474
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA98474%27 HTTP/1.1" 200 None
2026-03-27 10:55:35 [auto1.de] INFO: Scrape type for NA98474: 0
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: NL55322
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL55322%27 HTTP/1.1" 200 None
2026-03-27 10:55:35 [auto1.de] INFO: Scrape type for NL55322: 0
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: WG42712
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: WD62968
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: ME75055
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME75055%27 HTTP/1.1" 200 None
2026-03-27 10:55:35 [auto1.de] INFO: Scrape type for ME75055: 0
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: JT38047
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: XU25249
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: YR65508
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR65508%27 HTTP/1.1" 200 None
2026-03-27 10:55:35 [auto1.de] INFO: Scrape type for YR65508: 0
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: SW54282
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: JZ86765
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: LH55149
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: EA46191
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA46191%27 HTTP/1.1" 200 None
2026-03-27 10:55:35 [auto1.de] INFO: Scrape type for EA46191: 0
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: NT94381
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT94381%27 HTTP/1.1" 200 None
2026-03-27 10:55:35 [auto1.de] INFO: Scrape type for NT94381: 0
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: CS95133
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS95133%27 HTTP/1.1" 200 None
2026-03-27 10:55:35 [auto1.de] INFO: Scrape type for CS95133: 0
2026-03-27 10:55:35 [auto1.de] INFO: Found listing with ID: VF04675
2026-03-27 10:55:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:36 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 10609 | hits on page: 40
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: VF04675
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: FH63073
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH63073%27 HTTP/1.1" 200 None
2026-03-27 10:55:36 [auto1.de] INFO: Scrape type for FH63073: 0
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: ZD07127
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD07127%27 HTTP/1.1" 200 None
2026-03-27 10:55:36 [auto1.de] INFO: Scrape type for ZD07127: 0
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: WS95832
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS95832%27 HTTP/1.1" 200 None
2026-03-27 10:55:36 [auto1.de] INFO: Scrape type for WS95832: 0
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: CR20682
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: SD24929
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: SH25844
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW19119%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for VW19119: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: DF78416
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: VT89208
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT89208%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for VT89208: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: HB39069
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB39069%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for HB39069: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: GS12438
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS12438%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for GS12438: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: VK33407
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK33407%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for VK33407: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: WE84338
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE84338%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for WE84338: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: LH79634
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH79634%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for LH79634: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: XS15243
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: GG09705
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG09705%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for GG09705: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: RJ57220
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ57220%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for RJ57220: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: CJ93593
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ93593%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for CJ93593: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: YP24650
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: PX72797
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: KV91783
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV91783%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for KV91783: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: KF03787
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: FX70736
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: WP34180
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: AT93996
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: JM32956
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: YF17855
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF17855%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for YF17855: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: US29975
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: TX74544
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: MT29038
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: KA13570
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA13570%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for KA13570: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: EW55752
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW55752%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for EW55752: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: RR91926
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: FN32397
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN32397%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for FN32397: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: GP35635
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: XA58573
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA58573%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for XA58573: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: AS95642
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS95642%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for AS95642: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: WC43161
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: FC70073
2026-03-27 10:55:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:38 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 10609 | hits on page: 40
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: PA93267
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: LL10892
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: SB47402
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB47402%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for SB47402: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: TJ17702
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: UU71497
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: CA94630
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: VW86065
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW86065%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for VW86065: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: UX96397
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: PP17491
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: VM73254
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: NY78602
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: LU10384
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU10384%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for LU10384: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: VG17915
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG17915%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for VG17915: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: SR89713
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR89713%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for SR89713: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: ZN00220
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN00220%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for ZN00220: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: YF34625
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF34625%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for YF34625: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: LM34580
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM34580%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for LM34580: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: CA52910
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA52910%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for CA52910: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: WG43761
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG43761%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for WG43761: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: CU14282
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU14282%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for CU14282: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: UN40728
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN40728%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for UN40728: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: MN70772
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN70772%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for MN70772: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: TN82564
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: EA44859
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA44859%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for EA44859: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: NZ41454
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ41454%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for NZ41454: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: GF09833
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: YF15540
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: LS92579
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS92579%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for LS92579: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: EV62209
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: PM30121
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM30121%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for PM30121: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: WG89224
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: EP59038
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: MV80796
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV80796%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for MV80796: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: NW23822
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: UT55299
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: SN69565
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN69565%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for SN69565: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: EC58729
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC58729%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for EC58729: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: MT34659
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT34659%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for MT34659: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: CH63331
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH63331%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for CH63331: 0
2026-03-27 10:55:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:39 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 10610 | hits on page: 40
2026-03-27 10:55:39 [auto1.de] INFO: Found listing with ID: CH63331
2026-03-27 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH63331%27 HTTP/1.1" 200 None
2026-03-27 10:55:39 [auto1.de] INFO: Scrape type for CH63331: 0
2026-03-27 10:55:39 [auto1.de] INFO: Found listing with ID: XN53400
2026-03-27 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN53400%27 HTTP/1.1" 200 None
2026-03-27 10:55:39 [auto1.de] INFO: Scrape type for XN53400: 0
2026-03-27 10:55:39 [auto1.de] INFO: Found listing with ID: DU13995
2026-03-27 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13995%27 HTTP/1.1" 200 None
2026-03-27 10:55:39 [auto1.de] INFO: Scrape type for DU13995: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: LE65557
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: MA40694
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA40694%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for MA40694: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: RX80315
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80315%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for RX80315: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: VV56220
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: NV18768
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV18768%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for NV18768: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: AM83584
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: FZ54460
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ54460%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for FZ54460: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: RX96869
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: FJ03790
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: XC96921
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: LZ79063
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: XG22155
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: MN03229
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN03229%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for MN03229: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: UE28528
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: JP42070
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: TX07305
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: SP96872
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: HB59808
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: VK92736
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: EX50371
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX50371%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for EX50371: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: JH81808
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH81808%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for JH81808: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: MW99242
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: RE13510
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE13510%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for RE13510: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: KT12333
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT12333%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for KT12333: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: JK98125
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK98125%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for JK98125: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: ND84220
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND84220%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for ND84220: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: LP56741
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP56741%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for LP56741: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: ZG25746
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG25746%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for ZG25746: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: GL06639
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: AA89468
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA89468%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for AA89468: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: VJ91223
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: HR08840
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR08840%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for HR08840: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: HX46872
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: NK36025
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK36025%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for NK36025: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: FK17584
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: TN75370
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN75370%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for TN75370: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: KG16630
2026-03-27 10:55:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:44 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 10610 | hits on page: 40
2026-03-27 10:55:44 [auto1.de] INFO: Found listing with ID: DZ26668
2026-03-27 10:55:44 [auto1.de] INFO: Found listing with ID: AA38462
2026-03-27 10:55:44 [auto1.de] INFO: Found listing with ID: ME72144
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72144%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for ME72144: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: UY05499
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: FM01284
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: SD14498
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD14498%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for SD14498: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: SH08334
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH08334%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for SH08334: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: AP99471
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: TS13333
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS13333%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for TS13333: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: BJ99536
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ99536%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for BJ99536: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: FD48176
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD48176%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for FD48176: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: SY31526
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: PD05251
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD05251%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for PD05251: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: NB51207
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB51207%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for NB51207: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: WY14478
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: SF00674
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: YY85891
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: JJ86337
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ86337%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for JJ86337: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: BF99828
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF99828%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for BF99828: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: GF36565
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF36565%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for GF36565: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: WE14198
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE14198%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for WE14198: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: FH08441
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH08441%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for FH08441: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: SH34728
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: DR71954
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR71954%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for DR71954: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: JS67569
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS67569%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for JS67569: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: GL70534
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: KA69379
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: YM15308
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM15308%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for YM15308: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: FJ28912
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ28912%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for FJ28912: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: BF15182
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF15182%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for BF15182: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: FJ90232
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ90232%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for FJ90232: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: WU59517
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: KS68262
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS68262%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for KS68262: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: MF87973
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: KU34267
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU34267%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for KU34267: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: LP17470
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP17470%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for LP17470: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: TM22078
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: BP83751
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP83751%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for BP83751: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: DR55440
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR55440%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for DR55440: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: XJ41325
2026-03-27 10:55:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:46 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 10610 | hits on page: 40
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: EZ66449
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ66449%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for EZ66449: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: UL70925
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL70925%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for UL70925: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: JG51855
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: VH46900
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH46900%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for VH46900: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: CH25964
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: SD08227
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: YC42355
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: JR27484
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: UG57897
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: PP98476
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP98476%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for PP98476: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: VP79611
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: DM73323
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM73323%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for DM73323: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: MU75641
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU75641%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for MU75641: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: WP89589
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: RL43389
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: SV07694
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV07694%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for SV07694: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: BZ06260
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ06260%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for BZ06260: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: DE53161
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE53161%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for DE53161: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: FH12952
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH12952%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for FH12952: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: XU08667
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: TC34691
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC34691%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for TC34691: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: NT99648
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: KT88198
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT88198%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for KT88198: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: NM13557
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM13557%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for NM13557: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: RU20217
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU20217%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for RU20217: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: SX80762
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX80762%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for SX80762: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: LB67403
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: AC08857
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC08857%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for AC08857: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: ZJ94268
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ94268%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for ZJ94268: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: UT71403
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: PW27553
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW27553%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for PW27553: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: MC26208
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: XV29391
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: WV72742
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: KW93098
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: KV90234
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV90234%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for KV90234: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: GG85995
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG85995%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for GG85995: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: DX27890
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: BL06566
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL06566%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for BL06566: 0
2026-03-27 10:55:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:47 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 10610 | hits on page: 40
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: JH03969
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: HE06850
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: LD36602
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD36602%27 HTTP/1.1" 200 None
2026-03-27 10:55:47 [auto1.de] INFO: Scrape type for LD36602: 0
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: CN66331
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN66331%27 HTTP/1.1" 200 None
2026-03-27 10:55:47 [auto1.de] INFO: Scrape type for CN66331: 0
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: DP99201
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP99201%27 HTTP/1.1" 200 None
2026-03-27 10:55:47 [auto1.de] INFO: Scrape type for DP99201: 0
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: PK97822
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK97822%27 HTTP/1.1" 200 None
2026-03-27 10:55:47 [auto1.de] INFO: Scrape type for PK97822: 0
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: SB50693
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: BV38468
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV38468%27 HTTP/1.1" 200 None
2026-03-27 10:55:47 [auto1.de] INFO: Scrape type for BV38468: 0
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: UK10359
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: HG78965
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG78965%27 HTTP/1.1" 200 None
2026-03-27 10:55:47 [auto1.de] INFO: Scrape type for HG78965: 0
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: SG66334
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG66334%27 HTTP/1.1" 200 None
2026-03-27 10:55:47 [auto1.de] INFO: Scrape type for SG66334: 0
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: RF93551
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF93551%27 HTTP/1.1" 200 None
2026-03-27 10:55:47 [auto1.de] INFO: Scrape type for RF93551: 0
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: DH76315
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: YJ06008
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ06008%27 HTTP/1.1" 200 None
2026-03-27 10:55:47 [auto1.de] INFO: Scrape type for YJ06008: 0
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: XL57324
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: GR15178
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR15178%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for GR15178: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: PK44731
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK44731%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for PK44731: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: GC65720
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC65720%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for GC65720: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: KR79365
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR79365%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for KR79365: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: VU62303
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU62303%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for VU62303: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: WP32258
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: DH25431
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH25431%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for DH25431: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: MT15247
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT15247%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for MT15247: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: JG57844
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: FE86204
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: RT01188
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT01188%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for RT01188: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: RY89799
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY89799%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for RY89799: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: VB04886
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB04886%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for VB04886: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: SE03748
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: AT99674
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: VC24078
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC24078%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for VC24078: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: FJ41734
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: VZ54866
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ54866%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for VZ54866: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: KR74096
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: KV82053
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV82053%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for KV82053: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: MT27523
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: WX69164
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX69164%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for WX69164: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: BR38332
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR38332%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for BR38332: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: RL37734
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL37734%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for RL37734: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: BB62949
2026-03-27 10:55:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:49 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 10610 | hits on page: 40
2026-03-27 10:55:49 [auto1.de] INFO: Found listing with ID: VL42983
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL42983%27 HTTP/1.1" 200 None
2026-03-27 10:55:49 [auto1.de] INFO: Scrape type for VL42983: 0
2026-03-27 10:55:49 [auto1.de] INFO: Found listing with ID: NZ53793
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ53793%27 HTTP/1.1" 200 None
2026-03-27 10:55:49 [auto1.de] INFO: Scrape type for NZ53793: 2
2026-03-27 10:55:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af7da7c8-ba66-5578-852d-903a9b97a278 with identifier: NZ53793
2026-03-27 10:55:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af7da7c8-ba66-5578-852d-903a9b97a278 with scrape type 2
2026-03-27 10:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af7da7c8-ba66-5578-852d-903a9b97a278 with scrape type 2
2026-03-27 10:55:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af7da7c8-ba66-5578-852d-903a9b97a278, identifier: NZ53793
2026-03-27 10:55:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af7da7c8-ba66-5578-852d-903a9b97a278 with identifier: NZ53793
2026-03-27 10:55:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af7da7c8-ba66-5578-852d-903a9b97a278 with identifier: NZ53793
2026-03-27 10:55:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af7da7c8-ba66-5578-852d-903a9b97a278 with identifier: NZ53793 to the API
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:55:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-27T16:59:16Z',
'fuel_type': 'diesel',
'id': 'af7da7c8-ba66-5578-852d-903a9b97a278',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ53793',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Amarok',
'odometer': 110658,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-31',
'seller_name': None,
'title': 'Volkswagen Amarok 2.0 TDI Trendline DoubleCab 4Motion',
'transmission': 'manual',
'trim': 'Trendline DoubleCab 4Motion',
'year': 2012}
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ53793%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Saving data for NZ53793: {'auction_closing_time': 1774630756.0, 'created_time': 1773830219.903618, 'last_price_update_time': 1774608950.040573}
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ53793') HTTP/1.1" 204 0
2026-03-27 10:55:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: TP77311
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: EH04045
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH04045%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for EH04045: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: RX79901
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: HW55427
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: WK20643
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK20643%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for WK20643: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: DP60615
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: WY77446
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH94786%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for FH94786: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: ZD77831
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: TH33343
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH33343%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for TH33343: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: YX18251
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX18251%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for YX18251: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: AD45670
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: FL47412
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: AG57248
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: MV76572
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: SR56590
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: WD56073
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD56073%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for WD56073: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: JC93229
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: KF17998
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF17998%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for KF17998: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: ZJ08757
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ08757%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for ZJ08757: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: FD36365
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: WV18755
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV18755%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for WV18755: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: EV41055
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV41055%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for EV41055: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: KR96778
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR96778%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for KR96778: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: NU10771
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: GM94362
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM94362%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for GM94362: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: LC26336
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: NF54912
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: JC71292
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: TA17370
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA17370%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for TA17370: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: GV09238
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: CS89362
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: HF40608
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF40608%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for HF40608: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: TX62945
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: KR13539
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: DA94168
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: CP53358
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: HT15929
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT15929%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for HT15929: 0
2026-03-27 10:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:51 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 10610 | hits on page: 40
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: CK72706
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72706%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for CK72706: 2
2026-03-27 10:55:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34c72606-c2d4-56ee-b99d-7c8a27d83b98 with identifier: CK72706
2026-03-27 10:55:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34c72606-c2d4-56ee-b99d-7c8a27d83b98 with scrape type 2
2026-03-27 10:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34c72606-c2d4-56ee-b99d-7c8a27d83b98 with scrape type 2
2026-03-27 10:55:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34c72606-c2d4-56ee-b99d-7c8a27d83b98, identifier: CK72706
2026-03-27 10:55:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34c72606-c2d4-56ee-b99d-7c8a27d83b98 with identifier: CK72706
2026-03-27 10:55:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34c72606-c2d4-56ee-b99d-7c8a27d83b98 with identifier: CK72706
2026-03-27 10:55:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34c72606-c2d4-56ee-b99d-7c8a27d83b98 with identifier: CK72706 to the API
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:55:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-27T16:12:21Z',
'fuel_type': 'diesel',
'id': '34c72606-c2d4-56ee-b99d-7c8a27d83b98',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK72706',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 51646,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-06',
'seller_name': None,
'title': 'Audi A4 40 TDI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2020}
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72706%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Saving data for CK72706: {'auction_closing_time': 1774627941.0, 'created_time': 1773344415.113027, 'last_price_update_time': 1774608951.73318}
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK72706') HTTP/1.1" 204 0
2026-03-27 10:55:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: AY92583
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: AB52853
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: DL80875
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: JJ00405
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ00405%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for JJ00405: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: GL26328
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: CE25056
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: UH39337
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH39337%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for UH39337: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: RW57073
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW57073%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for RW57073: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: AG51690
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: NS06519
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: AJ98197
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: YC74395
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC74395%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for YC74395: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: VG84212
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: NH53039
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: MZ57576
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: TR39575
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR39575%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for TR39575: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: GH06629
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH06629%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for GH06629: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: KJ15454
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: LY90714
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY90714%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for LY90714: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: VR66092
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR66092%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for VR66092: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: FJ62780
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ62780%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for FJ62780: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: DF37743
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF37743%27 HTTP/1.1" 200 None
2026-03-27 10:55:52 [auto1.de] INFO: Scrape type for DF37743: 0
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: ZF28173
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: ME61701
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: XF39485
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: EU09221
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU09221%27 HTTP/1.1" 200 None
2026-03-27 10:55:52 [auto1.de] INFO: Scrape type for EU09221: 0
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: RT92200
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: MP73357
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP73357%27 HTTP/1.1" 200 None
2026-03-27 10:55:52 [auto1.de] INFO: Scrape type for MP73357: 0
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: CT63766
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT63766%27 HTTP/1.1" 200 None
2026-03-27 10:55:52 [auto1.de] INFO: Scrape type for CT63766: 0
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: ZZ04091
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ04091%27 HTTP/1.1" 200 None
2026-03-27 10:55:52 [auto1.de] INFO: Scrape type for ZZ04091: 0
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: XV74427
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: LX71659
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: AT28488
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT28488%27 HTTP/1.1" 200 None
2026-03-27 10:55:52 [auto1.de] INFO: Scrape type for AT28488: 0
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: EG42583
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG42583%27 HTTP/1.1" 200 None
2026-03-27 10:55:52 [auto1.de] INFO: Scrape type for EG42583: 0
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: LZ64363
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ64363%27 HTTP/1.1" 200 None
2026-03-27 10:55:52 [auto1.de] INFO: Scrape type for LZ64363: 0
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: JK99996
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK99996%27 HTTP/1.1" 200 None
2026-03-27 10:55:52 [auto1.de] INFO: Scrape type for JK99996: 0
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: BK32051
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: HN46656
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: AW59691
2026-03-27 10:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:53 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 10610 | hits on page: 40
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: VM70947
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM70947%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for VM70947: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: HD11508
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: CK60135
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK60135%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for CK60135: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: VR97346
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: ZG11710
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG11710%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for ZG11710: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: RX02406
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: TW53975
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW53975%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for TW53975: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: VF27943
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF27943%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for VF27943: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: NC80324
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC80324%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for NC80324: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: RL91217
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL91217%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for RL91217: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: NB86362
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: EF16593
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: YK91002
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: MY86649
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: HT53845
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: BH49655
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH49655%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for BH49655: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: SK50734
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK50734%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for SK50734: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: ZZ02833
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ02833%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for ZZ02833: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: GD09618
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: CW35231
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: VV25463
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV25463%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for VV25463: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: HY87386
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: JH33807
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: KG51970
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG51970%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for KG51970: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: MV64182
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: SV54413
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV54413%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for SV54413: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: SC28168
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC28168%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for SC28168: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: KV92241
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: UL92999
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL92999%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for UL92999: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: AZ12624
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ12624%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for AZ12624: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: TW11648
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW11648%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for TW11648: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: CU60081
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: SM51987
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM51987%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for SM51987: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: TY25896
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: FJ12691
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: HA27527
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: JT36836
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT36836%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for JT36836: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: HM53441
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: XN01413
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: PX36804
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX36804%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for PX36804: 0
2026-03-27 10:55:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:54 [auto1.de] INFO: Channel: 24h | Page: 153 | totalHits: 10611 | hits on page: 40
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: PX36804
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX36804%27 HTTP/1.1" 200 None
2026-03-27 10:55:54 [auto1.de] INFO: Scrape type for PX36804: 0
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: CB84596
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: SR06825
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: FZ79276
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: KN24500
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN24500%27 HTTP/1.1" 200 None
2026-03-27 10:55:54 [auto1.de] INFO: Scrape type for KN24500: 0
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: NN85060
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN85060%27 HTTP/1.1" 200 None
2026-03-27 10:55:54 [auto1.de] INFO: Scrape type for NN85060: 2
2026-03-27 10:55:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1147b085-cbb0-521e-860f-920619ea5386 with identifier: NN85060
2026-03-27 10:55:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1147b085-cbb0-521e-860f-920619ea5386 with scrape type 2
2026-03-27 10:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1147b085-cbb0-521e-860f-920619ea5386 with scrape type 2
2026-03-27 10:55:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1147b085-cbb0-521e-860f-920619ea5386, identifier: NN85060
2026-03-27 10:55:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1147b085-cbb0-521e-860f-920619ea5386 with identifier: NN85060
2026-03-27 10:55:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1147b085-cbb0-521e-860f-920619ea5386 with identifier: NN85060
2026-03-27 10:55:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1147b085-cbb0-521e-860f-920619ea5386 with identifier: NN85060 to the API
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:55:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 72,
'expiration_date': '2026-03-27T16:46:24Z',
'fuel_type': 'petrol',
'id': '1147b085-cbb0-521e-860f-920619ea5386',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN85060',
'listing': 'auction',
'make': 'Citroen',
'model': 'C1',
'odometer': 83126,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-29',
'seller_name': None,
'title': 'Citroen C1 1.0 VTi Origins',
'transmission': 'manual',
'trim': 'Origins',
'year': 2020}
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN85060%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Saving data for NN85060: {'auction_closing_time': 1774629984.0, 'created_time': 1774423874.964631, 'last_price_update_time': 1774608955.023367}
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN85060') HTTP/1.1" 204 0
2026-03-27 10:55:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: RR48020
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: FN32159
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN32159%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for FN32159: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: TY96424
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY96424%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for TY96424: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: KC52744
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: ML82340
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML82340%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for ML82340: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: ZD44688
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: KA32583
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: LX44936
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX44936%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for LX44936: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: KG10806
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG10806%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for KG10806: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: JY58234
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY58234%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for JY58234: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: LM84236
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV28684%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for GV28684: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: HT38824
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: XY24138
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY24138%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for XY24138: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: UK22592
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK22592%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for UK22592: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: ZW43695
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: AV92070
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: VR71281
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR71281%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for VR71281: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: GP42203
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: UF59044
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF59044%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for UF59044: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: UR35427
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR35427%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for UR35427: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: VU18540
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: RS74296
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: TP36932
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP36932%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for TP36932: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: PH88321
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH88321%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for PH88321: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: MG66726
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: AN69467
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: XM11846
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: TZ15393
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: LF57012
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF57012%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for LF57012: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: NH37075
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH37075%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for NH37075: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: SS40295
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS40295%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for SS40295: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: TW14325
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: AZ27432
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ27432%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for AZ27432: 0
2026-03-27 10:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:56 [auto1.de] INFO: Channel: 24h | Page: 154 | totalHits: 10611 | hits on page: 40
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: MT86254
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT86254%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for MT86254: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: FN23082
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: RY27380
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY27380%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for RY27380: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: FV34689
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: BM74248
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: HZ43600
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: KW02679
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW02679%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for KW02679: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: PY59919
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: XR64222
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR64222%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for XR64222: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: HT55645
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: WP00727
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP00727%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for WP00727: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: LJ19691
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ19691%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for LJ19691: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: HV98245
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: XE44885
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: TL37084
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: JC38309
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC38309%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for JC38309: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: PT11126
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT11126%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for PT11126: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: ZE87532
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE87532%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for ZE87532: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: UE64486
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE64486%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for UE64486: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: PF00888
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: WB57730
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB57730%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for WB57730: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: MP90537
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: KX93717
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: EU61165
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU61165%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for EU61165: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: NV63188
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV63188%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for NV63188: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: XL89060
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL89060%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for XL89060: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: WM92411
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: CH92359
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH92359%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for CH92359: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: TS98691
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: FK65857
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK65857%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for FK65857: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: XH30741
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH30741%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for XH30741: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: DS36264
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: PY20785
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY20785%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for PY20785: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91085%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for XT91085: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: AS81057
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: BS29922
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS29922%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for BS29922: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: LX06278
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX06278%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for LX06278: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: EY81923
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY81923%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for EY81923: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: DH11736
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH11736%27 HTTP/1.1" 200 None
2026-03-27 10:55:56 [auto1.de] INFO: Scrape type for DH11736: 0
2026-03-27 10:55:56 [auto1.de] INFO: Found listing with ID: XU07051
2026-03-27 10:55:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:58 [auto1.de] INFO: Channel: 24h | Page: 155 | totalHits: 10612 | hits on page: 40
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: XU07051
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: ZT67074
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: GN34545
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN34545%27 HTTP/1.1" 200 None
2026-03-27 10:55:58 [auto1.de] INFO: Scrape type for GN34545: 0
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: PL36428
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL36428%27 HTTP/1.1" 200 None
2026-03-27 10:55:58 [auto1.de] INFO: Scrape type for PL36428: 0
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: DN56642
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1"